<
Single Day: Oct 5▾
> Reset
View JSON API

Environment: DEV

Failure patterns: 45 · Failures matched: 558 · Total runs: 77 · Runs affected: 62

Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs.Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern).Number of distinct job runs where this failure pattern was detected.Percentage of all job runs in this environment affected by this failure pattern during the selected window.Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate.TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size.Also inOther environments where the same failure pattern was also detected during the selected window.
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hype...
full failure pattern:
ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet; provider Microsoft.RedHatOpenShift
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
e2e11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:403]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x394650f4c690>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-txc4g676jchd" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
      "name": "b74958ca-74c5-4aed-bdef-2d25ccfd763f",
      "status": "Failed",
      "startTime": "2026-10-05T22:11:10.271614632Z",
      "endTime": "2026-10-05T22:30:19.790444395Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x394650f4c678>{
                errs: [
                    <*fmt.wrapError | 0x394650914540>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x394651164040>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x394651e824c0>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x394651e82480>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x394651e82400>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x394651e823c0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x394652251040>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n  \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x394652250900>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n  \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x3946515b1020>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "afe2deb3-54d4-4b50-a32f-f2d06131e56f",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 22:30:27 GMT",
                                ],
                                "Content-Length": ["620"],
                                "X-Envoy-Upstream-Service-Time": ["9"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x394652250820>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 49, 49, 58, 49, 48, 46, 50, 55, 49, 54, 49, 52, 54, 51, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 51, 48, 58, 49, 57, 46, 55, 57, 48, 52, 52, 52, 51, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 110, 111, 116, 32, 99, 97, 99, 104, 101, 100, 32, 121, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 620,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j1538688.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
                                    Fragment: "",
                                    RawQuery: "api-version=2026-09-01-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "fffb22aa-0f4c-43e9-89d1-09d2bda795e6",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "0f6fdf15-8ef6-489d-a565-de2b11510c75",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T22:30:27Z\"}",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j1538688.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j1538688.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x394651770ec0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bd760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n  \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:403]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x394650f4c690>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-txc4g676jchd" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
      "name": "b74958ca-74c5-4aed-bdef-2d25ccfd763f",
      "status": "Failed",
      "startTime": "2026-10-05T22:11:10.271614632Z",
      "endTime": "2026-10-05T22:30:19.790444395Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x394650f4c678>{
                errs: [
                    <*fmt.wrapError | 0x394650914540>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x394651164040>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x394651e824c0>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x394651e82480>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x394651e82400>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x394651e823c0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x394652251040>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n  \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x394652250900>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-txc4g676jchd\" to finish creating: GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n  \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x3946515b1020>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "afe2deb3-54d4-4b50-a32f-f2d06131e56f",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 22:30:27 GMT",
                                ],
                                "Content-Length": ["620"],
                                "X-Envoy-Upstream-Service-Time": ["9"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x394652250820>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 52, 57, 53, 56, 99, 97, 45, 55, 52, 99, 53, 45, 52, 97, 101, 100, 45, 98, 100, 101, 102, 45, 50, 100, 50, 53, 99, 99, 102, 100, 55, 54, 51, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 49, 49, 58, 49, 48, 46, 50, 55, 49, 54, 49, 52, 54, 51, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 50, 58, 51, 48, 58, 49, 57, 46, 55, 57, 48, 52, 52, 52, 51, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 110, 111, 116, 32, 99, 97, 99, 104, 101, 100, 32, 121, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 620,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j1538688.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f",
                                    Fragment: "",
                                    RawQuery: "api-version=2026-09-01-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "fffb22aa-0f4c-43e9-89d1-09d2bda795e6",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "0f6fdf15-8ef6-489d-a565-de2b11510c75",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T22:30:27Z\"}",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j1538688.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j1538688.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x394651770ec0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bd760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j1538688.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"name\": \"b74958ca-74c5-4aed-bdef-2d25ccfd763f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T22:11:10.271614632Z\",\n  \"endTime\": \"2026-10-05T22:30:19.790444395Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift node pool not cached yet\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster and node pools with aggregated advanced features1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #63642107216083751538688
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeploymentFailed; detail code BadRequest; detail message The requested operation cannot be performed because the database account arohcpci01-rp-j1672192 is in the proc...
full failure pattern:
ERROR CODE: DeploymentFailed; detail code BadRequest; detail message The requested operation cannot be performed because the database account arohcpci01-rp-j1672192 is in the process of being created. Please wait until account creation completes and retry the operation.\\\\\\\ \\\\\\ ActivityId: <uuid>, Microsoft.Azure.Documents.Common/2.14.0"\\\ \\ }; provider Microsoft.DocumentDB
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
provision11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
time=2026-10-05T23:36:27.137Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n  Kind: ARM\n  Template: templates/region.bicep\n  Parameters: configurations/region.tmpl.bicepparam"
time=2026-10-05T23:36:28.752Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-10-05T23:36:29.424Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=5dd69a04f62785b0df4182f2e62bb16930ed2731284e7680f8dc157ea0096d63 portal=https://ms.portal.azure.com/#view/Microsoft_Azure_Resources/DeploymentDetails.MenuView/~/overview/id/%2Fsubscriptions%2FXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%2FresourceGroups%2Fhcp-underlay-ci01-j1672192%2Fproviders%2FMicrosoft.Resources%2Fdeployments%2F5dd69a04f62785b0df4182f2e62bb16930ed2731284e7680f8dc157ea0096d63
time=2026-10-05T23:38:29.834Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j1672192/providers/Microsoft.Resources/deployments/5dd69a04f62785b0df4182f2e62bb16930ed2731284e7680f8dc157ea0096d63/operationStatuses/08584103634964314871\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j1672192/providers/Microsoft.Resources/deployments/rp-cosmos-account\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"BadRequest\\\",\\r\\n            \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j1672192/providers/Microsoft.DocumentDB/databaseAccounts/arohcpci01-rp-j1672192\\\",\\r\\n            \\\"message\\\": \\\"{\\\\r\\\\n  \\\\\\\"code\\\\\\\": \\\\\\\"BadRequest\\\\\\\",\\\\r\\\\n  \\\\\\\"message\\\\\\\": \\\\\\\"The requested operation cannot be performed because the database account arohcpci01-rp-j1672192 is in the process of being created. Please wait until account creation completes and retry the operation.\\\\\\\\r\\\\\\\\nActivityId: 75b0de9b-7548-4bae-95bc-f97589468144, Microsoft.Azure.Documents.Common/2.14.0\\\\\\\"\\\\r\\\\n}\\\"\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"
Contributing tests (1)
Failed AtJobTestSupport
provisionpull-ci-Azure-ARO-HCP-main-e2e-parallelRun pipeline step Microsoft.Azure.ARO.HCP.Region/regional/infra1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #71052107245692081672192
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeploymentFailed; detail code DeploymentActive; detail message The deployment with resource id '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers...
full failure pattern:
ERROR CODE: DeploymentFailed; detail code DeploymentActive; detail message The deployment with resource id '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Resources/deployments/profile-thqgrr3ymebbw' cannot be saved, because this would overwrite an existing deployment which is still active. If this is an intentional re-deployment, please wait for the original deployment to complete, or cancel it before re-attempting the operation. The previous deployment was started at '<timestamp>' with correlationId '<uuid>', and will expire at '<timestamp>' if it does not complete before then.
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
provision11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
time=2026-10-05T17:12:22.862Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2 description="Step nsp\n  Kind: ARM\n  Template: templates/mgmt-nsp.bicep\n  Parameters: configurations/mgmt-nsp.tmpl.bicepparam"
time=2026-10-05T17:12:23.287Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2
time=2026-10-05T17:12:24.013Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2 deployment=e2e1fa40714c294cc444d45df7d65e7230bd956473842bf5c4f49c5bfba93caa portal=https://ms.portal.azure.com/#view/Microsoft_Azure_Resources/DeploymentDetails.MenuView/~/overview/id/%2Fsubscriptions%2FXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%2FresourceGroups%2Fhcp-underlay-ci01-j9265280-mgmt-2%2Fproviders%2FMicrosoft.Resources%2Fdeployments%2Fe2e1fa40714c294cc444d45df7d65e7230bd956473842bf5c4f49c5bfba93caa
time=2026-10-05T17:13:24.301Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=nsp stamp=2 err="stamp 2: failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9265280-mgmt-2/providers/Microsoft.Resources/deployments/e2e1fa40714c294cc444d45df7d65e7230bd956473842bf5c4f49c5bfba93caa/operationStatuses/08584103865419476507\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"DeploymentActive\\\",\\r\\n    \\\"message\\\": \\\"The deployment with resource id '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j9265280-mgmt-2/providers/Microsoft.Resources/deployments/profile-thqgrr3ymebbw' cannot be saved, because this would overwrite an existing deployment which is still active. If this is an intentional re-deployment, please wait for the original deployment to complete, or cancel it before re-attempting the operation. The previous deployment was started at '10/5/2026 5:12:37 PM' with correlationId '9bd28390-2035-44ef-a1dc-d068a232c592', and will expire at '10/12/2026 5:12:37 PM' if it does not complete before then. Please see https://aka.ms/arm-deploy-resources for usage details.\\\"\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"
Contributing tests (1)
Failed AtJobTestSupport
provisionpull-ci-Azure-ARO-HCP-main-e2e-parallelRun pipeline step Microsoft.Azure.ARO.HCP.Management.Infra/management/nsp (stamp=2)1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73602107145790039265280
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: DeploymentFailed; detail code NotFound; detail message Resource '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.ManagedIdentity/user...
full failure pattern:
ERROR CODE: DeploymentFailed; detail code NotFound; detail message Resource '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-puller' was not found.; provider Microsoft.ManagedIdentity
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
provision11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
time=2026-10-05T09:59:52.082Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2 description="Step cluster\n  Kind: ARM\n  Template: templates/mgmt-cluster.bicep\n  Parameters: configurations/mgmt-cluster.tmpl.bicepparam"
time=2026-10-05T09:59:52.761Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2
time=2026-10-05T09:59:53.566Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2 deployment=c9397b972a000626b7c9dd06c82246169ec346b2e88665f7f2672f34e557c5c2 portal=https://ms.portal.azure.com/#view/Microsoft_Azure_Resources/DeploymentDetails.MenuView/~/overview/id/%2Fsubscriptions%2FXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX%2FresourceGroups%2Fhcp-underlay-ci01-j2945792-mgmt-2%2Fproviders%2FMicrosoft.Resources%2Fdeployments%2Fc9397b972a000626b7c9dd06c82246169ec346b2e88665f7f2672f34e557c5c2
time=2026-10-05T10:01:54.159Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster stamp=2 err="stamp 2: failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2945792-mgmt-2/providers/Microsoft.Resources/deployments/c9397b972a000626b7c9dd06c82246169ec346b2e88665f7f2672f34e557c5c2/operationStatuses/08584104124922522992\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2945792-mgmt-2/providers/Microsoft.Resources/deployments/aks-cluster-post\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"NotFound\\\",\\r\\n            \\\"message\\\": \\\"Resource '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2945792-mgmt-2/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-puller' was not found.\\\"\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"
Contributing tests (1)
Failed AtJobTestSupport
provisionpull-ci-Azure-ARO-HCP-main-e2e-parallelRun pipeline step Microsoft.Azure.ARO.HCP.Management.Infra/management/cluster (stamp=2)1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #67462107039414742945792
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRERROR CODE: InvalidRequestContent; detail message Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/<subscription>/resourcegroups/<resource-gro...
full failure pattern:
ERROR CODE: InvalidRequestContent; detail message Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.Monitor/accounts/services-j2198528; provider Microsoft.Monitor
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
e2e11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:493]: failed to create alert processing rule
Unexpected error:
    <*errors.errorString | 0x383c4f08c1e0>: 
    expected status 200, got 400: {
        "error": {
            "code": "InvalidRequestContent",
            "message": "Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528"
        }
    }
    {
        s: "expected status 200, got 400: {\n    \"error\": {\n        \"code\": \"InvalidRequestContent\",\n        \"message\": \"Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528\"\n    }\n}",
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:493]: failed to create alert processing rule
Unexpected error:
    <*errors.errorString | 0x383c4f08c1e0>: 
    expected status 200, got 400: {
        "error": {
            "code": "InvalidRequestContent",
            "message": "Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528"
        }
    }
    {
        s: "expected status 200, got 400: {\n    \"error\": {\n        \"code\": \"InvalidRequestContent\",\n        \"message\": \"Invalid scope(s) in request: at least one of these scopes is required: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/hcps-j2198528,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528; got: /subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-ci01-j2198528/providers/Microsoft.Monitor/accounts/services-j2198528\"\n    }\n}",
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelSRE should be able to perform alert processing rule CRUD operations1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73102107140685202198528
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRUnauthorized
full failure pattern:
Unauthorized
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
e2e11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:128]: failed to disable kube-proxy via network operator patch
Unexpected error:
    <*errors.StatusError | 0x1122950dbe00>: 
    Unauthorized
    {
        ErrStatus: {
            TypeMeta: {Kind: "", APIVersion: ""},
            ListMeta: {
                SelfLink: "",
                ResourceVersion: "",
                Continue: "",
                RemainingItemCount: nil,
                ShardInfo: nil,
            },
            Status: "Failure",
            Message: "Unauthorized",
            Reason: "Unauthorized",
            Details: nil,
            Code: 401,
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:128]: failed to disable kube-proxy via network operator patch
Unexpected error:
    <*errors.StatusError | 0x1122950dbe00>: 
    Unauthorized
    {
        ErrStatus: {
            TypeMeta: {Kind: "", APIVersion: ""},
            ListMeta: {
                SelfLink: "",
                ResourceVersion: "",
                Continue: "",
                RemainingItemCount: nil,
                ShardInfo: nil,
            },
            Status: "Failure",
            Message: "Unauthorized",
            Reason: "Unauthorized",
            Details: nil,
            Code: 401,
        },
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73312107244242656038912
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRVerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "<url>": context deadline exceeded
full failure pattern:
VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "<url>": context deadline exceeded
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
e2e11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
    <*fmt.wrapError | 0x1ec2e1beb2e0>: 
    VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud": context deadline exceeded
    {
        msg: "VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
        err: <*fmt.wrapError | 0x1ec2e1beafe0>{
            msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
            err: <*url.Error | 0x1ec2e1a4fb60>{
                Op: "Get",
                URL: "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud",
                Err: <context.deadlineExceededError>{},
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
    <*fmt.wrapError | 0x1ec2e1beb2e0>: 
    VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud": context deadline exceeded
    {
        msg: "VerifyDefaultIngressCertificate timed out after 35m0.003s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
        err: <*fmt.wrapError | 0x1ec2e1beafe0>{
            msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud\": context deadline exceeded",
            err: <*url.Error | 0x1ec2e1a4fb60>{
                Op: "Get",
                URL: "https://agnhost-e2e-sample-app-twj87.apps.aro.r5v0b5h5l4z1l6s.jobe.j9797888.hcp.osadev.cloud",
                Err: <context.deadlineExceededError>{},
            },
        },
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should serve the default ingress certificate through public ingress with OCP candidate channel for 5.11
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73252107206247269797888
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRVerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-d...
full failure pattern:
VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
e2e11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_container_registry.go:257]: [day 2] pod in namespace acr-pull-test-day2 never pulled image ubi-minimal from private ACR acrpull6864z6s54xlk.azurecr.io
Unexpected error:
    <*fmt.wrapError | 0x88c3b4bd360>: 
    VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:
      - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a
    {
        msg: "VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n  - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
        err: <*errors.errorString | 0x88c3b30f800>{
            s: "expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n  - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_container_registry.go:257]: [day 2] pod in namespace acr-pull-test-day2 never pulled image ubi-minimal from private ACR acrpull6864z6s54xlk.azurecr.io
Unexpected error:
    <*fmt.wrapError | 0x88c3b4bd360>: 
    VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:
      - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a
    {
        msg: "VerifyImagePulled(acrpull6864z6s54xlk.azurecr.io/ubi-minimal) timed out after 2m0.006s: expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n  - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
        err: <*errors.errorString | 0x88c3b30f800>{
            s: "expected image from acrpull6864z6s54xlk.azurecr.io/ubi-minimal in namespace acr-pull-test-day2: image pull errors:\n  - pod acr-pull-test container acr-pull-test: ErrImagePull - unable to pull image or OCI artifact: pull image err: initializing source docker://acrpull6864z6s54xlk.azurecr.io/ubi-minimal:latest: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 3e6da004-1a48-4c61-b7cd-2c06205130ad; artifact err: image reference: get manifest from ref: create image source: unable to retrieve auth token: invalid username/password: unauthorized: authentication required, visit https://aka.ms/acr/authorization for more information. CorrelationId: 2c421171-6e86-4b5b-8da9-c36681c3d54a",
        },
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster with ACR pull via managed identity and pull from a private ACR1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73132107245793541885952
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRalert [hcp] KubeDeploymentRolloutStuck fired
full failure pattern:
alert [hcp] KubeDeploymentRolloutStuck fired
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
alert11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
alert fired 2 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T12:54:04Z
  Ended:       2026-10-05T13:00:05Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentRolloutStuck", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", condition="Progressing", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", reason="progressdeadlineexceeded", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", status="false"
  Description: Rollout of deployment ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/capi-provider is not progressing for longer than 30 minutes.
Firing 2:
  State:       Resolved
  Started:     2026-10-05T12:54:04Z
  Ended:       2026-10-05T13:00:05Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentRolloutStuck", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", condition="Progressing", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", reason="progressdeadlineexceeded", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", status="false"
  Description: Rollout of deployment ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/capi-provider is not progressing for longer than 30 minutes.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [hcp] alert KubeDeploymentRolloutStuck does not fire1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73492107066190932217856
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRfailed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQ...
full failure pattern:
failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQL: let _startTime = datetime(2026-10-04T19:42:22
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
e2e11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:96]: Timed out after 600.004s.
Expected success, but got an error:
    <*fmt.wrapError | 0x260bcea34260>: 
    failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);
    let _endTime = datetime(2026-10-05T19:42:22.1821449Z);
    // Extract cluster ID from CS logs using cid field
    let _cs_cluster_id = toscalar(
        database('ServiceLogs').table('clustersServiceLogs')
        | where timestamp between (_startTime .. _endTime)
        | where resource_id has 'kusto-logs-xj24lxzh8jt8'
        | where isnotempty(log.cid)
        | distinct tostring(log.cid)
        | limit 1
    );
    // Find all Maestro resource IDs for this cluster
    let maestro_resource_ids = (
        database('ServiceLogs').table('containerLogs')
        | where timestamp between (_startTime .. _endTime)
        | where namespace_name has "maestro"
        | extend logStr = tostring(log)
        | where logStr has _cs_cluster_id
        | extend resourceId = extract(@'resourceid[=:"]+([a-f0-9\-]+)', 1, logStr)
        | where isnotempty(resourceId)
        | distinct resourceId
    );
    // Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent
    union
        (
            // Maestro logs: Resource bundle operations for this cluster and its associated resources
            // Includes: resource creation, updates, deletions, status events, gRPC communications
            database('ServiceLogs').table('containerLogs')
            | where timestamp between (_startTime .. _endTime)
            | where namespace_name has "maestro"
            | extend logStr = tostring(log)
            | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)
            | project timestamp, container_name, msg = logStr, log
        ),
        (
            // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs
            // Includes the CR reconciliation logs
            database('ServiceLogs').table('containerLogs')
            | where timestamp between (_startTime .. _endTime)
            | where namespace_name has "hypershift"
            | extend logStr = tostring(log)
            | where logStr has _cs_cluster_id
            | project timestamp, container_name, msg = logStr, log
        ),
        (
            // ACM Agent logs: ManifestWork reconciliation on the managed cluster
            // Includes: work agent operations, manifest application, status feedback
            database('ServiceLogs').table('containerLogs')
            | where timestamp between (_startTime .. _endTime)
            | where namespace_name has "open-cluster-management-agent"
            | extend logStr = tostring(log)
            | where logStr has _cs_cluster_id
            | project timestamp, container_name, msg = logStr, log
        )
    | order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:"LimitsExceeded", Message:"Request is invalid and cannot be executed.", Description:"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..", Type:"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException", Context:v2.ErrorContext{Timestamp:"2026-10-05T19:42:30.9508158Z", ServiceAlias:"HCP-DEV-US-2", MachineName:"", ProcessName:"", ProcessId:0, ThreadId:0, ClientRequestId:"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4", ActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", SubActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityType:"GW.Http.CallContext", ParentActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityStack:"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)"}, IsPermanent:false})
    {
        msg: "failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
        err: <*errors.joinError | 0x260bd06af728>{
            errs: [
                <*fmt.wrapError | 0x260bcea34240>{
                    msg: "failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                    err: <*fmt.wrapError | 0x260bcea34220>{
                        msg: "error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                        err: <*fmt.wrapError | 0x260bcfe34b60>{
                            msg: "failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                            err: <*fmt.wrapError | 0x260bcfe34b00>{
                                msg: "failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                                err: <*v2.OneApiError | 0x260bcef76000>{
                                    ErrorMessage: {
                                        Code: "LimitsExceeded",
                                        Message: "Request is invalid and cannot be executed.",
                                        Description: "Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..",
                                        Type: "Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException",
                                        Context: {
                                            Timestamp: ...,
                                            ServiceAlias: ...,
                                            MachineName: ...,
                                            ProcessName: ...,
                                            ProcessId: ...,
                                            ThreadId: ...,
                                            ClientRequestId: ...,
                                            ActivityId: ...,
                                            SubActivityId: ...,
                                            ActivityType: ...,
                                            ParentActivityId: ...,
                                            ActivityStack: ...,
                                        },
                                        IsPermanent: false,
                                    },
                                },
                            },
                        },
                    },
                },
            ],
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:96]: Timed out after 600.004s.
Expected success, but got an error:
    <*fmt.wrapError | 0x260bcea34260>: 
    failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query "detailedInfraOrchestrationLogs" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);
    let _endTime = datetime(2026-10-05T19:42:22.1821449Z);
    // Extract cluster ID from CS logs using cid field
    let _cs_cluster_id = toscalar(
        database('ServiceLogs').table('clustersServiceLogs')
        | where timestamp between (_startTime .. _endTime)
        | where resource_id has 'kusto-logs-xj24lxzh8jt8'
        | where isnotempty(log.cid)
        | distinct tostring(log.cid)
        | limit 1
    );
    // Find all Maestro resource IDs for this cluster
    let maestro_resource_ids = (
        database('ServiceLogs').table('containerLogs')
        | where timestamp between (_startTime .. _endTime)
        | where namespace_name has "maestro"
        | extend logStr = tostring(log)
        | where logStr has _cs_cluster_id
        | extend resourceId = extract(@'resourceid[=:"]+([a-f0-9\-]+)', 1, logStr)
        | where isnotempty(resourceId)
        | distinct resourceId
    );
    // Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent
    union
        (
            // Maestro logs: Resource bundle operations for this cluster and its associated resources
            // Includes: resource creation, updates, deletions, status events, gRPC communications
            database('ServiceLogs').table('containerLogs')
            | where timestamp between (_startTime .. _endTime)
            | where namespace_name has "maestro"
            | extend logStr = tostring(log)
            | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)
            | project timestamp, container_name, msg = logStr, log
        ),
        (
            // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs
            // Includes the CR reconciliation logs
            database('ServiceLogs').table('containerLogs')
            | where timestamp between (_startTime .. _endTime)
            | where namespace_name has "hypershift"
            | extend logStr = tostring(log)
            | where logStr has _cs_cluster_id
            | project timestamp, container_name, msg = logStr, log
        ),
        (
            // ACM Agent logs: ManifestWork reconciliation on the managed cluster
            // Includes: work agent operations, manifest application, status feedback
            database('ServiceLogs').table('containerLogs')
            | where timestamp between (_startTime .. _endTime)
            | where namespace_name has "open-cluster-management-agent"
            | extend logStr = tostring(log)
            | where logStr has _cs_cluster_id
            | project timestamp, container_name, msg = logStr, log
        )
    | order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:"LimitsExceeded", Message:"Request is invalid and cannot be executed.", Description:"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..", Type:"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException", Context:v2.ErrorContext{Timestamp:"2026-10-05T19:42:30.9508158Z", ServiceAlias:"HCP-DEV-US-2", MachineName:"", ProcessName:"", ProcessId:0, ThreadId:0, ClientRequestId:"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4", ActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", SubActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityType:"GW.Http.CallContext", ParentActivityId:"f7c0f10d-28d1-4f0c-aa3d-b966d3722931", ActivityStack:"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)"}, IsPermanent:false})
    {
        msg: "failed to gather logs: failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
        err: <*errors.joinError | 0x260bd06af728>{
            errs: [
                <*fmt.wrapError | 0x260bcea34240>{
                    msg: "failed to execute custom logs query: error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                    err: <*fmt.wrapError | 0x260bcea34220>{
                        msg: "error during query execution: failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                        err: <*fmt.wrapError | 0x260bcfe34b60>{
                            msg: "failed to execute query: failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                            err: <*fmt.wrapError | 0x260bcfe34b00>{
                                msg: "failed to read query \"detailedInfraOrchestrationLogs\" result (KQL: let _startTime = datetime(2026-10-04T19:42:22.1821447Z);\nlet _endTime = datetime(2026-10-05T19:42:22.1821449Z);\n// Extract cluster ID from CS logs using cid field\nlet _cs_cluster_id = toscalar(\n    database('ServiceLogs').table('clustersServiceLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where resource_id has 'kusto-logs-xj24lxzh8jt8'\n    | where isnotempty(log.cid)\n    | distinct tostring(log.cid)\n    | limit 1\n);\n// Find all Maestro resource IDs for this cluster\nlet maestro_resource_ids = (\n    database('ServiceLogs').table('containerLogs')\n    | where timestamp between (_startTime .. _endTime)\n    | where namespace_name has \"maestro\"\n    | extend logStr = tostring(log)\n    | where logStr has _cs_cluster_id\n    | extend resourceId = extract(@'resourceid[=:\"]+([a-f0-9\\-]+)', 1, logStr)\n    | where isnotempty(resourceId)\n    | distinct resourceId\n);\n// Infrastructure & Orchestration Logs - Maestro, Hypershift, and ACM Agent\nunion\n    (\n        // Maestro logs: Resource bundle operations for this cluster and its associated resources\n        // Includes: resource creation, updates, deletions, status events, gRPC communications\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"maestro\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id or logStr has_any (maestro_resource_ids)\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // Hypershift logs: Hypershift operator reconciliation of HostedCluster and NodePool CRs\n        // Includes the CR reconciliation logs\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"hypershift\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    ),\n    (\n        // ACM Agent logs: ManifestWork reconciliation on the managed cluster\n        // Includes: work agent operations, manifest application, status feedback\n        database('ServiceLogs').table('containerLogs')\n        | where timestamp between (_startTime .. _endTime)\n        | where namespace_name has \"open-cluster-management-agent\"\n        | extend logStr = tostring(log)\n        | where logStr has _cs_cluster_id\n        | project timestamp, container_name, msg = logStr, log\n    )\n| order by timestamp asc): OneApiError(Error=v2.ErrorMessage{Code:\"LimitsExceeded\", Message:\"Request is invalid and cannot be executed.\", Description:\"Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..\", Type:\"Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException\", Context:v2.ErrorContext{Timestamp:\"2026-10-05T19:42:30.9508158Z\", ServiceAlias:\"HCP-DEV-US-2\", MachineName:\"\", ProcessName:\"\", ProcessId:0, ThreadId:0, ClientRequestId:\"KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4\", ActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", SubActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityType:\"GW.Http.CallContext\", ParentActivityId:\"f7c0f10d-28d1-4f0c-aa3d-b966d3722931\", ActivityStack:\"(Activity stack: CRID=KGC.execute;7caca62d-ed6e-422a-9706-85e0c5cf40b4 ARID=f7c0f10d-28d1-4f0c-aa3d-b966d3722931 > GW.Http.CallContext/f7c0f10d-28d1-4f0c-aa3d-b966d3722931)\"}, IsPermanent:false})",
                                err: <*v2.OneApiError | 0x260bcef76000>{
                                    ErrorMessage: {
                                        Code: "LimitsExceeded",
                                        Message: "Request is invalid and cannot be executed.",
                                        Description: "Query execution has exceeded the allowed limits (80DA0003): The results of this query exceed the set limit of 64 MB, so not all records were returned (E_QUERY_RESULT_SET_TOO_LARGE, 0x80DA0003). See https://aka.ms/kustoquerylimits for more information and possible solutions..",
                                        Type: "Kusto.Data.Exceptions.KustoServicePartialQueryFailureLimitsExceededException",
                                        Context: {
                                            Timestamp: ...,
                                            ServiceAlias: ...,
                                            MachineName: ...,
                                            ProcessName: ...,
                                            ProcessId: ...,
                                            ThreadId: ...,
                                            ClientRequestId: ...,
                                            ActivityId: ...,
                                            SubActivityId: ...,
                                            ActivityType: ...,
                                            ParentActivityId: ...,
                                            ActivityStack: ...,
                                        },
                                        IsPermanent: false,
                                    },
                                },
                            },
                        },
                    },
                },
            ],
        },
    }
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelEngineering should be able to retrieve kusto logs for a cluster and services1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #71052107168847067877376
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRfailed to roll out Helm release: unable to continue with install: could not get information about the resource Deployment "maestro-agent" in namespace "<namespace>": the server wa...
full failure pattern:
failed to roll out Helm release: unable to continue with install: could not get information about the resource Deployment "maestro-agent" in namespace "<namespace>": the server was unable to return a response in the time allotted, but may still be processing
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
provision11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
time=2026-10-05T22:09:08.885Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 description="Step deploy\n Kind: Helm\n"
time=2026-10-05T22:09:09.811Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 values="map[azure:map[clientId:f8b6549e-d7f6-4ed0-9e41-251cd63c5293 cloudEnvironmentName:AzurePublicCloud tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] broker:map[host:arohcp-ci01-maestro-j9785984.westus3-1.ts.eventgrid.azure.net port:8883] consumerName:hcp-underlay-j9785984-mgmt-1 credsKeyVault:map[name:ah-ci01-mg-j9785984-1 secret:hcp-underlay-j9785984-mgmt-1] deployment:map[zoneCount:3] glog_v:2 image:map[digest:sha256:9af415e086251e94f471e03844ce768bed6493653b6cabdaff68acf99573679d registry:arohcpsvcdev.azurecr.io repository:redhat-user-workloads/maestro-rhtap-tenant/maestro/maestro] installAppliedManifestWorkCRD:false replicas:1 serviceAccountName:maestro sideCar:map[image:map[digest:sha256:3a8316d42c6491dbc15f2cf59985901365c7c402d3a0649abe695a4a6554654e registry:mcr.microsoft.com repository:azurelinux/base/nginx]]]"
time=2026-10-05T22:09:09.811Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1
time=2026-10-05T22:09:25.359Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 namespace=maestro
time=2026-10-05T22:09:40.945Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 dryRun=false
time=2026-10-05T22:09:40.945Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1
time=2026-10-05T22:09:41.070Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1
time=2026-10-05T22:11:59.108Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 err="unable to continue with install: could not get information about the resource Deployment \"maestro-agent\" in namespace \"maestro\": the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps maestro-agent)"
time=2026-10-05T22:11:59.108Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Maestro.Agent resourceGroup=management step=deploy stamp=1 err="stamp 1: error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: unable to continue with install: could not get information about the resource Deployment \"maestro-agent\" in namespace \"maestro\": the server was unable to return a response in the time allotted, but may still be processing the request (get deployments.apps maestro-agent)"
Contributing tests (1)
Failed AtJobTestSupport
provisionpull-ci-Azure-ARO-HCP-main-e2e-parallelRun pipeline step Microsoft.Azure.ARO.HCP.Maestro.Agent/management/deploy (stamp=1)1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #68202107215529679785984
Show signal detailsLikely regression — post-good=0; only seen in DEV; only seen in one PRtls: failed to verify certificate: x509: certificate signed by unknown authority
full failure pattern:
tls: failed to verify certificate: x509: certificate signed by unknown authority
Signal: RegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PR
e2e11.30%1 of 77 job runs affectedRegressionSignal: Regression — post-good=0; only seen in DEV; only seen in one PRShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
    <*fmt.wrapError | 0x3372404d8860>: 
    VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud": tls: failed to verify certificate: x509: certificate signed by unknown authority
    {
        msg: "VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
        err: <*fmt.wrapError | 0x3372404d86a0>{
            msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
            err: <*url.Error | 0x337240d25200>{
                Op: "Get",
                URL: "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                Err: <*tls.CertificateVerificationError | 0x337240d251d0>{
                    UnverifiedCertificates: [
                        {
                            Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
                            RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
                                N: {
                                    neg: false,
                                    abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [11686061353655275548, 5126660660355678701],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926798559, loc: nil},
                            NotAfter: {wall: 0, ext: 63942523959, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    Err: <x509.UnknownAuthorityError>{
                        Cert: {
                            Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
                            RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
                                N: {
                                    neg: false,
                                    abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [11686061353655275548, 5126660660355678701],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926798559, loc: nil},
                            NotAfter: {wall: 0, ext: 63942523959, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                        hintErr: nil,
                        hintCert: nil,
                    },
                },
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_serve_default_ingress_certificate_public.go:162]: sample app must return HTTP 200 over trusted HTTPS through public ingress
Unexpected error:
    <*fmt.wrapError | 0x3372404d8860>: 
    VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud": tls: failed to verify certificate: x509: certificate signed by unknown authority
    {
        msg: "VerifyDefaultIngressCertificate timed out after 35m0.006s: default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
        err: <*fmt.wrapError | 0x3372404d86a0>{
            msg: "default ingress route must serve trusted HTTPS: Get \"https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud\": tls: failed to verify certificate: x509: certificate signed by unknown authority",
            err: <*url.Error | 0x337240d25200>{
                Op: "Get",
                URL: "https://agnhost-e2e-sample-app-dlm4f.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                Err: <*tls.CertificateVerificationError | 0x337240d251d0>{
                    UnverifiedCertificates: [
                        {
                            Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
                            RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
                                N: {
                                    neg: false,
                                    abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [11686061353655275548, 5126660660355678701],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926798559, loc: nil},
                            NotAfter: {wall: 0, ext: 63942523959, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    Err: <x509.UnknownAuthorityError>{
                        Cert: {
                            Raw: [48, 130, 3, 150, 48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            RawTBSCertificate: [48, 130, 2, 126, 160, 3, 2, 1, 2, 2, 16, 71, 37, 142, 181, 88, 120, 65, 237, 162, 45, 58, 226, 192, 11, 16, 28, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 50, 48, 50, 51, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 50, 49, 50, 51, 57, 90, 48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1, 163, 129, 195, 48, 129, 192, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 68, 6, 3, 85, 29, 17, 4, 61, 48, 59, 130, 57, 42, 46, 97, 112, 112, 115, 46, 97, 114, 111, 46, 98, 48, 106, 56, 114, 48, 104, 55, 108, 56, 113, 53, 116, 51, 107, 46, 48, 109, 118, 116, 46, 106, 54, 55, 53, 50, 55, 54, 56, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 181, 148, 160, 58, 159, 44, 153, 189, 36, 197, 17, 74, 137, 78, 238, 19, 140, 39, 221, 151, 167, 22, 205, 15, 7, 40, 199, 178, 107, 108, 83, 245, 4, 15, 66, 170, 6, 2, 153, 40, 176, 5, 165, 164, 185, 6, 115, 198, 163, 250, 76, 35, 57, 212, 96, 143, 20, 7, 175, 90, 157, 208, 174, 16, 202, 199, 44, 17, 102, 244, 198, 52, 204, 65, 137, 108, 19, 135, 26, 127, 78, 51, 213, 51, 68, 81, 63, 231, 144, 40, 174, 125, 233, 62, 128, 68, 107, 11, 69, 136, 153, 13, 122, 60, 214, 15, 81, 35, 39, 146, 218, 51, 84, 201, 235, 28, 61, 57, 74, 138, 98, 177, 95, 158, 90, 13, 112, 246, 227, 22, 71, 87, 11, 179, 223, 221, 214, 151, 166, 112, 127, 75, 18, 118, 87, 138, 226, 173, 108, 74, 219, 149, 119, 92, 52, 158, 73, 189, 57, 183, 180, 127, 185, 90, 69, 109, 85, 12, 138, 96, 131, 92, 166, 33, 19, 110, 99, 130, 167, 53, 159, 121, 182, 197, 212, 91, 163, 159, 72, 20, 33, 226, 223, 108, 95, 146, 249, 93, 95, 253, 247, 125, 47, 58, 173, 102, 103, 100, 144, 223, 195, 76, 84, 188, 209, 36, 70, 100, 106, 157, 248, 188, 183, 4, 181, 237, 183, 10, 186, 221, 158, 254, 196, 110, 221, 220, 4, 211, 191, 88, 72, 240, 80, 249, 175, 35, 184, 230, 129, 148, 143, 25, 203, 142, 78, 57, 2, 3, 1, 0, 1],
                            RawSubject: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 36, 49, 34, 48, 32, 6, 3, 85, 4, 3, 19, 25, 114, 101, 115, 101, 114, 118, 101, 100, 46, 104, 99, 112, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [147, 134, 1, 10, 99, 115, 212, 128, 154, 247, 88, 143, 132, 18, 62, 104, 53, 29, 163, 204, 160, 86, 14, 144, 189, 8, 184, 211, 37, 11, 40, 146, 196, 120, 87, 249, 82, 39, 175, 243, 133, 128, 16, 181, 237, 205, 54, 58, 227, 14, 179, 200, 144, 127, 45, 145, 129, 24, 170, 240, 41, 228, 61, 99, 51, 77, 144, 12, 29, 169, 159, 25, 218, 17, 199, 182, 75, 152, 126, 179, 115, 15, 107, 196, 109, 85, 95, 213, 213, 58, 180, 53, 66, 153, 230, 39, 58, 144, 242, 96, 16, 226, 207, 0, 92, 163, 55, 242, 81, 244, 35, 243, 253, 19, 247, 198, 16, 11, 52, 54, 149, 220, 217, 58, 119, 161, 173, 86, 78, 177, 249, 121, 221, 175, 160, 140, 40, 7, 212, 180, 234, 200, 20, 32, 223, 73, 100, 92, 83, 139, 213, 173, 70, 18, 179, 17, 246, 69, 185, 16, 112, 42, 163, 187, 68, 169, 236, 189, 25, 89, 253, 108, 72, 149, 151, 150, 250, 244, 61, 80, 104, 174, 22, 117, 197, 243, 100, 97, 162, 170, 161, 255, 29, 154, 36, 83, 33, 119, 148, 212, 184, 52, 75, 236, 171, 107, 201, 4, 183, 186, 61, 72, 200, 2, 92, 39, 159, 16, 28, 82, 202, 52, 157, 129, 245, 113, 22, 70, 206, 100, 38, 180, 159, 164, 96, 252, 63, 248, 44, 185, 36, 172, 178, 93, 36, 254, 17, 239, 118, 89, 117, 197, 232, 50, 216, 210],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x337240007ac0>{
                                N: {
                                    neg: false,
                                    abs: [9337245268397936185, 5255789798456801510, 14154494615915577176, 13109335347058024190, 5072296307041548036, 10439277193874690340, 17833462028520810340, 16099347852796190717, 15302004063425798626, 7170477405477910213, 9971114008945693550, 13006318046232270092, 8600807242817419703, 6308103462559865749, 15463010847702061686, 16363344735281340381, 7111570420315025654, 6109672876023564938, 15424636460196878899, 7713335239787772476, 10387744396337381444, 5635081974936846311, 14718196154500586111, 14611695969280247348, 1443315009325149712, 11815840286537703567, 12683726052456297414, 292525798815078696, 515881726454289397, 10099284332814716175, 2649542967606308371, 13084258991057181117],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [11686061353655275548, 5126660660355678701],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "reserved.hcp.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"reserved.hcp.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926798559, loc: nil},
                            NotAfter: {wall: 0, ext: 63942523959, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: "0;\x829*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            AuthorityKeyId: [168, 251, 204, 255, 251, 89, 21, 98, 0, 191, 78, 208, 215, 20, 131, 219, 93, 195, 226, 223],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "*.apps.aro.b0j8r0h7l8q5t3k.0mvt.j6752768.hcp.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                        hintErr: nil,
                        hintCert: nil,
                    },
                },
            },
        },
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should serve the default ingress certificate through public ingress with OCP candidate channel for 5.11
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73252107065983326752768
ERROR CODE: DeadlineExceeded; provider Microsoft.Compute
full failure pattern:
ERROR CODE: DeadlineExceeded; provider Microsoft.Compute
Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 7 days
e2e3748.05%37 of 77 job runs affectedFlakeSignal: Flake — present in 2 prior week(s); spread across 7 daysShow trend detailsSep 29: 10 · Sep 30: 8 · Oct 1: 21 · Oct 2: 21 · Oct 3: 10 · Oct 4: 61 · Oct 5: 276none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:159]: failed to create node pool "np-1" for private KAS cluster "private-kas"
Unexpected error:
    <*fmt.wrapError | 0x87d3cbc4aa0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kas" in resourcegroup="private-kas-jwhp5tq4cqwd" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
      "name": "b0d48117-514b-478b-977c-25e8c43baf9c",
      "status": "Failed",
      "startTime": "2026-10-06T00:11:05.686165077Z",
      "endTime": "2026-10-06T00:30:11.474018181Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n  \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x87d3d5a41c0>{
            msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n  \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x87d3de4c3c0>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Length": ["1387"],
                        "X-Envoy-Upstream-Service-Time": ["11"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "603ab4c0-fea1-47ce-8270-c4d08c44ea6b",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:30:18 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x87d3d5a4000>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 49, 58, 48, 53, 46, 54, 56, 54, 49, 54, 53, 48, 55, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 49, 49, 46, 52, 55, 52, 48, 49, 56, 49, 56, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 49, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1387,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
                            Fragment: "",
                            RawQuery: "api-version=2025-12-23-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "4ec77276-bcdf-4f79-a17b-de505a326025",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "76f6daf9-5cb5-4a8d-a190-0b8e8b6c620f",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:18Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x87d3cd125d0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n  \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:159]: failed to create node pool "np-1" for private KAS cluster "private-kas"
Unexpected error:
    <*fmt.wrapError | 0x87d3cbc4aa0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kas" in resourcegroup="private-kas-jwhp5tq4cqwd" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
      "name": "b0d48117-514b-478b-977c-25e8c43baf9c",
      "status": "Failed",
      "startTime": "2026-10-06T00:11:05.686165077Z",
      "endTime": "2026-10-06T00:30:11.474018181Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n  \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x87d3d5a41c0>{
            msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kas\" in resourcegroup=\"private-kas-jwhp5tq4cqwd\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n  \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x87d3de4c3c0>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Length": ["1387"],
                        "X-Envoy-Upstream-Service-Time": ["11"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "603ab4c0-fea1-47ce-8270-c4d08c44ea6b",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:30:18 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x87d3d5a4000>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 48, 100, 52, 56, 49, 49, 55, 45, 53, 49, 52, 98, 45, 52, 55, 56, 98, 45, 57, 55, 55, 99, 45, 50, 53, 101, 56, 99, 52, 51, 98, 97, 102, 57, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 49, 58, 48, 53, 46, 54, 56, 54, 49, 54, 53, 48, 55, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 49, 49, 46, 52, 55, 52, 48, 49, 56, 49, 56, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 49, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 49, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 106, 119, 104, 112, 53, 116, 113, 52, 99, 113, 119, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 97, 115, 45, 110, 112, 45, 49, 45, 115, 102, 118, 103, 116, 45, 52, 99, 56, 103, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1387,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c",
                            Fragment: "",
                            RawQuery: "api-version=2025-12-23-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "4ec77276-bcdf-4f79-a17b-de505a326025",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "76f6daf9-5cb5-4a8d-a190-0b8e8b6c620f",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:18Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x87d3cd125d0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"name\": \"b0d48117-514b-478b-977c-25e8c43baf9c\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:11:05.686165077Z\",\n  \"endTime\": \"2026-10-06T00:30:11.474018181Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 1; node pool condition AllNodesHealthy is False: 1 of 1 machines are not healthy\\nMachine private-kas-np-1-sfvgt-4c8gq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n; node pool condition AllMachinesReady is False: 1 of 1 machines are not ready\\nMachine private-kas-np-1-sfvgt-4c8gq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwhp5tq4cqwd--managed/providers/Microsoft.Compute/virtualMachines/private-kas-np-1-sfvgt-4c8gq to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56"
Unexpected error:
    <*fmt.wrapError | 0x73c49f3c980>: 
    failed to create NodePool np-xhdn56: failed waiting for nodepool="np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56" in resourcegroup="rg-candidate-5-0-l69m5s2wj9zh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
      "name": "63aba31b-da06-4f4a-9914-cbd8d6017560",
      "status": "Failed",
      "startTime": "2026-10-06T00:10:54.897052208Z",
      "endTime": "2026-10-06T00:30:01.84112593Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-xhdn56: failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n  \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x73c4a89ecc0>{
            msg: "failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n  \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x73c4b254c30>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["7"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "cbeb0ebc-f5fc-4c59-9458-989384b89c6d",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:30:08 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x73c4a89eae0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 53, 52, 46, 56, 57, 55, 48, 53, 50, 50, 48, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 48, 49, 46, 56, 52, 49, 49, 50, 53, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "d6f9bece-8fd8-4312-a433-a0c321f4c5f1",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "6f8bed6d-9a07-4894-b3b1-18e9c91b02ca",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:08Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x73c4a679ae0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n  \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56"
Unexpected error:
    <*fmt.wrapError | 0x73c49f3c980>: 
    failed to create NodePool np-xhdn56: failed waiting for nodepool="np-xhdn56" for cluster "cluster-candidate-5-0-xhdn56" in resourcegroup="rg-candidate-5-0-l69m5s2wj9zh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
      "name": "63aba31b-da06-4f4a-9914-cbd8d6017560",
      "status": "Failed",
      "startTime": "2026-10-06T00:10:54.897052208Z",
      "endTime": "2026-10-06T00:30:01.84112593Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-xhdn56: failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n  \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x73c4a89ecc0>{
            msg: "failed waiting for nodepool=\"np-xhdn56\" for cluster \"cluster-candidate-5-0-xhdn56\" in resourcegroup=\"rg-candidate-5-0-l69m5s2wj9zh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n  \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x73c4b254c30>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["7"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "cbeb0ebc-f5fc-4c59-9458-989384b89c6d",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:30:08 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x73c4a89eae0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 51, 97, 98, 97, 51, 49, 98, 45, 100, 97, 48, 54, 45, 52, 102, 52, 97, 45, 57, 57, 49, 52, 45, 99, 98, 100, 56, 100, 54, 48, 49, 55, 53, 54, 48, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 53, 52, 46, 56, 57, 55, 48, 53, 50, 50, 48, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 48, 58, 48, 49, 46, 56, 52, 49, 49, 50, 53, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 100, 107, 100, 56, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 53, 45, 48, 45, 108, 54, 57, 109, 53, 115, 50, 119, 106, 57, 122, 104, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 120, 104, 100, 110, 53, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 54, 114, 57, 97, 53, 108, 54, 99, 55, 117, 57, 114, 48, 99, 45, 110, 112, 45, 120, 104, 100, 110, 53, 54, 45, 120, 112, 120, 108, 104, 45, 113, 56, 109, 110, 108, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "d6f9bece-8fd8-4312-a433-a0c321f4c5f1",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "6f8bed6d-9a07-4894-b3b1-18e9c91b02ca",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:30:08Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x73c4a679ae0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"name\": \"63aba31b-da06-4f4a-9914-cbd8d6017560\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:54.897052208Z\",\n  \"endTime\": \"2026-10-06T00:30:01.84112593Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-dkd8h to exist\\nMachine c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-l69m5s2wj9zh-candidate-xhdn56--managed/providers/Microsoft.Compute/virtualMachines/c6r9a5l6c7u9r0c-np-xhdn56-xpxlh-q8mnl to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0xd75da0ec270>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-zjz8vfx54pwq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
      "name": "1a2981fe-47af-45c6-aa16-68dab8daa466",
      "status": "Failed",
      "startTime": "2026-10-06T00:14:09.62885793Z",
      "endTime": "2026-10-06T00:33:11.463583946Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0xd75da0ec210>{
                errs: [
                    <*fmt.wrapError | 0xd75db066900>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0xd75dae671a0>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0xd75dafb0500>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                        err: <*fmt.wrapError | 0xd75dafb04e0>{
                            msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                            err: <*errors.errorString | 0xd75d9a137a0>{
                                s: "no cilium pods found in kube-system namespace",
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0xd75db066060>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n  \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0xd75db0d03a0>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n  \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0xd75dbce6870>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "84f21420-6517-4fcd-a156-bde9ed70da59",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:33:13 GMT",
                                ],
                                "Content-Length": ["1645"],
                                "X-Envoy-Upstream-Service-Time": ["7"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0xd75db0d02c0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 52, 58, 48, 57, 46, 54, 50, 56, 56, 53, 55, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 51, 58, 49, 49, 46, 52, 54, 51, 53, 56, 51, 57, 52, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1645,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "e744a325-a27c-41a0-9df8-747b325e8113",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "da44c5b3-1830-4973-a452-c8236a098071",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:33:13Z\"}",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0xd75db6ac3b0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57ee760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n  \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0xd75da0ec270>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-zjz8vfx54pwq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
      "name": "1a2981fe-47af-45c6-aa16-68dab8daa466",
      "status": "Failed",
      "startTime": "2026-10-06T00:14:09.62885793Z",
      "endTime": "2026-10-06T00:33:11.463583946Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0xd75da0ec210>{
                errs: [
                    <*fmt.wrapError | 0xd75db066900>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0xd75dae671a0>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0xd75dafb0500>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                        err: <*fmt.wrapError | 0xd75dafb04e0>{
                            msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                            err: <*errors.errorString | 0xd75d9a137a0>{
                                s: "no cilium pods found in kube-system namespace",
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0xd75db066060>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n  \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0xd75db0d03a0>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-zjz8vfx54pwq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n  \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0xd75dbce6870>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "84f21420-6517-4fcd-a156-bde9ed70da59",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:33:13 GMT",
                                ],
                                "Content-Length": ["1645"],
                                "X-Envoy-Upstream-Service-Time": ["7"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0xd75db0d02c0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 97, 50, 57, 56, 49, 102, 101, 45, 52, 55, 97, 102, 45, 52, 53, 99, 54, 45, 97, 97, 49, 54, 45, 54, 56, 100, 97, 98, 56, 100, 97, 97, 52, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 52, 58, 48, 57, 46, 54, 50, 56, 56, 53, 55, 57, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 51, 58, 49, 49, 46, 52, 54, 51, 53, 56, 51, 57, 52, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 120, 103, 98, 110, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 122, 106, 122, 56, 118, 102, 120, 53, 52, 112, 119, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 109, 57, 106, 112, 118, 45, 122, 109, 99, 104, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1645,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "e744a325-a27c-41a0-9df8-747b325e8113",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "da44c5b3-1830-4973-a452-c8236a098071",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:33:13Z\"}",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0xd75db6ac3b0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57ee760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"name\": \"1a2981fe-47af-45c6-aa16-68dab8daa466\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:14:09.62885793Z\",\n  \"endTime\": \"2026-10-06T00:33:11.463583946Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-m9jpv-xgbn5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-m9jpv-zmchr: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-zjz8vfx54pwq--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-m9jpv-zmchr to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
Contributing tests (20)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP HyperShift Presubmit should create a cluster and nodepool to completion30
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to retrieve cluster and nodepool status active versions28
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.2127
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.2225
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.125
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.2023
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.2323
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.022
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCreate HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API22
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public22
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster and node pools with aggregated advanced features13
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully8
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should serve the default ingress certificate through public ingress with OCP candidate channel for 5.11
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a HCP cluster and use cilium CNI plugin1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster with an external auth config and get the external auth config1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create node pools with ARM64-based VMs1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should create a cluster with private ingress using v20260901preview and verify the ingress is internal1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should upgrade control plane minor version when pods cannot be created from 4.21 minor to 4.22 minor1
Affected runs (37)
Date (UTC)Associated PRProw job
PR #73652107245789225947136
PR #73552107245759840653312
PR #73562107245750499938304
PR #73312107244242656038912
PR #72792107229401274912768
PR #73662107215519332438016
PR #73622107215468136763392
PR #73192107206250759458816
PR #73652107198083426160640
PR #73322107196586068021248
PR #73492107193894448926720
PR #72782107193887125671936
PR #73632107183062990196736
PR #73422107168939829104640
PR #73512107168887228338176
PR #73522107168871638110208
PR #73552107168836758278144
PR #73252107155963554304000
PR #73622107147472735309824
PR #70882107144096983289856
PR #72792107131932365033472
PR #73312107125784404561920
PR #67462107119792417673216
PR #73592107117812953649152
PR #69442107117611937435648
PR #71582107096289194807296
PR #73132107092599713042432
PR #73552107081303852584960
PR #73512107066931902156800
PR #73492107066190932217856
PR #72922107066130689429504
PR #68892107059552468865024
PR #72152107008962619510784
PR #73422107002394956009472
PR #73312107000790592786432
PR #71052107000443698679808
PR #73452106971795000135680
client rate limiter Wait returned an error: context deadline exceeded
full failure pattern:
client rate limiter Wait returned an error: context deadline exceeded
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 4 days
e2e2735.06%27 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 4 daysShow trend detailsSep 29: 0 · Sep 30: 1 · Oct 1: 0 · Oct 2: 4 · Oct 3: 0 · Oct 4: 5 · Oct 5: 36none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0x34e792c98030>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-mmc2xb78g9bz" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
      "name": "b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
      "status": "Failed",
      "startTime": "2026-10-06T00:23:40.809196099Z",
      "endTime": "2026-10-06T00:42:49.207450913Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x34e792c98018>{
                errs: [
                    <*fmt.wrapError | 0x34e792adad20>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x34e793b0fd30>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x34e7934e0260>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x34e7934e0240>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x34e7934e0200>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x34e7934e01e0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x34e7934f0aa0>{
                msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n  \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x34e7931a8cc0>{
                    msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n  \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x34e7935f8f30>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "X-Envoy-Upstream-Service-Time": ["12"],
                                "Server": ["istio-envoy"],
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "ec6d1a06-8329-4fda-80cb-6f299a2e3b46",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:42:54 GMT",
                                ],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x34e7931a8b60>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 52, 48, 46, 56, 48, 57, 49, 57, 54, 48, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 57, 46, 50, 48, 55, 52, 53, 48, 57, 49, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 83, 101, 116, 115, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: -1,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "b75ee27e-2e14-4129-9e4d-0d377c24b1a9",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "785a8b33-08f1-4ca1-ad3f-503cda07acc8",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:54Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x34e792a80cf0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n  \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0x34e792c98030>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-mmc2xb78g9bz" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
      "name": "b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
      "status": "Failed",
      "startTime": "2026-10-06T00:23:40.809196099Z",
      "endTime": "2026-10-06T00:42:49.207450913Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x34e792c98018>{
                errs: [
                    <*fmt.wrapError | 0x34e792adad20>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x34e793b0fd30>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x34e7934e0260>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x34e7934e0240>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x34e7934e0200>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x34e7934e01e0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x34e7934f0aa0>{
                msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n  \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x34e7931a8cc0>{
                    msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-mmc2xb78g9bz\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n  \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x34e7935f8f30>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "X-Envoy-Upstream-Service-Time": ["12"],
                                "Server": ["istio-envoy"],
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "ec6d1a06-8329-4fda-80cb-6f299a2e3b46",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:42:54 GMT",
                                ],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x34e7931a8b60>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 55, 48, 54, 101, 101, 99, 57, 45, 50, 49, 52, 48, 45, 52, 100, 50, 97, 45, 56, 56, 54, 102, 45, 102, 98, 102, 54, 97, 57, 99, 54, 54, 100, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 52, 48, 46, 56, 48, 57, 49, 57, 54, 48, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 57, 46, 50, 48, 55, 52, 53, 48, 57, 49, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 115, 116, 99, 114, 104, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 115, 101, 116, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 97, 118, 97, 105, 108, 97, 98, 105, 108, 105, 116, 121, 83, 101, 116, 115, 47, 50, 116, 56, 117, 116, 106, 105, 98, 113, 54, 54, 111, 113, 48, 50, 101, 55, 97, 54, 51, 117, 48, 56, 53, 53, 100, 101, 53, 57, 111, 101, 97, 95, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 97, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 109, 109, 99, 50, 120, 98, 55, 56, 103, 57, 98, 122, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 122, 120, 54, 114, 99, 45, 110, 50, 115, 114, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: -1,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "b75ee27e-2e14-4129-9e4d-0d377c24b1a9",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "785a8b33-08f1-4ca1-ad3f-503cda07acc8",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:54Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x34e792a80cf0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"name\": \"b706eec9-2140-4d2a-886f-fbf6a9c66dd9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:40.809196099Z\",\n  \"endTime\": \"2026-10-06T00:42:49.207450913Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-stcrh to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-zx6rc-stcrh: Failed: availabilitysets failed to create or update. err: failed to get existing resource complex-cilium-kv-mmc2xb78g9bz--managed/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/availabilitySets/2t8utjibq66oq02e7a63u0855de59oea_cilium-cluster-cilium-np-as\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try aga... message truncated\\nMachine cilium-cluster-cilium-np-zx6rc-n2srv: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-mmc2xb78g9bz--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-zx6rc-n2srv to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x8a5d7b18078>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-7zrw7bt2w5s4" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
      "name": "6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
      "status": "Failed",
      "startTime": "2026-10-06T00:23:01.529024983Z",
      "endTime": "2026-10-06T00:42:08.957585569Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x8a5d7b18048>{
                errs: [
                    <*fmt.wrapError | 0x8a5d7792020>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x8a5d7ad42d0>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x8a5d745c260>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x8a5d745c240>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x8a5d745c200>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x8a5d745c1e0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x8a5d751e8a0>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n  \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x8a5d751e680>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n  \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x8a5d741cd20>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "8a808e74-a7a5-4e02-b899-c9cfe73958f6",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:42:14 GMT",
                                ],
                                "X-Envoy-Upstream-Service-Time": ["9"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x8a5d751e5a0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 48, 49, 46, 53, 50, 57, 48, 50, 52, 57, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 48, 56, 46, 57, 53, 55, 53, 56, 53, 53, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: -1,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "Authorization": ["redacted"],
                                    "X-Ms-Correlation-Request-Id": [
                                        "6d01cafb-a9cb-45c8-9cce-57f3b1b4f172",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "da5486fc-d5e7-44b9-810a-8d1d4e00fbed",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:14Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x8a5d822f990>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n  \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x8a5d7b18078>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-7zrw7bt2w5s4" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
      "name": "6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
      "status": "Failed",
      "startTime": "2026-10-06T00:23:01.529024983Z",
      "endTime": "2026-10-06T00:42:08.957585569Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x8a5d7b18048>{
                errs: [
                    <*fmt.wrapError | 0x8a5d7792020>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x8a5d7ad42d0>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x8a5d745c260>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x8a5d745c240>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x8a5d745c200>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x8a5d745c1e0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x8a5d751e8a0>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n  \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x8a5d751e680>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-7zrw7bt2w5s4\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n  \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x8a5d741cd20>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "8a808e74-a7a5-4e02-b899-c9cfe73958f6",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:42:14 GMT",
                                ],
                                "X-Envoy-Upstream-Service-Time": ["9"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x8a5d751e5a0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 54, 101, 49, 97, 49, 98, 97, 99, 45, 55, 55, 55, 99, 45, 52, 56, 57, 98, 45, 97, 52, 97, 100, 45, 97, 52, 99, 101, 51, 50, 55, 102, 57, 101, 55, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 48, 49, 46, 53, 50, 57, 48, 50, 52, 57, 56, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 48, 56, 46, 57, 53, 55, 53, 56, 53, 53, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 98, 119, 50, 115, 53, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 55, 122, 114, 119, 55, 98, 116, 50, 119, 53, 115, 52, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 100, 102, 53, 54, 119, 45, 120, 109, 98, 119, 118, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 51, 57, 101, 101, 102, 99, 52, 102, 45, 53, 101, 50, 52, 45, 52, 57, 49, 100, 45, 57, 102, 48, 57, 45, 98, 99, 99, 48, 97, 100, 53, 55, 51, 98, 99, 102, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: -1,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "Authorization": ["redacted"],
                                    "X-Ms-Correlation-Request-Id": [
                                        "6d01cafb-a9cb-45c8-9cce-57f3b1b4f172",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "da5486fc-d5e7-44b9-810a-8d1d4e00fbed",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:14Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j0653312.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x8a5d822f990>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"name\": \"6e1a1bac-777c-489b-a4ad-a4ce327f9e76\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:01.529024983Z\",\n  \"endTime\": \"2026-10-06T00:42:08.957585569Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-df56w-xmbwv to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-df56w-bw2s5: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-df56w-xmbwv: Failed: interfaces failed to create or update. err: failed to get existing resource feature-aggregation-7zrw7bt2w5s4--managed/agg-cluster-agg-np-a-df56w-xmbwv-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-7zrw7bt2w5s4--managed/providers/Microsoft.Network/networkInterfaces/agg-cluster-agg-np-a-df56w-xmbwv-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '39eefc4f-5e24-491d-9f09-bcc0ad573bcf' exceeded. Please try again after '10' seconds after additional tokens are available... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x124a88912018>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-q9jgfkvl8wfd" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
      "name": "17635fe1-58eb-49b7-8f56-02062587c9ca",
      "status": "Failed",
      "startTime": "2026-10-06T00:17:22.925439722Z",
      "endTime": "2026-10-06T00:36:24.290937421Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x124a88912000>{
                errs: [
                    <*fmt.wrapError | 0x124a89baf100>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x124a8987cc30>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x124a89bae240>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x124a89bae220>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x124a89bae1e0>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x124a89bae1c0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x124a89c3c3c0>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n  \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x124a88604520>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n  \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x124a88dfc840>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Server": ["istio-envoy"],
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "104849b7-9743-4b31-821d-345ed3dffead",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:36:25 GMT",
                                ],
                                "Content-Length": ["1646"],
                                "X-Envoy-Upstream-Service-Time": ["8"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x124a88604440>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 55, 58, 50, 50, 46, 57, 50, 53, 52, 51, 57, 55, 50, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 54, 58, 50, 52, 46, 50, 57, 48, 57, 51, 55, 52, 50, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1646,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j9938304.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "Authorization": ["redacted"],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "3e1faf47-a710-4139-aaba-847d9f08d99c",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "4f200bc1-9193-40c2-aea0-0e6f7338b9f8",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:36:25Z\"}",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j9938304.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x124a89bf5380>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n  \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x124a88912018>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-q9jgfkvl8wfd" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
      "name": "17635fe1-58eb-49b7-8f56-02062587c9ca",
      "status": "Failed",
      "startTime": "2026-10-06T00:17:22.925439722Z",
      "endTime": "2026-10-06T00:36:24.290937421Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x124a88912000>{
                errs: [
                    <*fmt.wrapError | 0x124a89baf100>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x124a8987cc30>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x124a89bae240>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x124a89bae220>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x124a89bae1e0>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x124a89bae1c0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x124a89c3c3c0>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n  \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x124a88604520>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-q9jgfkvl8wfd\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n  \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x124a88dfc840>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Server": ["istio-envoy"],
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "104849b7-9743-4b31-821d-345ed3dffead",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:36:25 GMT",
                                ],
                                "Content-Length": ["1646"],
                                "X-Envoy-Upstream-Service-Time": ["8"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x124a88604440>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 55, 54, 51, 53, 102, 101, 49, 45, 53, 56, 101, 98, 45, 52, 57, 98, 55, 45, 56, 102, 53, 54, 45, 48, 50, 48, 54, 50, 53, 56, 55, 99, 57, 99, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 55, 58, 50, 50, 46, 57, 50, 53, 52, 51, 57, 55, 50, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 54, 58, 50, 52, 46, 50, 57, 48, 57, 51, 55, 52, 50, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 112, 120, 53, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 102, 101, 97, 116, 117, 114, 101, 45, 97, 103, 103, 114, 101, 103, 97, 116, 105, 111, 110, 45, 113, 57, 106, 103, 102, 107, 118, 108, 56, 119, 102, 100, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 55, 118, 104, 56, 57, 45, 115, 56, 115, 56, 114, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1646,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j9938304.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "Authorization": ["redacted"],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "3e1faf47-a710-4139-aaba-847d9f08d99c",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "4f200bc1-9193-40c2-aea0-0e6f7338b9f8",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:36:25Z\"}",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j9938304.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x124a89bf5380>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"name\": \"17635fe1-58eb-49b7-8f56-02062587c9ca\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:17:22.925439722Z\",\n  \"endTime\": \"2026-10-06T00:36:24.290937421Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-7vh89-px5ms: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-7vh89-s8s8r: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-q9jgfkvl8wfd--managed/providers/Microsoft.Compute/virtualMachines/agg-cluster-agg-np-a-7vh89-s8s8r to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
Contributing tests (2)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully22
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster and node pools with aggregated advanced features14
Affected runs (27)
alert [svc] BackendControllerQueueDepthHigh fired
full failure pattern:
alert [svc] BackendControllerQueueDepthHigh fired
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 7 days
alert2633.77%26 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 7 daysShow trend detailsSep 29: 11 · Sep 30: 3 · Oct 1: 5 · Oct 2: 19 · Oct 3: 15 · Oct 4: 3 · Oct 5: 26none
Full failure examples (3)
alert fired 1 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-06T00:29:05Z
  Ended:       2026-10-06T00:35:10Z
  Severity:    Sev3
  Labels:      alertname="BackendControllerQueueDepthHigh", cluster="ci01-j1885952-svc", component="backend", name="clustervalidationcontrolplaneidentitiespermissionsclustervalidation", region="westus3", severity="warning"
  Description: Backend controller workqueue clustervalidationcontrolplaneidentitiespermissionsclustervalidation has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed.
alert fired 2 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-06T00:16:45Z
  Ended:       2026-10-06T00:22:41Z
  Severity:    Sev3
  Labels:      alertname="BackendControllerQueueDepthHigh", cluster="ci01-j5947136-svc", component="backend", name="clustervalidationcontrolplaneidentitiespermissionsclustervalidation", region="canadacentral", severity="warning"
  Description: Backend controller workqueue clustervalidationcontrolplaneidentitiespermissionsclustervalidation has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed.
Firing 2:
  State:       Resolved
  Started:     2026-10-06T00:18:42Z
  Ended:       2026-10-06T00:35:43Z
  Severity:    Sev3
  Labels:      alertname="BackendControllerQueueDepthHigh", cluster="ci01-j5947136-svc", component="backend", name="clusterresources", region="canadacentral", severity="warning"
  Description: Backend controller workqueue clusterresources has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed.
alert fired 2 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-06T00:28:30Z
  Ended:       2026-10-06T00:42:31Z
  Severity:    Sev3
  Labels:      alertname="BackendControllerQueueDepthHigh", cluster="ci01-j9125632-svc", component="backend", name="csstatedump", region="westus3", severity="warning"
  Description: Backend controller workqueue csstatedump has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed.
Firing 2:
  State:       Resolved
  Started:     2026-10-06T00:28:30Z
  Ended:       2026-10-06T00:54:31Z
  Severity:    Sev3
  Labels:      alertname="BackendControllerQueueDepthHigh", cluster="ci01-j9125632-svc", component="backend", name="clusterresources", region="westus3", severity="warning"
  Description: Backend controller workqueue clusterresources has had a depth > 10 for more than 15 minutes, indicating work is accumulating faster than it can be processed.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert BackendControllerQueueDepthHigh does not fire26
Affected runs (26)
alert [hcp] KubeDeploymentReplicasMismatch fired
full failure pattern:
alert [hcp] KubeDeploymentReplicasMismatch fired
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days
alert79.09%7 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 5 daysShow trend detailsSep 29: 3 · Sep 30: 4 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 7none
Full failure examples (3)
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:36:50Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j3932544-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cloud-network-config-controller", endpoint="http", environment="ci01", instance="10.128.64.126:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/hcps-j3932544", namespace="ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c", pod="arohcp-monitor-kube-state-metrics-7988dc648c-vcq6q", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c/cloud-network-config-controller has not matched the expected number of replicas for longer than 30 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:36:50Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j3932544-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cloud-network-config-controller", endpoint="http", environment="ci01", instance="10.128.64.126:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/hcps-j3932544", namespace="ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c", pod="arohcp-monitor-kube-state-metrics-7988dc648c-vcq6q", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8tisk9kktfaj2i52gigds57r9odgif-a2w7k9s5c0u9u3c/cloud-network-config-controller has not matched the expected number of replicas for longer than 30 minutes.
alert fired 4 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:24:03Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/cluster-api has not matched the expected number of replicas for longer than 30 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:24:03Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/capi-provider has not matched the expected number of replicas for longer than 30 minutes.
Firing 3:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:44:02Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/cluster-api has not matched the expected number of replicas for longer than 30 minutes.
Firing 4:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:44:02Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j6160640-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.165:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6160640/providers/microsoft.monitor/accounts/hcps-j6160640", namespace="ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r", pod="arohcp-monitor-kube-state-metrics-7988dc648c-bnmhw", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl-m1q4z8j1g8b8v9r/capi-provider has not matched the expected number of replicas for longer than 30 minutes.
alert fired 4 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:53:02Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/capi-provider has not matched the expected number of replicas for longer than 30 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:54:01Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/cluster-api has not matched the expected number of replicas for longer than 30 minutes.
Firing 3:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:54:01Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="cluster-api", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/cluster-api has not matched the expected number of replicas for longer than 30 minutes.
Firing 4:
  State:       Fired (not resolved)
  Started:     2026-10-05T21:54:01Z
  Severity:    Sev3
  Labels:      alertname="KubeDeploymentReplicasMismatch", cluster="ci01-j8926720-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", deployment="capi-provider", endpoint="http", environment="ci01", instance="10.128.64.137:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8926720/providers/microsoft.monitor/accounts/hcps-j8926720", namespace="ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s", pod="arohcp-monitor-kube-state-metrics-7988dc648c-zq9dq", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Deployment ocm-arohcpci01-2t8rqeg64rdubkf4dn8i2cvdj9fkohjh-l7o3d2d1v5q0i2s/capi-provider has not matched the expected number of replicas for longer than 30 minutes.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [hcp] alert KubeDeploymentReplicasMismatch does not fire7
Affected runs (7)
Date (UTC)Associated PRProw job
PR #73502107225642733932544
PR #73652107198083426160640
PR #73492107193894448926720
PR #72792107185267151474688
PR #73522107168871638110208
PR #73312107125784404561920
PR #73492107066190932217856
alert [svc] KustoLogsDataStale fired
full failure pattern:
alert [svc] KustoLogsDataStale fired
Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days
alert67.79%6 of 77 job runs affectedFlakeSignal: Flake — present in 2 prior week(s); spread across 5 daysShow trend detailsSep 29: 2 · Sep 30: 2 · Oct 1: 3 · Oct 2: 2 · Oct 3: 0 · Oct 4: 0 · Oct 5: 6none
Full failure examples (3)
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-06T00:01:43Z
  Severity:    Sev3
  Labels:      alertname="KustoLogsDataStale", cluster="ci01-j3932544-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.40:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/services-j3932544", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-7f699bc757-kn9nf", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs"
  Description: Kusto log data for table systemdlogs on cluster ci01-j3932544-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline.

Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-06T00:01:43Z
  Severity:    Sev3
  Labels:      alertname="KustoLogsDataStale", cluster="ci01-j3932544-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.40:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j3932544/providers/microsoft.monitor/accounts/services-j3932544", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-7f699bc757-kn9nf", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs"
  Description: Kusto log data for table systemdlogs on cluster ci01-j3932544-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline.
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T20:29:50Z
  Severity:    Sev3
  Labels:      alertname="KustoLogsDataStale", cluster="ci01-j2518144-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.80:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2518144/providers/microsoft.monitor/accounts/services-j2518144", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-ccd58d89f-8dxcr", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs"
  Description: Kusto log data for table systemdlogs on cluster ci01-j2518144-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline.

Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T20:29:50Z
  Severity:    Sev3
  Labels:      alertname="KustoLogsDataStale", cluster="ci01-j2518144-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.80:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2518144/providers/microsoft.monitor/accounts/services-j2518144", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-ccd58d89f-8dxcr", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs"
  Description: Kusto log data for table systemdlogs on cluster ci01-j2518144-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline.
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T14:51:33Z
  Severity:    Sev3
  Labels:      alertname="KustoLogsDataStale", cluster="ci01-j0003968-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.41:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0003968/providers/microsoft.monitor/accounts/services-j0003968", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-5497464f5-rjdk8", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs"
  Description: Kusto log data for table systemdlogs on cluster ci01-j0003968-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline.

Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T14:51:33Z
  Severity:    Sev3
  Labels:      alertname="KustoLogsDataStale", cluster="ci01-j0003968-svc", component="kusto", container="aro-hcp-exporter", endpoint="metrics", environment="ci01", instance="10.128.64.41:8080", job="aro-hcp-exporter", kusto_cluster="hcp-dev-us-2", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0003968/providers/microsoft.monitor/accounts/services-j0003968", namespace="aro-hcp-exporter", pod="aro-hcp-exporter-5497464f5-rjdk8", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="aro-hcp-exporter", severity="warning", table="systemdlogs"
  Description: Kusto log data for table systemdlogs on cluster ci01-j0003968-svc (Kusto cluster hcp-dev-us-2) is stale. Check the ingestion pipeline.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert KustoLogsDataStale does not fire6
Affected runs (6)
Date (UTC)Associated PRProw job
PR #73502107225642733932544
PR #73132107168826272518144
PR #73502107087110770003968
PR #73562107081906662150144
PR #73492107066190932217856
PR #73252107065983326752768
alert [svc] KubePodNotReady fired
full failure pattern:
alert [svc] KubePodNotReady fired
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days
alert45.19%4 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 5 daysShow trend detailsSep 29: 6 · Sep 30: 7 · Oct 1: 0 · Oct 2: 3 · Oct 3: 1 · Oct 4: 0 · Oct 5: 4none
Full failure examples (3)
alert fired 3 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:24:58Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-d8469", region="canadacentral", severity="warning"
  Description: Pod arobit/arobit-forwarder-d8469 has been in a non-ready state for longer than 5 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:28:58Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-69flm", region="canadacentral", severity="warning"
  Description: Pod arobit/arobit-forwarder-69flm has been in a non-ready state for longer than 5 minutes.
Firing 3:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:28:58Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-g4dmc", region="canadacentral", severity="warning"
  Description: Pod arobit/arobit-forwarder-g4dmc has been in a non-ready state for longer than 5 minutes.
alert fired 3 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:00:22Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-pmhh6", region="westus3", severity="warning"
  Description: Pod arobit/arobit-forwarder-pmhh6 has been in a non-ready state for longer than 5 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:01:23Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-g2sk2", region="westus3", severity="warning"
  Description: Pod arobit/arobit-forwarder-g2sk2 has been in a non-ready state for longer than 5 minutes.
Firing 3:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:03:25Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-2fdvx", region="westus3", severity="warning"
  Description: Pod arobit/arobit-forwarder-2fdvx has been in a non-ready state for longer than 5 minutes.
alert fired 3 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T18:58:19Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-pv2hz", region="westus3", severity="warning"
  Description: Pod arobit/arobit-forwarder-pv2hz has been in a non-ready state for longer than 5 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T18:58:19Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-cwfj7", region="westus3", severity="warning"
  Description: Pod arobit/arobit-forwarder-cwfj7 has been in a non-ready state for longer than 5 minutes.
Firing 3:
  State:       Fired (not resolved)
  Started:     2026-10-05T19:00:20Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", namespace="arobit", pod="arobit-forwarder-9czh7", region="westus3", severity="warning"
  Description: Pod arobit/arobit-forwarder-9czh7 has been in a non-ready state for longer than 5 minutes.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert KubePodNotReady does not fire4
Affected runs (4)
Date (UTC)Associated PRProw job
PR #68202107237896200130560
PR #68202107215529679785984
PR #68202107170660328411136
PR #71782106913296060780544
alert [hcp] KubePodNotReady fired
full failure pattern:
alert [hcp] KubePodNotReady fired
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 6 days
alert33.90%3 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 6 daysShow trend detailsSep 29: 7 · Sep 30: 10 · Oct 1: 6 · Oct 2: 5 · Oct 3: 2 · Oct 4: 0 · Oct 5: 3none
Full failure examples (3)
alert fired 1 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T17:31:22Z
  Ended:       2026-10-05T18:01:21Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j3289856-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8osonvedkq4us42vso5g475pmi6bd2-t8u7l4d5a0n0j4i", pod="router-fcdd476b-ns9vb", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8osonvedkq4us42vso5g475pmi6bd2-t8u7l4d5a0n0j4i/router-fcdd476b-ns9vb has been in a non-ready state for longer than 5 minutes.
alert fired 25 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-kx88p", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-kx88p has been in a non-ready state for longer than 5 minutes.
Firing 2:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:16Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-xz59p", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-xz59p has been in a non-ready state for longer than 5 minutes.
Firing 3:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-cs6cc", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-cs6cc has been in a non-ready state for longer than 5 minutes.
Firing 4:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-jj9lv", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-jj9lv has been in a non-ready state for longer than 5 minutes.
Firing 5:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-7lzb4", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-7lzb4 has been in a non-ready state for longer than 5 minutes.
Firing 6:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-fpswn", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-fpswn has been in a non-ready state for longer than 5 minutes.
Firing 7:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-jd2zc", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-jd2zc has been in a non-ready state for longer than 5 minutes.
Firing 8:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-62265", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-62265 has been in a non-ready state for longer than 5 minutes.
Firing 9:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:16Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-p7hl9", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-p7hl9 has been in a non-ready state for longer than 5 minutes.
Firing 10:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-9b89p", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-9b89p has been in a non-ready state for longer than 5 minutes.
Firing 11:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:57:14Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-jwnvq", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-jwnvq has been in a non-ready state for longer than 5 minutes.
Firing 12:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-64tmg", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-64tmg has been in a non-ready state for longer than 5 minutes.
Firing 13:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-4c9ln", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-4c9ln has been in a non-ready state for longer than 5 minutes.
Firing 14:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-8v98s", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-8v98s has been in a non-ready state for longer than 5 minutes.
Firing 15:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:16Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-r8p2j", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-r8p2j has been in a non-ready state for longer than 5 minutes.
Firing 16:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-tjf2v", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-tjf2v has been in a non-ready state for longer than 5 minutes.
Firing 17:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-gbnfj", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-gbnfj has been in a non-ready state for longer than 5 minutes.
Firing 18:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-nhf96", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-nhf96 has been in a non-ready state for longer than 5 minutes.
Firing 19:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-q9gf7", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-q9gf7 has been in a non-ready state for longer than 5 minutes.
Firing 20:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-h5rt4", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-h5rt4 has been in a non-ready state for longer than 5 minutes.
Firing 21:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-29s4f", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-29s4f has been in a non-ready state for longer than 5 minutes.
Firing 22:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:57:14Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-fjjh8", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-fjjh8 has been in a non-ready state for longer than 5 minutes.
Firing 23:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:57:14Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-x82jg", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-x82jg has been in a non-ready state for longer than 5 minutes.
Firing 24:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-rzpbb", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-rzpbb has been in a non-ready state for longer than 5 minutes.
Firing 25:
  State:       Resolved
  Started:     2026-10-05T12:27:17Z
  Ended:       2026-10-05T12:53:15Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j9429504-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t", pod="network-node-identity-c866c657b-tlbkl", region="westus3", severity="warning"
  Description: Pod ocm-arohcpci01-2t8kcvlcb4r81e54iqgm615qle3eool9-b6c7f1t6t1l4y8t/network-node-identity-c866c657b-tlbkl has been in a non-ready state for longer than 5 minutes.
alert fired 30 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T06:01:34Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-wdgbt", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-wdgbt has been in a non-ready state for longer than 5 minutes.
Firing 2:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-c9c8c", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-c9c8c has been in a non-ready state for longer than 5 minutes.
Firing 3:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-g7h4x", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-g7h4x has been in a non-ready state for longer than 5 minutes.
Firing 4:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-hbfhn", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-hbfhn has been in a non-ready state for longer than 5 minutes.
Firing 5:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-t7xgn", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-t7xgn has been in a non-ready state for longer than 5 minutes.
Firing 6:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-rk9hr", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-rk9hr has been in a non-ready state for longer than 5 minutes.
Firing 7:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-8cwl5", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-8cwl5 has been in a non-ready state for longer than 5 minutes.
Firing 8:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-6xrf2", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-6xrf2 has been in a non-ready state for longer than 5 minutes.
Firing 9:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-wc285", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-wc285 has been in a non-ready state for longer than 5 minutes.
Firing 10:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-gs6ng", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-gs6ng has been in a non-ready state for longer than 5 minutes.
Firing 11:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-55fbw", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-55fbw has been in a non-ready state for longer than 5 minutes.
Firing 12:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-kmpnh", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-kmpnh has been in a non-ready state for longer than 5 minutes.
Firing 13:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-2lb9z", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-2lb9z has been in a non-ready state for longer than 5 minutes.
Firing 14:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-5hg9l", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-5hg9l has been in a non-ready state for longer than 5 minutes.
Firing 15:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-7bn7h", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-7bn7h has been in a non-ready state for longer than 5 minutes.
Firing 16:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-5jd2x", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-5jd2x has been in a non-ready state for longer than 5 minutes.
Firing 17:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-rspt4", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-rspt4 has been in a non-ready state for longer than 5 minutes.
Firing 18:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-f8ff5", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-f8ff5 has been in a non-ready state for longer than 5 minutes.
Firing 19:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-hk4dh", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-hk4dh has been in a non-ready state for longer than 5 minutes.
Firing 20:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-bn4mj", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-bn4mj has been in a non-ready state for longer than 5 minutes.
Firing 21:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-wtj9v", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-wtj9v has been in a non-ready state for longer than 5 minutes.
Firing 22:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-72wfb", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-72wfb has been in a non-ready state for longer than 5 minutes.
Firing 23:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-srdxs", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-srdxs has been in a non-ready state for longer than 5 minutes.
Firing 24:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-2f6vs", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-2f6vs has been in a non-ready state for longer than 5 minutes.
Firing 25:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-blmhn", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-blmhn has been in a non-ready state for longer than 5 minutes.
Firing 26:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-x4877", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-x4877 has been in a non-ready state for longer than 5 minutes.
Firing 27:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-5fxm6", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-5fxm6 has been in a non-ready state for longer than 5 minutes.
Firing 28:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:37Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-9b6xs", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-9b6xs has been in a non-ready state for longer than 5 minutes.
Firing 29:
  State:       Resolved
  Started:     2026-10-05T06:01:35Z
  Ended:       2026-10-05T06:35:36Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-mkx2w", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-mkx2w has been in a non-ready state for longer than 5 minutes.
Firing 30:
  State:       Resolved
  Started:     2026-10-05T06:01:36Z
  Ended:       2026-10-05T06:35:38Z
  Severity:    Sev3
  Labels:      alertname="KubePodNotReady", cluster="ci01-j0135680-mgmt-2", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster", pod="kube-controller-manager-55f846669b-4xsqp", region="canadacentral", severity="warning"
  Description: Pod ocm-arohcpci01-2t8enkn131an0ihqo3ighci5ack9eubq-agg-cluster/kube-controller-manager-55f846669b-4xsqp has been in a non-ready state for longer than 5 minutes.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [hcp] alert KubePodNotReady does not fire3
Affected runs (3)
Date (UTC)Associated PRProw job
PR #70882107144096983289856
PR #72922107066130689429504
PR #73452106971795000135680
alert [hcp] KubeStatefulSetReplicasMismatch fired
full failure pattern:
alert [hcp] KubeStatefulSetReplicasMismatch fired
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days
alert22.60%2 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 5 daysShow trend detailsSep 29: 5 · Sep 30: 2 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2none
Full failure examples (2)
alert fired 2 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T16:17:11Z
  Ended:       2026-10-05T16:43:07Z
  Severity:    Sev3
  Labels:      alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="arohcp-monitor-kube-state-metrics-7988dc648c-dvvxp", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd"
  Description: StatefulSet ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd has not matched the expected number of replicas for longer than 15 minutes.
Firing 2:
  State:       Resolved
  Started:     2026-10-05T16:17:11Z
  Ended:       2026-10-05T16:42:08Z
  Severity:    Sev3
  Labels:      alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="arohcp-monitor-kube-state-metrics-7988dc648c-dvvxp", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd"
  Description: StatefulSet ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd has not matched the expected number of replicas for longer than 15 minutes.
alert fired 2 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T12:29:02Z
  Ended:       2026-10-05T12:58:06Z
  Severity:    Sev3
  Labels:      alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd"
  Description: StatefulSet ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd has not matched the expected number of replicas for longer than 15 minutes.
Firing 2:
  State:       Resolved
  Started:     2026-10-05T12:29:02Z
  Ended:       2026-10-05T12:58:06Z
  Severity:    Sev3
  Labels:      alertname="KubeStatefulSetReplicasMismatch", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="arohcp-monitor-kube-state-metrics-7988dc648c-twm4t", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", statefulset="etcd"
  Description: StatefulSet ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd has not matched the expected number of replicas for longer than 15 minutes.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [hcp] alert KubeStatefulSetReplicasMismatch does not fire2
Affected runs (2)
Date (UTC)Associated PRProw job
PR #73312107125784404561920
PR #73492107066190932217856
alert [hcp] KubePodCrashLooping fired
full failure pattern:
alert [hcp] KubePodCrashLooping fired
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 5 days
alert22.60%2 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 5 daysShow trend detailsSep 29: 2 · Sep 30: 3 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2none
Full failure examples (2)
alert fired 2 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T16:19:07Z
  Ended:       2026-10-05T16:47:06Z
  Severity:    Sev3
  Labels:      alertname="KubePodCrashLooping", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", reason="CrashLoopBackOff", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="57a4a966-6353-4123-811e-4e0b86345fdf"
  Description: Pod ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff").
Firing 2:
  State:       Resolved
  Started:     2026-10-05T16:19:07Z
  Ended:       2026-10-05T16:47:06Z
  Severity:    Sev3
  Labels:      alertname="KubePodCrashLooping", cluster="ci01-j4561920-mgmt-2", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.65.37:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j4561920/providers/microsoft.monitor/accounts/hcps-j4561920", namespace="ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", reason="CrashLoopBackOff", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="57a4a966-6353-4123-811e-4e0b86345fdf"
  Description: Pod ocm-arohcpci01-2t8nku7q7d73ebo44l1m4ahakgjd268j-l7i1b4z6t3k5e1d/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff").
alert fired 2 time(s)
Firing 1:
  State:       Resolved
  Started:     2026-10-05T12:29:59Z
  Ended:       2026-10-05T13:02:01Z
  Severity:    Sev3
  Labels:      alertname="KubePodCrashLooping", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", reason="CrashLoopBackOff", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="5e533b4c-45fc-47fd-bd2f-17c4a977b441"
  Description: Pod ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff").
Firing 2:
  State:       Resolved
  Started:     2026-10-05T12:31:03Z
  Ended:       2026-10-05T13:02:01Z
  Severity:    Sev3
  Labels:      alertname="KubePodCrashLooping", cluster="ci01-j2217856-mgmt-1", component="kubernetes-infrastructure", container="etcd", endpoint="http", environment="ci01", instance="10.128.64.214:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j2217856/providers/microsoft.monitor/accounts/hcps-j2217856", namespace="ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics", pod="etcd-2", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", reason="CrashLoopBackOff", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning", uid="5e533b4c-45fc-47fd-bd2f-17c4a977b441"
  Description: Pod ocm-arohcpci01-2t8kbgro552tj4iv3ti1u3mhvuvqkpb8-ksm-hcp-metrics/etcd-2 (etcd) is in waiting state (reason: "CrashLoopBackOff").
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [hcp] alert KubePodCrashLooping does not fire2
Affected runs (2)
Date (UTC)Associated PRProw job
PR #73312107125784404561920
PR #73492107066190932217856
ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedC...
full failure pattern:
ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: [capi-provider]; provider Microsoft.RedHatOpenShift
Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 5 days
e2e22.60%2 of 77 job runs affectedFlakeSignal: Flake — present in 2 prior week(s); spread across 5 daysShow trend detailsSep 29: 19 · Sep 30: 3 · Oct 1: 5 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2none
Full failure examples (2)
fail [github.com/Azure/ARO-HCP/test/e2e/kms_key_rotation.go:98]: failed to create HCP cluster for KMS key rotation test
Unexpected error:
    <*fmt.wrapError | 0x36e441954e40>: 
    failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster="kms-key-rotate-422" in resourcegroup="kms-key-rotate-b88w54wctnjn" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
      "name": "baaa9036-b952-4d2a-af36-e458936f36a4",
      "status": "Failed",
      "startTime": "2026-10-05T15:55:35.591747237Z",
      "endTime": "2026-10-05T16:24:44.537042498Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n  \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x36e441954e20>{
            msg: "failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n  \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x36e442c82e10>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["6"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "a3f95c09-30cc-48c8-864f-93bedfa005a5",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 16:24:50 GMT",
                        ],
                        "Content-Length": ["800"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x36e441954c40>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 53, 58, 53, 53, 58, 51, 53, 46, 53, 57, 49, 55, 52, 55, 50, 51, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 52, 58, 52, 52, 46, 53, 51, 55, 48, 52, 50, 52, 57, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 800,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j4561920.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "a3ce1ebc-332d-4e44-a410-f6ca7636c979",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "5ecae373-2571-4956-8610-1ab01d3b362e",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:24:50Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j4561920.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x36e4416e62a0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12046148573969957371, 6451793621481834338],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926810520, loc: nil},
                                NotAfter: {wall: 0, ext: 63942535920, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
                                AuthorityKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j4561920.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n  \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/kms_key_rotation.go:98]: failed to create HCP cluster for KMS key rotation test
Unexpected error:
    <*fmt.wrapError | 0x36e441954e40>: 
    failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster="kms-key-rotate-422" in resourcegroup="kms-key-rotate-b88w54wctnjn" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
      "name": "baaa9036-b952-4d2a-af36-e458936f36a4",
      "status": "Failed",
      "startTime": "2026-10-05T15:55:35.591747237Z",
      "endTime": "2026-10-05T16:24:44.537042498Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster kms-key-rotate-422: failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n  \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x36e441954e20>{
            msg: "failed waiting for cluster=\"kms-key-rotate-422\" in resourcegroup=\"kms-key-rotate-b88w54wctnjn\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n  \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x36e442c82e10>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["6"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "a3f95c09-30cc-48c8-864f-93bedfa005a5",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 16:24:50 GMT",
                        ],
                        "Content-Length": ["800"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x36e441954c40>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 98, 97, 97, 97, 57, 48, 51, 54, 45, 98, 57, 53, 50, 45, 52, 100, 50, 97, 45, 97, 102, 51, 54, 45, 101, 52, 53, 56, 57, 51, 54, 102, 51, 54, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 53, 58, 53, 53, 58, 51, 53, 46, 53, 57, 49, 55, 52, 55, 50, 51, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 52, 58, 52, 52, 46, 53, 51, 55, 48, 52, 50, 52, 57, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 800,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j4561920.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "a3ce1ebc-332d-4e44-a410-f6ca7636c979",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "5ecae373-2571-4956-8610-1ab01d3b362e",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:24:50Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j4561920.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 89, 137, 96, 29, 156, 142, 71, 98, 167, 44, 132, 78, 7, 14, 193, 251, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 53, 50, 50, 48, 48, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 53, 51, 50, 48, 48, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 231, 231, 253, 109, 174, 181, 17, 215, 186, 77, 63, 196, 58, 222, 175, 33, 28, 131, 179, 251, 41, 63, 148, 152, 51, 172, 168, 230, 18, 247, 84, 5, 79, 216, 227, 149, 240, 153, 53, 93, 57, 19, 59, 5, 142, 41, 112, 29, 14, 68, 145, 79, 89, 110, 162, 155, 43, 16, 218, 133, 190, 1, 152, 142, 229, 8, 67, 206, 153, 68, 147, 15, 192, 143, 211, 209, 51, 145, 84, 185, 53, 205, 119, 241, 27, 143, 4, 44, 39, 10, 155, 210, 236, 213, 27, 42, 161, 78, 32, 1, 101, 190, 80, 224, 117, 98, 180, 76, 143, 235, 13, 240, 54, 230, 227, 149, 237, 6, 102, 14, 174, 17, 183, 2, 178, 148, 86, 8, 1, 224, 188, 201, 190, 20, 165, 170, 141, 233, 49, 180, 0, 18, 114, 26, 98, 58, 26, 190, 204, 17, 179, 165, 84, 179, 40, 193, 90, 80, 151, 175, 250, 84, 168, 191, 34, 95, 118, 214, 204, 155, 171, 128, 146, 139, 223, 155, 195, 124, 166, 70, 207, 45, 134, 38, 88, 73, 9, 171, 118, 46, 47, 153, 194, 24, 132, 240, 135, 99, 233, 93, 80, 101, 242, 192, 158, 233, 194, 126, 203, 100, 99, 1, 231, 174, 180, 173, 114, 188, 69, 11, 164, 7, 126, 10, 22, 55, 23, 129, 153, 16, 251, 179, 65, 2, 176, 95, 49, 112, 42, 89, 135, 146, 221, 37, 58, 92, 93, 225, 155, 138, 158, 86, 144, 220, 151, 145, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 53, 54, 49, 57, 50, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [173, 183, 143, 196, 8, 157, 186, 151, 80, 173, 243, 27, 54, 197, 55, 99, 150, 226, 67, 127, 130, 110, 110, 211, 42, 183, 183, 230, 128, 78, 70, 226, 32, 144, 33, 196, 70, 195, 33, 25, 114, 119, 79, 153, 54, 160, 81, 47, 213, 95, 44, 242, 107, 54, 150, 225, 141, 76, 61, 94, 237, 104, 184, 21, 163, 180, 222, 18, 130, 158, 202, 48, 96, 213, 244, 77, 101, 52, 116, 60, 29, 140, 216, 69, 142, 121, 0, 75, 144, 15, 205, 243, 239, 25, 139, 110, 221, 119, 1, 178, 160, 244, 34, 242, 187, 94, 49, 173, 88, 114, 7, 238, 240, 221, 240, 246, 34, 229, 31, 88, 134, 87, 39, 227, 192, 14, 53, 12, 64, 137, 25, 217, 232, 157, 239, 65, 169, 187, 255, 211, 200, 121, 11, 114, 40, 13, 123, 200, 193, 37, 43, 2, 169, 146, 140, 184, 83, 137, 2, 135, 157, 124, 50, 42, 189, 102, 91, 64, 132, 92, 33, 21, 178, 71, 150, 4, 122, 232, 232, 122, 154, 132, 25, 46, 166, 181, 10, 61, 109, 45, 237, 158, 34, 226, 81, 246, 153, 43, 221, 171, 68, 26, 241, 67, 140, 208, 214, 188, 37, 60, 156, 213, 251, 187, 198, 99, 41, 39, 145, 202, 144, 186, 234, 111, 177, 231, 151, 149, 226, 188, 253, 57, 197, 84, 237, 163, 103, 34, 72, 57, 41, 120, 212, 29, 172, 19, 119, 164, 221, 169, 172, 109, 198, 221, 151, 166],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x36e4416e62a0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12046148573969957371, 6451793621481834338],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4561920.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926810520, loc: nil},
                                NotAfter: {wall: 0, ext: 63942535920, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
                                AuthorityKeyId: [83, 195, 193, 57, 246, 47, 173, 24, 219, 116, 34, 160, 239, 163, 169, 163, 217, 55, 115, 160],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j4561920.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"name\": \"baaa9036-b952-4d2a-af36-e458936f36a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T15:55:35.591747237Z\",\n  \"endTime\": \"2026-10-05T16:24:44.537042498Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/metrics_amw_hcp_ksm.go:87]: failed to create HCP cluster "ksm-hcp-metrics"
Unexpected error:
    <*fmt.wrapError | 0x344ebf63c7c0>: 
    failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster="ksm-hcp-metrics" in resourcegroup="hcp-metrics-bsf4h8h9wkbr" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
      "name": "1d5a733a-9da9-4475-bed6-8528cbdf6e37",
      "status": "Failed",
      "startTime": "2026-10-05T12:10:42.682289211Z",
      "endTime": "2026-10-05T12:39:45.193347342Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n  \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x344ebf63c7a0>{
            msg: "failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n  \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x344ebef45c80>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["60"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "c4545e57-f0ba-44a5-9d2d-736013623271",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 12:39:46 GMT",
                        ],
                        "Content-Length": ["794"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x344ebf63c6c0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 101, 100, 49, 50, 50, 100, 49, 45, 55, 101, 48, 51, 45, 52, 97, 48, 49, 45, 98, 97, 97, 101, 45, 57, 48, 50, 48, 97, 98, 102, 51, 53, 48, 100, 52, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 49, 48, 58, 52, 50, 46, 54, 56, 50, 50, 56, 57, 50, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 51, 57, 58, 52, 53, 46, 49, 57, 51, 51, 52, 55, 51, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 794,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j2217856.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "136ed6eb-937d-4e4b-8536-654350fef198",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "18cbf27a-1b01-4066-9df8-5b9ddaff0188",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T12:39:46Z\"}",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j2217856.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j2217856.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x344ebe526210>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13059016536027565577, 8476489264654993528],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926796977, loc: nil},
                                NotAfter: {wall: 0, ext: 63942522377, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
                                AuthorityKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j2217856.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n  \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/metrics_amw_hcp_ksm.go:87]: failed to create HCP cluster "ksm-hcp-metrics"
Unexpected error:
    <*fmt.wrapError | 0x344ebf63c7c0>: 
    failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster="ksm-hcp-metrics" in resourcegroup="hcp-metrics-bsf4h8h9wkbr" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
      "name": "1d5a733a-9da9-4475-bed6-8528cbdf6e37",
      "status": "Failed",
      "startTime": "2026-10-05T12:10:42.682289211Z",
      "endTime": "2026-10-05T12:39:45.193347342Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster ksm-hcp-metrics: failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n  \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x344ebf63c7a0>{
            msg: "failed waiting for cluster=\"ksm-hcp-metrics\" in resourcegroup=\"hcp-metrics-bsf4h8h9wkbr\" to finish creating: GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n  \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x344ebef45c80>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["60"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "c4545e57-f0ba-44a5-9d2d-736013623271",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 12:39:46 GMT",
                        ],
                        "Content-Length": ["794"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x344ebf63c6c0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 54, 101, 100, 49, 50, 50, 100, 49, 45, 55, 101, 48, 51, 45, 52, 97, 48, 49, 45, 98, 97, 97, 101, 45, 57, 48, 50, 48, 97, 98, 102, 51, 53, 48, 100, 52, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 49, 100, 53, 97, 55, 51, 51, 97, 45, 57, 100, 97, 57, 45, 52, 52, 55, 53, 45, 98, 101, 100, 54, 45, 56, 53, 50, 56, 99, 98, 100, 102, 54, 101, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 49, 48, 58, 52, 50, 46, 54, 56, 50, 50, 56, 57, 50, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 50, 58, 51, 57, 58, 52, 53, 46, 49, 57, 51, 51, 52, 55, 51, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 67, 108, 117, 115, 116, 101, 114, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 105, 115, 32, 110, 111, 116, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 58, 32, 75, 117, 98, 101, 99, 111, 110, 102, 105, 103, 87, 97, 105, 116, 105, 110, 103, 70, 111, 114, 67, 114, 101, 97, 116, 101, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 104, 111, 115, 116, 101, 100, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 107, 117, 98, 101, 99, 111, 110, 102, 105, 103, 32, 116, 111, 32, 98, 101, 32, 99, 114, 101, 97, 116, 101, 100, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 99, 97, 112, 105, 45, 112, 114, 111, 118, 105, 100, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 794,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j2217856.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "136ed6eb-937d-4e4b-8536-654350fef198",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "18cbf27a-1b01-4066-9df8-5b9ddaff0188",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T12:39:46Z\"}",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j2217856.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j2217856.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 162, 138, 19, 106, 44, 72, 120, 181, 58, 242, 89, 145, 224, 14, 9, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 49, 51, 54, 49, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 49, 52, 54, 49, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 194, 211, 94, 75, 53, 136, 89, 106, 69, 248, 252, 242, 226, 246, 237, 231, 97, 248, 176, 189],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 174, 156, 77, 233, 7, 127, 159, 162, 157, 235, 232, 227, 255, 166, 19, 14, 245, 60, 140, 93, 118, 51, 96, 255, 192, 163, 118, 110, 43, 124, 203, 93, 85, 87, 146, 108, 72, 214, 202, 116, 171, 142, 180, 205, 133, 86, 235, 10, 152, 203, 107, 214, 81, 127, 185, 214, 69, 193, 179, 100, 48, 233, 108, 109, 239, 8, 113, 231, 177, 0, 52, 96, 85, 72, 181, 74, 215, 103, 190, 232, 214, 39, 150, 40, 199, 4, 178, 208, 201, 24, 20, 11, 42, 60, 77, 2, 119, 196, 88, 169, 193, 20, 163, 9, 62, 112, 224, 168, 71, 51, 171, 0, 67, 18, 78, 190, 120, 33, 71, 9, 231, 233, 17, 29, 88, 51, 123, 145, 5, 22, 216, 6, 109, 49, 158, 8, 249, 27, 68, 33, 152, 229, 107, 195, 143, 224, 237, 149, 46, 5, 62, 110, 32, 62, 167, 158, 31, 55, 104, 231, 151, 30, 134, 141, 176, 90, 143, 178, 35, 164, 43, 193, 3, 70, 37, 145, 203, 200, 179, 42, 223, 160, 187, 217, 164, 23, 171, 6, 218, 227, 186, 63, 172, 179, 89, 204, 121, 155, 215, 17, 123, 55, 26, 36, 87, 196, 64, 137, 148, 48, 231, 54, 153, 130, 71, 64, 232, 246, 223, 184, 140, 127, 185, 70, 119, 146, 141, 164, 215, 156, 180, 142, 121, 231, 80, 30, 143, 180, 230, 13, 5, 99, 230, 213, 92, 90, 180, 18, 230, 171, 116, 155, 158, 217, 107, 193, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 50, 49, 55, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [35, 201, 110, 86, 226, 149, 129, 41, 31, 201, 26, 80, 55, 77, 236, 190, 206, 104, 63, 159, 181, 80, 31, 47, 237, 97, 163, 105, 223, 53, 62, 118, 159, 122, 65, 57, 182, 33, 162, 243, 236, 24, 116, 140, 20, 240, 109, 25, 198, 192, 225, 185, 135, 163, 200, 91, 29, 209, 149, 102, 208, 12, 89, 35, 0, 28, 49, 199, 84, 168, 58, 198, 188, 195, 229, 51, 229, 43, 243, 28, 80, 216, 59, 101, 35, 255, 206, 250, 235, 93, 29, 233, 27, 166, 132, 173, 37, 82, 79, 122, 63, 118, 243, 249, 225, 136, 231, 26, 223, 227, 6, 27, 14, 236, 245, 215, 115, 194, 225, 89, 218, 58, 146, 43, 150, 5, 42, 131, 192, 64, 219, 53, 207, 177, 199, 212, 250, 141, 9, 134, 132, 116, 200, 62, 193, 108, 72, 222, 169, 245, 83, 186, 241, 41, 162, 158, 146, 8, 56, 179, 245, 68, 199, 118, 234, 18, 154, 252, 50, 6, 51, 66, 10, 148, 54, 136, 220, 193, 117, 109, 153, 202, 23, 34, 252, 160, 73, 126, 124, 100, 174, 230, 164, 240, 52, 221, 61, 97, 160, 95, 250, 112, 161, 170, 210, 134, 112, 162, 181, 98, 113, 56, 52, 78, 37, 228, 40, 202, 230, 8, 51, 12, 165, 169, 222, 130, 77, 59, 203, 103, 110, 96, 192, 56, 59, 91, 163, 57, 182, 188, 150, 210, 44, 238, 63, 61, 158, 38, 28, 189, 32, 34, 148, 168, 68, 105],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x344ebe526210>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13059016536027565577, 8476489264654993528],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j2217856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926796977, loc: nil},
                                NotAfter: {wall: 0, ext: 63942522377, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
                                AuthorityKeyId: "\xc2\xd3^K5\x88YjE\xf8\xfc\xf2\xe2\xf6\xed\xe7a\xf8\xb0\xbd",
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j2217856.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j2217856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"name\": \"1d5a733a-9da9-4475-bed6-8528cbdf6e37\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T12:10:42.682289211Z\",\n  \"endTime\": \"2026-10-05T12:39:45.193347342Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [clusterServiceClusterStatus] cluster service is installing; [hypershiftHostedCluster] hosted cluster is not available: KubeconfigWaitingForCreate: Waiting for hosted control plane kubeconfig to be created; hosted cluster degraded: UnavailableReplicas: capi-provider deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
Contributing tests (2)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to rotate KMS key for a cluster with version >= 4.221
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelEngineering want metrics from HCP to be present in Azure Monitor Workspace1
Affected runs (2)
Date (UTC)Associated PRProw job
PR #73312107125784404561920
PR #73492107066190932217856
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServic...
full failure pattern:
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServiceStatus] state is "uninstalling"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: nodePools, serviceProviderClusters, serviceProviderNodePools; provider Microsoft.RedHatOpenShift
Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days
e2e11.30%1 of 77 job runs affectedFlakeSignal: Flake — present in 2 prior week(s); spread across 3 daysShow trend detailsSep 29: 17 · Sep 30: 22 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 8none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x1aa156004108>: 
    resource group "rg-candidate-5-0-8tjwmpdtkhph": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-5-0-pgtvx6" in resourcegroup="rg-candidate-5-0-8tjwmpdtkhph" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8",
      "name": "79c1b550-6373-4cea-be54-1e9006359ec8",
      "status": "Failed",
      "startTime": "2026-10-05T02:23:09.692187892Z",
      "endTime": "2026-10-05T02:47:13.541313539Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x1aa155a102a0>{
                msg: "resource group \"rg-candidate-5-0-8tjwmpdtkhph\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x1aa155a10260>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x1aa155a10220>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x1aa155a10200>{
                            msg: "failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x1aa1560a4660>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                        "Content-Type": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x1aa155a10000>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1034,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j0780544.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57c5760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x1aa156004108>: 
    resource group "rg-candidate-5-0-8tjwmpdtkhph": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-5-0-pgtvx6" in resourcegroup="rg-candidate-5-0-8tjwmpdtkhph" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8",
      "name": "79c1b550-6373-4cea-be54-1e9006359ec8",
      "status": "Failed",
      "startTime": "2026-10-05T02:23:09.692187892Z",
      "endTime": "2026-10-05T02:47:13.541313539Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x1aa155a102a0>{
                msg: "resource group \"rg-candidate-5-0-8tjwmpdtkhph\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x1aa155a10260>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x1aa155a10220>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x1aa155a10200>{
                            msg: "failed waiting for hcpCluster=\"cluster-candidate-5-0-pgtvx6\" in resourcegroup=\"rg-candidate-5-0-8tjwmpdtkhph\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x1aa1560a4660>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                        "Content-Type": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x1aa155a10000>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1034,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j0780544.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57c5760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"name\": \"79c1b550-6373-4cea-be54-1e9006359ec8\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:23:09.692187892Z\",\n  \"endTime\": \"2026-10-05T02:47:13.541313539Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcftb9d8golj7an109igafq0puid5 still exists (deletion dispatched at 2026-10-05T02:23:16Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x3a1639c9c150>: 
    resource group "rg-candidate-4-22-w6vk6h8k9k9m": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-22-5ngq9s" in resourcegroup="rg-candidate-4-22-w6vk6h8k9k9m" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
      "name": "2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
      "status": "Failed",
      "startTime": "2026-10-05T02:18:35.841855817Z",
      "endTime": "2026-10-05T02:42:44.185198344Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x3a1637397360>{
                msg: "resource group \"rg-candidate-4-22-w6vk6h8k9k9m\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x3a1637397320>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x3a16373972e0>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x3a1637397280>{
                            msg: "failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x3a1639c32cf0>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x3a1637396e00>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1034,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j0780544.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57c5760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x3a1639c9c150>: 
    resource group "rg-candidate-4-22-w6vk6h8k9k9m": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-22-5ngq9s" in resourcegroup="rg-candidate-4-22-w6vk6h8k9k9m" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
      "name": "2709f4f5-77a0-416d-aca2-c1cf92ad96b7",
      "status": "Failed",
      "startTime": "2026-10-05T02:18:35.841855817Z",
      "endTime": "2026-10-05T02:42:44.185198344Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x3a1637397360>{
                msg: "resource group \"rg-candidate-4-22-w6vk6h8k9k9m\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x3a1637397320>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x3a16373972e0>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x3a1637397280>{
                            msg: "failed waiting for hcpCluster=\"cluster-candidate-4-22-5ngq9s\" in resourcegroup=\"rg-candidate-4-22-w6vk6h8k9k9m\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x3a1639c32cf0>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x3a1637396e00>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1034,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j0780544.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57c5760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"name\": \"2709f4f5-77a0-416d-aca2-c1cf92ad96b7\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:18:35.841855817Z\",\n  \"endTime\": \"2026-10-05T02:42:44.185198344Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcb20dsvl4btplesvugrshfmru5oc still exists (deletion dispatched at 2026-10-05T02:18:44Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x303aeb2f0180>: 
    resource group "rg-candidate-4-20-f7fctkc5pgvh": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-20-2xk4k8" in resourcegroup="rg-candidate-4-20-f7fctkc5pgvh" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe",
      "name": "ac7db877-195f-438d-ad8c-5562e31beefe",
      "status": "Failed",
      "startTime": "2026-10-05T02:17:15.872053554Z",
      "endTime": "2026-10-05T02:41:23.612334671Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x303aea9f69e0>{
                msg: "resource group \"rg-candidate-4-20-f7fctkc5pgvh\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x303aea9f6720>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x303aea9f66a0>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x303aea9f6660>{
                            msg: "failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x303aeba3eab0>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x303aea9f6440>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1034,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j0780544.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57c5760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x303aeb2f0180>: 
    resource group "rg-candidate-4-20-f7fctkc5pgvh": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-20-2xk4k8" in resourcegroup="rg-candidate-4-20-f7fctkc5pgvh" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe",
      "name": "ac7db877-195f-438d-ad8c-5562e31beefe",
      "status": "Failed",
      "startTime": "2026-10-05T02:17:15.872053554Z",
      "endTime": "2026-10-05T02:41:23.612334671Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x303aea9f69e0>{
                msg: "resource group \"rg-candidate-4-20-f7fctkc5pgvh\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x303aea9f6720>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x303aea9f66a0>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x303aea9f6660>{
                            msg: "failed waiting for hcpCluster=\"cluster-candidate-4-20-2xk4k8\" in resourcegroup=\"rg-candidate-4-20-f7fctkc5pgvh\" to finish deleting: GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x303aeba3eab0>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x303aea9f6440>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1034,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j0780544.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j0780544.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57c5760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j0780544.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"name\": \"ac7db877-195f-438d-ad8c-5562e31beefe\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T02:17:15.872053554Z\",\n  \"endTime\": \"2026-10-05T02:41:23.612334671Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8bcdvjf2bud05rc2f900gu17tdi5ei still exists (deletion dispatched at 2026-10-05T02:17:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
Contributing tests (8)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.201
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.221
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.231
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.01
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.11
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCreate HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to delete a nodepool1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #71782106913296060780544
alert [svc] ServiceCPUDrift fired
full failure pattern:
alert [svc] ServiceCPUDrift fired
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days
alert11.30%1 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 3 daysShow trend detailsSep 29: 2 · Sep 30: 1 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T02:34:29Z
  Severity:    Sev3
  Labels:      alertname="ServiceCPUDrift", cluster="ci01-j0780544-svc", component="service-memory", container="aro-hcp-frontend", namespace="aro-hcp", pod="aro-hcp-frontend-7d685f5d65-pqsl6", severity="warning", team="hcp-sl"
  Description: Container aro-hcp-frontend in pod aro-hcp-frontend-7d685f5d65-pqsl6 (namespace aro-hcp) on cluster ci01-j0780544-svc has averaged 333.9% of its CPU request over the last 30 minutes.
This may indicate workload growth that requires right-sizing the request in config.yaml.

Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T02:34:29Z
  Severity:    Sev3
  Labels:      alertname="ServiceCPUDrift", cluster="ci01-j0780544-svc", component="service-memory", container="aro-hcp-frontend", namespace="aro-hcp", pod="aro-hcp-frontend-7d685f5d65-cx7cb", severity="warning", team="hcp-sl"
  Description: Container aro-hcp-frontend in pod aro-hcp-frontend-7d685f5d65-cx7cb (namespace aro-hcp) on cluster ci01-j0780544-svc has averaged 330.2% of its CPU request over the last 30 minutes.
This may indicate workload growth that requires right-sizing the request in config.yaml.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert ServiceCPUDrift does not fire1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #71782106913296060780544
ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet complete...
full failure pattern:
ERROR CODE: DeadlineExceeded; detail message cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version <version> is Partial (want Completed), started <duration> ago; hosted cluster degraded: UnavailableReplicas: [router]; provider Microsoft.RedHatOpenShift
Signal: FlakeSignal: Flake — present in 2 prior week(s); spread across 3 days
e2e11.30%1 of 77 job runs affectedFlakeSignal: Flake — present in 2 prior week(s); spread across 3 daysShow trend detailsSep 29: 10 · Sep 30: 5 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-23-dtftt72rmq4p/cluster-candidate-4-23-8jw2cp should provision
Unexpected error:
    <*fmt.wrapError | 0x26a5bc4e400>: 
    failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster="cluster-candidate-4-23-8jw2cp" in resourcegroup="rg-candidate-4-23-dtftt72rmq4p" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
      "name": "37d8a3f3-8107-442c-8393-d0345952f91b",
      "status": "Failed",
      "startTime": "2026-10-05T17:20:34.024624942Z",
      "endTime": "2026-10-05T17:49:43.310425447Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n  \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x26a5bc4e120>{
            msg: "failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n  \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x26a5c6a2390>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "f46ca1e1-52f8-44e9-bb67-889cb17d0373",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 17:49:46 GMT",
                        ],
                        "Content-Length": ["736"],
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x26a5bc4e000>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 51, 52, 46, 48, 50, 52, 54, 50, 52, 57, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 52, 57, 58, 52, 51, 46, 51, 49, 48, 52, 50, 53, 52, 52, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 118, 101, 114, 115, 105, 111, 110, 32, 110, 111, 116, 32, 121, 101, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 100, 58, 32, 118, 101, 114, 115, 105, 111, 110, 32, 52, 46, 50, 51, 46, 48, 45, 101, 99, 46, 49, 32, 105, 115, 32, 80, 97, 114, 116, 105, 97, 108, 32, 40, 119, 97, 110, 116, 32, 67, 111, 109, 112, 108, 101, 116, 101, 100, 41, 44, 32, 115, 116, 97, 114, 116, 101, 100, 32, 50, 52, 109, 50, 115, 32, 97, 103, 111, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 114, 111, 117, 116, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 736,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j3289856.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
                            Fragment: "",
                            RawQuery: "api-version=2025-12-23-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "fbcf69e0-8a48-4875-8e0c-6fab6efbd907",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "f2be8d2b-f66b-4625-9159-9d50d40c317a",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:49:46Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j3289856.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j3289856.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x26a5c2c7ee0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13674014417601754645, 7714712095918866626],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926815684, loc: nil},
                                NotAfter: {wall: 0, ext: 63942541084, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
                                AuthorityKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j3289856.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ba760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n  \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-23-dtftt72rmq4p/cluster-candidate-4-23-8jw2cp should provision
Unexpected error:
    <*fmt.wrapError | 0x26a5bc4e400>: 
    failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster="cluster-candidate-4-23-8jw2cp" in resourcegroup="rg-candidate-4-23-dtftt72rmq4p" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
      "name": "37d8a3f3-8107-442c-8393-d0345952f91b",
      "status": "Failed",
      "startTime": "2026-10-05T17:20:34.024624942Z",
      "endTime": "2026-10-05T17:49:43.310425447Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster cluster-candidate-4-23-8jw2cp: failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n  \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x26a5bc4e120>{
            msg: "failed waiting for cluster=\"cluster-candidate-4-23-8jw2cp\" in resourcegroup=\"rg-candidate-4-23-dtftt72rmq4p\" to finish creating: GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n  \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x26a5c6a2390>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "f46ca1e1-52f8-44e9-bb67-889cb17d0373",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 17:49:46 GMT",
                        ],
                        "Content-Length": ["736"],
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x26a5bc4e000>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 55, 100, 56, 97, 51, 102, 51, 45, 56, 49, 48, 55, 45, 52, 52, 50, 99, 45, 56, 51, 57, 51, 45, 100, 48, 51, 52, 53, 57, 53, 50, 102, 57, 49, 98, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 51, 52, 46, 48, 50, 52, 54, 50, 52, 57, 52, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 52, 57, 58, 52, 51, 46, 51, 49, 48, 52, 50, 53, 52, 52, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 99, 111, 110, 116, 114, 111, 108, 32, 112, 108, 97, 110, 101, 32, 118, 101, 114, 115, 105, 111, 110, 32, 110, 111, 116, 32, 121, 101, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 100, 58, 32, 118, 101, 114, 115, 105, 111, 110, 32, 52, 46, 50, 51, 46, 48, 45, 101, 99, 46, 49, 32, 105, 115, 32, 80, 97, 114, 116, 105, 97, 108, 32, 40, 119, 97, 110, 116, 32, 67, 111, 109, 112, 108, 101, 116, 101, 100, 41, 44, 32, 115, 116, 97, 114, 116, 101, 100, 32, 50, 52, 109, 50, 115, 32, 97, 103, 111, 59, 32, 104, 111, 115, 116, 101, 100, 32, 99, 108, 117, 115, 116, 101, 114, 32, 100, 101, 103, 114, 97, 100, 101, 100, 58, 32, 85, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 82, 101, 112, 108, 105, 99, 97, 115, 58, 32, 114, 111, 117, 116, 101, 114, 32, 100, 101, 112, 108, 111, 121, 109, 101, 110, 116, 32, 104, 97, 115, 32, 49, 32, 117, 110, 97, 118, 97, 105, 108, 97, 98, 108, 101, 32, 114, 101, 112, 108, 105, 99, 97, 115, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 736,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j3289856.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b",
                            Fragment: "",
                            RawQuery: "api-version=2025-12-23-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "fbcf69e0-8a48-4875-8e0c-6fab6efbd907",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "f2be8d2b-f66b-4625-9159-9d50d40c317a",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:49:46Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j3289856.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j3289856.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 107, 16, 41, 198, 229, 167, 64, 194, 189, 195, 219, 170, 46, 184, 246, 21, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 52, 56, 48, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 53, 56, 48, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 150, 152, 67, 23, 80, 197, 3, 214, 173, 48, 146, 197, 159, 131, 245, 239, 109, 67, 141, 171, 26, 170, 225, 238, 17, 240, 7, 118, 31, 128, 141, 62, 64, 132, 163, 242, 128, 85, 162, 85, 173, 151, 127, 68, 90, 126, 166, 35, 20, 160, 105, 137, 93, 71, 177, 228, 174, 40, 113, 105, 101, 154, 174, 58, 137, 55, 103, 32, 216, 17, 81, 76, 55, 205, 51, 246, 106, 255, 233, 113, 209, 163, 78, 5, 126, 193, 177, 2, 182, 114, 168, 59, 3, 141, 7, 173, 185, 198, 177, 198, 82, 55, 232, 135, 230, 217, 22, 77, 175, 50, 99, 142, 19, 191, 186, 1, 180, 74, 134, 150, 200, 216, 123, 226, 69, 252, 169, 149, 66, 87, 52, 135, 226, 137, 242, 120, 203, 144, 228, 26, 181, 58, 152, 151, 194, 207, 55, 162, 126, 41, 184, 109, 173, 167, 142, 250, 205, 93, 182, 105, 138, 50, 20, 91, 125, 29, 167, 75, 29, 146, 18, 166, 172, 223, 231, 119, 145, 173, 249, 48, 247, 37, 133, 61, 40, 226, 184, 214, 184, 202, 72, 105, 131, 34, 29, 42, 124, 39, 7, 153, 169, 41, 206, 70, 76, 120, 203, 213, 137, 50, 199, 244, 16, 199, 85, 137, 233, 99, 116, 207, 22, 248, 172, 110, 62, 2, 9, 154, 49, 253, 154, 159, 52, 95, 223, 138, 4, 84, 15, 178, 94, 180, 190, 189, 32, 205, 219, 40, 252, 157, 88, 16, 24, 76, 62, 217, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 51, 50, 56, 57, 56, 53, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [39, 67, 216, 246, 105, 235, 89, 216, 192, 224, 246, 247, 245, 47, 112, 137, 249, 153, 80, 223, 21, 233, 102, 111, 198, 158, 97, 203, 183, 25, 213, 195, 111, 236, 9, 19, 78, 96, 161, 40, 206, 119, 92, 217, 13, 190, 25, 15, 6, 168, 7, 4, 249, 168, 216, 237, 64, 154, 70, 212, 214, 124, 133, 159, 57, 240, 178, 7, 72, 38, 212, 196, 142, 91, 74, 246, 181, 34, 139, 220, 212, 59, 10, 74, 151, 247, 97, 49, 209, 82, 114, 108, 4, 233, 199, 44, 35, 29, 170, 92, 48, 17, 95, 192, 11, 155, 72, 107, 249, 202, 248, 102, 5, 122, 14, 160, 74, 241, 70, 28, 115, 144, 228, 77, 53, 218, 11, 248, 37, 76, 76, 63, 16, 174, 217, 165, 212, 84, 30, 170, 207, 14, 233, 47, 127, 153, 250, 180, 218, 225, 47, 239, 165, 138, 88, 59, 251, 42, 227, 42, 200, 72, 63, 123, 131, 158, 109, 22, 236, 236, 56, 118, 164, 93, 217, 188, 109, 1, 208, 13, 51, 74, 10, 166, 98, 111, 162, 123, 183, 185, 170, 237, 141, 226, 231, 17, 103, 106, 75, 4, 1, 185, 99, 2, 235, 200, 159, 171, 253, 186, 119, 187, 116, 172, 189, 208, 165, 87, 56, 16, 100, 254, 168, 53, 131, 34, 58, 200, 111, 89, 210, 244, 185, 51, 89, 32, 201, 82, 122, 3, 250, 9, 61, 77, 68, 154, 27, 188, 200, 227, 237, 129, 19, 136, 78, 60],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x26a5c2c7ee0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13674014417601754645, 7714712095918866626],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j3289856.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926815684, loc: nil},
                                NotAfter: {wall: 0, ext: 63942541084, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
                                AuthorityKeyId: [21, 118, 95, 147, 101, 30, 77, 62, 3, 1, 103, 225, 118, 218, 45, 154, 208, 0, 11, 20],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j3289856.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ba760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j3289856.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"name\": \"37d8a3f3-8107-442c-8393-d0345952f91b\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:34.024624942Z\",\n  \"endTime\": \"2026-10-05T17:49:43.310425447Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster creation did not complete before the deadline; [hypershiftHostedCluster] hosted cluster control plane version not yet completed: version 4.23.0-ec.1 is Partial (want Completed), started 24m2s ago; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.231
Affected runs (1)
Date (UTC)Associated PRProw job
PR #70882107144096983289856
certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
full failure pattern:
certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days
e2e11.30%1 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 3 daysShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 1 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:388]: Timed out after 600.008s.
Certificate should be issued by Let's Encrypt staging via ACME DNS-01
Expected success, but got an error:
    <*errors.errorString | 0x3e07d72e7160>: 
    certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
    {
        s: "certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist",
    }
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:388]: Timed out after 600.008s.
Certificate should be issued by Let's Encrypt staging via ACME DNS-01
Expected success, but got an error:
    <*errors.errorString | 0x3e07d72e7160>: 
    certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist
    {
        s: "certificate not ready: reason=DoesNotExist message=Issuing certificate as Secret does not exist",
    }
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to issue the default ingress serving certificate from Let's Encrypt using cert-manager with ACME DNS-01 challenges1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73492107193894448926720
ERROR CODE: ResourceNotFound; detail message The resource 'locations/hcpOperationStatuses/<uuid>' under resource group '' was not found.; provider Microsoft.RedHatOpenShift
full failure pattern:
ERROR CODE: ResourceNotFound; detail message The resource 'locations/hcpOperationStatuses/<uuid>' under resource group '' was not found.; provider Microsoft.RedHatOpenShift
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 4 days
e2e11.30%1 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 4 daysShow trend detailsSep 29: 1 · Sep 30: 3 · Oct 1: 0 · Oct 2: 1 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
    <*fmt.wrapError | 0x352e8fdfe6c0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-gqb58gqd8ldz" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141
    --------------------------------------------------------------------------------
    RESPONSE 404: 404 Not Found
    ERROR CODE: ResourceNotFound
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "ResourceNotFound",
        "message": "The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"ResourceNotFound\",\n    \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x352e8fdfe2a0>{
            msg: "failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"ResourceNotFound\",\n    \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x352e919c0810>{
                ErrorCode: "ResourceNotFound",
                StatusCode: 404,
                RawResponse: {
                    Status: "404 Not Found",
                    StatusCode: 404,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["9"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Error-Code": ["ResourceNotFound"],
                        "X-Ms-Request-Id": [
                            "bb64626a-f069-4e2c-9f9a-a7bf9903305e",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 19:38:08 GMT",
                        ],
                        "Content-Length": ["394"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x352e8fdfe100>{
                        s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 82, 101, 115, 111, 117, 114, 99, 101, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 84, 104, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 39, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 39, 32, 117, 110, 100, 101, 114, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 103, 114, 111, 117, 112, 32, 39, 39, 32, 119, 97, 115, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 46, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 394,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j8278144.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "15a1cb22-1bff-47f2-bc22-751642c58b3b",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "00763265-c059-4a7d-84bf-5ebca7b78a65",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:38:08Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j8278144.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j8278144.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x352e90a880e0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12940308445013740884, 4596296149214776718],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926822334, loc: nil},
                                NotAfter: {wall: 0, ext: 63942547734, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
                                AuthorityKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j8278144.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"ResourceNotFound\",\n    \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
    <*fmt.wrapError | 0x352e8fdfe6c0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-gqb58gqd8ldz" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141
    --------------------------------------------------------------------------------
    RESPONSE 404: 404 Not Found
    ERROR CODE: ResourceNotFound
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "ResourceNotFound",
        "message": "The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"ResourceNotFound\",\n    \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x352e8fdfe2a0>{
            msg: "failed waiting for nodepool=\"np-1\" for cluster \"v20260901\" in resourcegroup=\"v20260901preview-gqb58gqd8ldz\" to finish creating: GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"ResourceNotFound\",\n    \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x352e919c0810>{
                ErrorCode: "ResourceNotFound",
                StatusCode: 404,
                RawResponse: {
                    Status: "404 Not Found",
                    StatusCode: 404,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["9"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Error-Code": ["ResourceNotFound"],
                        "X-Ms-Request-Id": [
                            "bb64626a-f069-4e2c-9f9a-a7bf9903305e",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 19:38:08 GMT",
                        ],
                        "Content-Length": ["394"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x352e8fdfe100>{
                        s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 82, 101, 115, 111, 117, 114, 99, 101, 78, 111, 116, 70, 111, 117, 110, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 84, 104, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 39, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 39, 32, 117, 110, 100, 101, 114, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 103, 114, 111, 117, 112, 32, 39, 39, 32, 119, 97, 115, 32, 110, 111, 116, 32, 102, 111, 117, 110, 100, 46, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 102, 55, 101, 101, 100, 45, 98, 100, 101, 100, 45, 52, 57, 50, 99, 45, 97, 54, 55, 49, 45, 52, 102, 99, 56, 98, 56, 53, 50, 100, 49, 52, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 394,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j8278144.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "15a1cb22-1bff-47f2-bc22-751642c58b3b",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "00763265-c059-4a7d-84bf-5ebca7b78a65",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:38:08Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j8278144.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j8278144.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 63, 201, 82, 254, 216, 113, 77, 142, 179, 149, 53, 248, 85, 8, 13, 84, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 56, 51, 56, 53, 52, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 52, 56, 53, 52, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 115, 252, 63, 105, 95, 176, 190, 205, 153, 245, 132, 100, 130, 40, 53, 248, 163, 161, 39, 164],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 200, 4, 205, 142, 135, 243, 51, 168, 224, 82, 218, 135, 233, 120, 73, 52, 115, 137, 71, 50, 129, 143, 132, 12, 8, 170, 212, 218, 88, 161, 133, 28, 60, 175, 112, 149, 174, 214, 160, 25, 58, 171, 8, 5, 16, 210, 213, 67, 241, 155, 47, 183, 42, 188, 3, 255, 82, 96, 248, 155, 20, 7, 216, 155, 201, 165, 232, 39, 72, 174, 187, 26, 89, 80, 170, 103, 240, 10, 37, 16, 242, 63, 0, 206, 91, 250, 71, 130, 22, 100, 137, 84, 184, 231, 95, 166, 196, 139, 210, 14, 215, 186, 145, 123, 36, 230, 96, 30, 177, 234, 248, 204, 112, 60, 148, 40, 102, 23, 150, 96, 23, 219, 57, 18, 106, 178, 144, 70, 196, 58, 231, 206, 140, 14, 92, 11, 201, 59, 54, 90, 41, 153, 17, 8, 252, 214, 120, 165, 243, 76, 22, 199, 184, 20, 75, 45, 173, 214, 34, 254, 107, 56, 21, 182, 217, 220, 234, 19, 159, 135, 49, 176, 197, 52, 75, 131, 244, 191, 220, 63, 70, 110, 14, 67, 154, 216, 119, 194, 87, 241, 122, 7, 250, 22, 189, 8, 116, 57, 58, 177, 144, 222, 37, 50, 190, 114, 7, 149, 56, 137, 200, 38, 186, 252, 185, 61, 151, 101, 84, 253, 20, 172, 131, 24, 245, 38, 48, 63, 26, 246, 8, 11, 72, 128, 29, 195, 103, 90, 135, 188, 60, 42, 48, 62, 234, 50, 105, 225, 116, 176, 46, 189, 121, 246, 228, 161, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 56, 50, 55, 56, 49, 52, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [121, 172, 253, 212, 219, 183, 41, 188, 253, 172, 34, 131, 20, 157, 101, 53, 248, 120, 66, 61, 186, 66, 238, 90, 138, 92, 131, 79, 10, 243, 73, 52, 133, 220, 145, 236, 169, 9, 207, 1, 70, 25, 225, 73, 85, 75, 67, 75, 45, 224, 112, 148, 242, 71, 229, 156, 134, 230, 7, 121, 100, 119, 26, 2, 3, 234, 90, 98, 164, 196, 63, 27, 231, 232, 44, 47, 216, 188, 214, 85, 114, 116, 192, 5, 205, 146, 145, 241, 17, 164, 243, 235, 235, 249, 36, 28, 102, 60, 151, 212, 49, 249, 203, 13, 16, 133, 192, 0, 195, 183, 12, 115, 81, 13, 76, 255, 105, 128, 70, 199, 211, 73, 251, 91, 121, 88, 235, 113, 22, 92, 206, 240, 178, 226, 81, 191, 61, 157, 142, 244, 45, 95, 118, 102, 172, 215, 91, 167, 99, 194, 210, 242, 232, 60, 98, 206, 16, 181, 74, 69, 24, 217, 199, 81, 25, 202, 254, 83, 34, 190, 205, 16, 108, 82, 95, 122, 39, 110, 28, 5, 71, 91, 189, 224, 248, 163, 130, 233, 86, 213, 142, 89, 250, 234, 16, 220, 231, 117, 14, 81, 17, 234, 45, 34, 92, 240, 124, 73, 169, 193, 114, 100, 219, 42, 193, 141, 198, 213, 221, 215, 248, 233, 96, 208, 0, 244, 218, 253, 65, 32, 116, 109, 240, 192, 8, 233, 121, 191, 78, 100, 135, 253, 114, 62, 72, 38, 254, 185, 250, 81, 241, 140, 191, 167, 103, 136],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x352e90a880e0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12940308445013740884, 4596296149214776718],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j8278144.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926822334, loc: nil},
                                NotAfter: {wall: 0, ext: 63942547734, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
                                AuthorityKeyId: "s\xfc?i_\xb0\xbe͙\xf5\x84d\x82(5\xf8\xa3\xa1'\xa4",
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j8278144.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j8278144.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE: ResourceNotFound\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"ResourceNotFound\",\n    \"message\": \"The resource 'locations/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141' under resource group '' was not found.\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8f7eed-bded-492c-a671-4fc8b852d141\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should create a cluster using v20260901preview API and verify cluster health1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73552107168836758278144
--------------------------------------------------------------------------------
full failure pattern:
--------------------------------------------------------------------------------
Signal: FlakeSignal: Flake — present in 3 prior week(s); spread across 3 days
e2e11.30%1 of 77 job runs affectedFlakeSignal: Flake — present in 3 prior week(s); spread across 3 daysShow trend detailsSep 29: 0 · Sep 30: 2 · Oct 1: 0 · Oct 2: 0 · Oct 3: 1 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:132]: nodepool creation errors: [failed to create NodePool np-update-NODES: failed waiting for nodepool="np-update-NODES" for cluster "np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-s2df9c9g5rnt" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
  "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
  "name": "804b1468-bc9d-4cd4-810e-085d36fab533",
  "status": "Failed",
  "startTime": "2026-10-05T17:20:24.835135873Z",
  "endTime": "2026-10-05T17:39:28.597417139Z",
  "error": {
    "code": "DeadlineExceeded",
    "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n"
  }
}
--------------------------------------------------------------------------------
]
Expected
    <[]error | len:1, cap:1>: [
        <*fmt.wrapError | 0x1274e3ba83a0>{
            msg: "failed to create NodePool np-update-NODES: failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n  \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*fmt.wrapError | 0x1274e368e1e0>{
                msg: "failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n  \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*exported.ResponseError | 0x1274e49e2420>{
                    ErrorCode: "DeadlineExceeded",
                    StatusCode: 200,
                    RawResponse: {
                        Status: "200 OK",
                        StatusCode: 200,
                        Proto: "HTTP/2.0",
                        ProtoMajor: 2,
                        ProtoMinor: 0,
                        Header: {
                            "Content-Length": ["1461"],
                            "X-Envoy-Upstream-Service-Time": ["8"],
                            "Server": ["istio-envoy"],
                            "Content-Type": ["application/json"],
                            "X-Ms-Request-Id": [
                                "899145d5-ec22-45c5-a22a-ffcdba0a2eda",
                            ],
                            "Date": [
                                "Mon, 05 Oct 2026 17:39:34 GMT",
                            ],
                        },
                        Body: <*exported.nopClosingBytesReader | 0x1274e386c1a0>{
                            s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 50, 52, 46, 56, 51, 53, 49, 51, 53, 56, 55, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 51, 57, 58, 50, 56, 46, 53, 57, 55, 52, 49, 55, 49, 51, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 49, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                            i: 0,
                        },
                        ContentLength: 1461,
                        TransferEncoding: nil,
                        Close: false,
                        Uncompressed: false,
                        Trailer: nil,
                        Request: {
                            Method: "GET",
                            URL: {
                                Scheme: "https",
                                Opaque: "",
                                User: nil,
                                Host: "rp.j2198528.hcpsvc.osadev.cloud",
                                Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
                                Fragment: "",
                                RawQuery: "api-version=2024-06-10-preview",
                                RawPath: "",
                                RawFragment: "",
                                ForceQuery: false,
                                OmitHost: false,
                            },
                            Proto: "HTTP/1.1",
                            ProtoMajor: 1,
                            ProtoMinor: 1,
                            Header: {
                                "X-Ms-Correlation-Request-Id": [
                                    "c75486c1-7a37-4aed-9c02-c6fa004ef9f8",
                                ],
                                "X-Ms-Client-Request-Id": [
                                    "555b284c-ed81-4274-874b-02ed7482c7a6",
                                ],
                                "X-Ms-Arm-Resource-System-Data": [
                                    "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:39:34Z\"}",
                                ],
                                "X-Ms-Identity-Url": [
                                    "https://dummyhost.identity.azure.net",
                                ],
                                "User-Agent": [
                                    "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                ],
                                "Authorization": ["redacted"],
                            },
                            Body: nil,
                            GetBody: nil,
                            ContentLength: 0,
                            TransferEncoding: nil,
                            Close: false,
                            Host: "rp.j2198528.hcpsvc.osadev.cloud",
                            Form: nil,
                            PostForm: nil,
                            MultipartForm: nil,
                            Trailer: nil,
                            RemoteAddr: "",
                            RequestURI: "",
                            TLS: nil,
                            Cancel: nil,
                            Response: nil,
                            Pattern: "",
                            ctx: <suppressed context>,
                            pat: nil,
                            matches: nil,
                            otherValues: nil,
                        },
                        TLS: {
                            Version: 772,
                            HandshakeComplete: true,
                            DidResume: false,
                            CipherSuite: 4865,
                            CurveID: 29,
                            NegotiatedProtocol: "h2",
                            NegotiatedProtocolIsMutual: true,
                            ServerName: "rp.j2198528.hcpsvc.osadev.cloud",
                            PeerCertificates: [
                                {
                                    Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
                                    RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
                                    RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1],
                                    RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                    RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                    Signature: [93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
                                    SignatureAlgorithm: 4,
                                    PublicKeyAlgorithm: 1,
                                    PublicKey: <*rsa.PublicKey | 0x1274e2e36730>{
                                        N: {neg: ..., abs: ...},
                                        E: 65537,
                                    },
                                    Version: 3,
                                    SerialNumber: {neg: false, abs: [..., ...]},
                                    Issuer: {
                                        Country: nil,
                                        Organization: nil,
                                        OrganizationalUnit: nil,
                                        Locality: nil,
                                        Province: nil,
                                        StreetAddress: nil,
                                        PostalCode: nil,
                                        SerialNumber: "",
                                        CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
                                        Names: [...],
                                        ExtraNames: nil,
                                    },
                                    Subject: {
                                        Country: nil,
                                        Organization: nil,
                                        OrganizationalUnit: nil,
                                        Locality: nil,
                                        Province: nil,
                                        StreetAddress: nil,
                                        PostalCode: nil,
                                        SerialNumber: "",
                                        CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
                                        Names: [...],
                                        ExtraNames: nil,
                                    },
                                    NotBefore: {wall: 0, ext: 63926813667, loc: nil},
                                    NotAfter: {wall: 0, ext: 63942539067, loc: nil},
                                    KeyUsage: 5,
                                    Extensions: [
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                    ],
                                    ExtraExtensions: nil,
                                    UnhandledCriticalExtensions: nil,
                                    ExtKeyUsage: [1, 2],
                                    UnknownExtKeyUsage: nil,
                                    BasicConstraintsValid: true,
                                    IsCA: false,
                                    MaxPathLen: -1,
                                    MaxPathLenZero: false,
                                    SubjectKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
                                    AuthorityKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
                                    OCSPServer: nil,
                                    IssuingCertificateURL: nil,
                                    DNSNames: [
                                        "rp.j2198528.hcpsvc.osadev.cloud",
                                    ],
                                    EmailAddresses: nil,
                                    IPAddresses: nil,
                                    URIs: nil,
                                    PermittedDNSDomainsCritical: false,
                                    PermittedDNSDomains: nil,
                                    ExcludedDNSDomains: nil,
                                    PermittedIPRanges: nil,
                                    ExcludedIPRanges: nil,
                                    PermittedEmailAddresses: nil,
                                    ExcludedEmailAddresses: nil,
                                    PermittedURIDomains: nil,
                                    ExcludedURIDomains: nil,
                                    CRLDistributionPoints: nil,
                                    PolicyIdentifiers: nil,
                                    Policies: nil,
                                    InhibitAnyPolicy: 0,
                                    InhibitAnyPolicyZero: false,
                                    InhibitPolicyMapping: 0,
                                    InhibitPolicyMappingZero: false,
                                    RequireExplicitPolicy: 0,
                                    RequireExplicitPolicyZero: false,
                                    PolicyMappings: nil,
                                },
                            ],
                            VerifiedChains: nil,
                            SignedCertificateTimestamps: nil,
                            OCSPResponse: nil,
                            TLSUnique: nil,
                            ECHAccepted: false,
                            HelloRetryRequest: false,
                            ekm: 0x5733c20,
                            testingOnlyPeerSignatureAlgorithm: 2052,
                        },
                    },
                    errMsg: "GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n  \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                },
            },
        },
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:132]: nodepool creation errors: [failed to create NodePool np-update-NODES: failed waiting for nodepool="np-update-NODES" for cluster "np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-s2df9c9g5rnt" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: DeadlineExceeded
--------------------------------------------------------------------------------
{
  "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
  "name": "804b1468-bc9d-4cd4-810e-085d36fab533",
  "status": "Failed",
  "startTime": "2026-10-05T17:20:24.835135873Z",
  "endTime": "2026-10-05T17:39:28.597417139Z",
  "error": {
    "code": "DeadlineExceeded",
    "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\n"
  }
}
--------------------------------------------------------------------------------
]
Expected
    <[]error | len:1, cap:1>: [
        <*fmt.wrapError | 0x1274e3ba83a0>{
            msg: "failed to create NodePool np-update-NODES: failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n  \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*fmt.wrapError | 0x1274e368e1e0>{
                msg: "failed waiting for nodepool=\"np-update-NODES\" for cluster \"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-s2df9c9g5rnt\" to finish creating: GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n  \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*exported.ResponseError | 0x1274e49e2420>{
                    ErrorCode: "DeadlineExceeded",
                    StatusCode: 200,
                    RawResponse: {
                        Status: "200 OK",
                        StatusCode: 200,
                        Proto: "HTTP/2.0",
                        ProtoMajor: 2,
                        ProtoMinor: 0,
                        Header: {
                            "Content-Length": ["1461"],
                            "X-Envoy-Upstream-Service-Time": ["8"],
                            "Server": ["istio-envoy"],
                            "Content-Type": ["application/json"],
                            "X-Ms-Request-Id": [
                                "899145d5-ec22-45c5-a22a-ffcdba0a2eda",
                            ],
                            "Date": [
                                "Mon, 05 Oct 2026 17:39:34 GMT",
                            ],
                        },
                        Body: <*exported.nopClosingBytesReader | 0x1274e386c1a0>{
                            s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 48, 52, 98, 49, 52, 54, 56, 45, 98, 99, 57, 100, 45, 52, 99, 100, 52, 45, 56, 49, 48, 101, 45, 48, 56, 53, 100, 51, 54, 102, 97, 98, 53, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 50, 48, 58, 50, 52, 46, 56, 51, 53, 49, 51, 53, 56, 55, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 55, 58, 51, 57, 58, 50, 56, 46, 53, 57, 55, 52, 49, 55, 49, 51, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 49, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 49, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 115, 50, 100, 102, 57, 99, 57, 103, 53, 114, 110, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 105, 50, 112, 54, 115, 48, 108, 49, 118, 54, 99, 48, 99, 52, 101, 45, 110, 112, 45, 117, 112, 100, 97, 116, 101, 45, 110, 111, 100, 101, 115, 45, 106, 102, 56, 98, 119, 45, 116, 52, 104, 119, 98, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                            i: 0,
                        },
                        ContentLength: 1461,
                        TransferEncoding: nil,
                        Close: false,
                        Uncompressed: false,
                        Trailer: nil,
                        Request: {
                            Method: "GET",
                            URL: {
                                Scheme: "https",
                                Opaque: "",
                                User: nil,
                                Host: "rp.j2198528.hcpsvc.osadev.cloud",
                                Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533",
                                Fragment: "",
                                RawQuery: "api-version=2024-06-10-preview",
                                RawPath: "",
                                RawFragment: "",
                                ForceQuery: false,
                                OmitHost: false,
                            },
                            Proto: "HTTP/1.1",
                            ProtoMajor: 1,
                            ProtoMinor: 1,
                            Header: {
                                "X-Ms-Correlation-Request-Id": [
                                    "c75486c1-7a37-4aed-9c02-c6fa004ef9f8",
                                ],
                                "X-Ms-Client-Request-Id": [
                                    "555b284c-ed81-4274-874b-02ed7482c7a6",
                                ],
                                "X-Ms-Arm-Resource-System-Data": [
                                    "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T17:39:34Z\"}",
                                ],
                                "X-Ms-Identity-Url": [
                                    "https://dummyhost.identity.azure.net",
                                ],
                                "User-Agent": [
                                    "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                ],
                                "Authorization": ["redacted"],
                            },
                            Body: nil,
                            GetBody: nil,
                            ContentLength: 0,
                            TransferEncoding: nil,
                            Close: false,
                            Host: "rp.j2198528.hcpsvc.osadev.cloud",
                            Form: nil,
                            PostForm: nil,
                            MultipartForm: nil,
                            Trailer: nil,
                            RemoteAddr: "",
                            RequestURI: "",
                            TLS: nil,
                            Cancel: nil,
                            Response: nil,
                            Pattern: "",
                            ctx: <suppressed context>,
                            pat: nil,
                            matches: nil,
                            otherValues: nil,
                        },
                        TLS: {
                            Version: 772,
                            HandshakeComplete: true,
                            DidResume: false,
                            CipherSuite: 4865,
                            CurveID: 29,
                            NegotiatedProtocol: "h2",
                            NegotiatedProtocolIsMutual: true,
                            ServerName: "rp.j2198528.hcpsvc.osadev.cloud",
                            PeerCertificates: [
                                {
                                    Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
                                    RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 32, 166, 247, 238, 189, 27, 78, 131, 164, 192, 1, 195, 147, 175, 134, 216, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 54, 49, 52, 50, 55, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 54, 50, 52, 50, 55, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
                                    RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 49, 252, 86, 114, 244, 124, 97, 104, 161, 52, 86, 109, 182, 148, 247, 136, 170, 164, 12, 238, 248, 127, 234, 250, 152, 19, 133, 248, 86, 157, 40, 139, 104, 199, 244, 114, 9, 66, 7, 65, 150, 30, 89, 249, 41, 188, 31, 218, 254, 96, 218, 108, 16, 7, 194, 102, 155, 44, 161, 192, 231, 91, 230, 123, 179, 185, 126, 226, 110, 217, 76, 91, 57, 41, 170, 95, 210, 161, 79, 197, 58, 234, 250, 171, 13, 55, 66, 46, 114, 29, 150, 223, 237, 40, 231, 31, 19, 84, 187, 102, 80, 234, 193, 68, 181, 222, 247, 95, 186, 175, 85, 53, 199, 209, 182, 235, 71, 233, 247, 249, 250, 182, 166, 40, 79, 25, 210, 248, 190, 51, 241, 29, 221, 65, 73, 43, 196, 5, 141, 69, 71, 20, 12, 120, 107, 215, 203, 28, 156, 180, 128, 78, 168, 15, 159, 255, 3, 108, 164, 197, 198, 80, 6, 181, 168, 32, 124, 227, 136, 63, 22, 7, 126, 71, 75, 0, 104, 46, 179, 207, 179, 186, 155, 152, 158, 239, 145, 145, 98, 141, 132, 172, 204, 112, 5, 125, 172, 184, 166, 235, 24, 217, 209, 74, 169, 43, 121, 80, 61, 93, 246, 234, 38, 231, 43, 51, 68, 225, 1, 216, 165, 87, 108, 2, 253, 80, 251, 172, 190, 119, 156, 176, 86, 137, 188, 128, 164, 190, 112, 9, 164, 244, 77, 172, 26, 113, 16, 99, 229, 78, 126, 64, 122, 228, 237, 2, 3, 1, 0, 1],
                                    RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                    RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 50, 49, 57, 56, 53, 50, 56, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                    Signature: [93, 155, 163, 243, 41, 219, 118, 101, 117, 161, 123, 18, 101, 41, 56, 126, 102, 90, 14, 183, 93, 230, 97, 200, 9, 76, 139, 241, 111, 250, 164, 150, 238, 236, 209, 195, 31, 241, 167, 252, 86, 22, 106, 173, 212, 139, 123, 27, 229, 179, 179, 201, 43, 36, 192, 68, 74, 92, 228, 192, 150, 224, 70, 141, 4, 228, 208, 87, 77, 86, 36, 248, 188, 252, 111, 114, 168, 210, 227, 127, 7, 24, 120, 238, 139, 122, 236, 240, 108, 196, 138, 185, 162, 87, 246, 167, 124, 111, 149, 108, 124, 189, 140, 203, 84, 115, 119, 163, 56, 221, 233, 198, 138, 116, 60, 59, 174, 119, 19, 77, 29, 137, 220, 10, 235, 240, 240, 46, 142, 122, 178, 89, 169, 87, 35, 8, 7, 208, 223, 137, 30, 135, 188, 14, 0, 249, 249, 74, 0, 81, 51, 81, 185, 193, 155, 35, 12, 79, 28, 72, 155, 35, 196, 252, 148, 205, 109, 41, 168, 122, 232, 91, 98, 51, 3, 202, 187, 88, 58, 114, 163, 114, 32, 142, 212, 81, 24, 206, 235, 176, 238, 40, 121, 170, 54, 85, 208, 6, 211, 32, 137, 156, 215, 29, 91, 254, 13, 161, 30, 90, 50, 95, 134, 148, 119, 91, 207, 94, 118, 93, 244, 147, 220, 185, 150, 143, 11, 133, 227, 208, 60, 198, 171, 4, 78, 255, 87, 143, 97, 128, 133, 125, 190, 3, 12, 148, 13, 236, 56, 138, 111, 84, 37, 183, 176, 192],
                                    SignatureAlgorithm: 4,
                                    PublicKeyAlgorithm: 1,
                                    PublicKey: <*rsa.PublicKey | 0x1274e2e36730>{
                                        N: {neg: ..., abs: ...},
                                        E: 65537,
                                    },
                                    Version: 3,
                                    SerialNumber: {neg: false, abs: [..., ...]},
                                    Issuer: {
                                        Country: nil,
                                        Organization: nil,
                                        OrganizationalUnit: nil,
                                        Locality: nil,
                                        Province: nil,
                                        StreetAddress: nil,
                                        PostalCode: nil,
                                        SerialNumber: "",
                                        CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
                                        Names: [...],
                                        ExtraNames: nil,
                                    },
                                    Subject: {
                                        Country: nil,
                                        Organization: nil,
                                        OrganizationalUnit: nil,
                                        Locality: nil,
                                        Province: nil,
                                        StreetAddress: nil,
                                        PostalCode: nil,
                                        SerialNumber: "",
                                        CommonName: "rp.j2198528.hcpsvc.osadev.cloud",
                                        Names: [...],
                                        ExtraNames: nil,
                                    },
                                    NotBefore: {wall: 0, ext: 63926813667, loc: nil},
                                    NotAfter: {wall: 0, ext: 63942539067, loc: nil},
                                    KeyUsage: 5,
                                    Extensions: [
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                        {Id: ..., Critical: ..., Value: ...},
                                    ],
                                    ExtraExtensions: nil,
                                    UnhandledCriticalExtensions: nil,
                                    ExtKeyUsage: [1, 2],
                                    UnknownExtKeyUsage: nil,
                                    BasicConstraintsValid: true,
                                    IsCA: false,
                                    MaxPathLen: -1,
                                    MaxPathLenZero: false,
                                    SubjectKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
                                    AuthorityKeyId: [227, 57, 3, 199, 69, 116, 224, 217, 28, 117, 13, 97, 67, 40, 127, 215, 249, 12, 75, 231],
                                    OCSPServer: nil,
                                    IssuingCertificateURL: nil,
                                    DNSNames: [
                                        "rp.j2198528.hcpsvc.osadev.cloud",
                                    ],
                                    EmailAddresses: nil,
                                    IPAddresses: nil,
                                    URIs: nil,
                                    PermittedDNSDomainsCritical: false,
                                    PermittedDNSDomains: nil,
                                    ExcludedDNSDomains: nil,
                                    PermittedIPRanges: nil,
                                    ExcludedIPRanges: nil,
                                    PermittedEmailAddresses: nil,
                                    ExcludedEmailAddresses: nil,
                                    PermittedURIDomains: nil,
                                    ExcludedURIDomains: nil,
                                    CRLDistributionPoints: nil,
                                    PolicyIdentifiers: nil,
                                    Policies: nil,
                                    InhibitAnyPolicy: 0,
                                    InhibitAnyPolicyZero: false,
                                    InhibitPolicyMapping: 0,
                                    InhibitPolicyMappingZero: false,
                                    RequireExplicitPolicy: 0,
                                    RequireExplicitPolicyZero: false,
                                    PolicyMappings: nil,
                                },
                            ],
                            VerifiedChains: nil,
                            SignedCertificateTimestamps: nil,
                            OCSPResponse: nil,
                            TLSUnique: nil,
                            ECHAccepted: false,
                            HelloRetryRequest: false,
                            ekm: 0x5733c20,
                            testingOnlyPeerSignatureAlgorithm: 2052,
                        },
                    },
                    errMsg: "GET https://rp.j2198528.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"name\": \"804b1468-bc9d-4cd4-810e-085d36fab533\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T17:20:24.835135873Z\",\n  \"endTime\": \"2026-10-05T17:39:28.597417139Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllNodesHealthy is False: 1 of 2 machines are not healthy\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\\nMachine i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-update-nodes-s2df9c9g5rnt--managed/providers/Microsoft.Compute/virtualMachines/i2p6s0l1v6c0c4e-np-update-nodes-jf8bw-t4hwb to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                },
            },
        },
    ]
to be empty
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to update nodepool replicas and autoscaling1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73102107140685202198528
failed to create nodepool <nodepool>: failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: GET <url>
full failure pattern:
failed to create nodepool <nodepool>: failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: GET <url>
Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s)
e2e3444.16%34 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 1 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 34none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0x325fd7944b20>: 
    failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-ng96cscd46kh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
      "name": "e2da8575-58f4-46e6-afe9-f8b19daec723",
      "status": "Failed",
      "startTime": "2026-10-06T00:31:19.626547026Z",
      "endTime": "2026-10-06T00:50:21.291382978Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n  \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x325fd7944880>{
            msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n  \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x325fd9614ea0>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "66aff4b8-5d1b-45a0-bb13-b10f02fc92a8",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:50:22 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x325fd7944780>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 49, 57, 46, 54, 50, 54, 53, 52, 55, 48, 50, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 48, 58, 50, 49, 46, 50, 57, 49, 51, 56, 50, 57, 55, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "3af8787f-942d-41b9-a8d4-1ae5d4856cd8",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "65b76431-6c2c-4f8f-ab9e-3592dd03f034",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:50:22Z\"}",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x325fd86f0100>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n  \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0x325fd7944b20>: 
    failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-ng96cscd46kh" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
      "name": "e2da8575-58f4-46e6-afe9-f8b19daec723",
      "status": "Failed",
      "startTime": "2026-10-06T00:31:19.626547026Z",
      "endTime": "2026-10-06T00:50:21.291382978Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n  \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x325fd7944880>{
            msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-ng96cscd46kh\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n  \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x325fd9614ea0>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "66aff4b8-5d1b-45a0-bb13-b10f02fc92a8",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:50:22 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x325fd7944780>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 50, 100, 97, 56, 53, 55, 53, 45, 53, 56, 102, 52, 45, 52, 54, 101, 54, 45, 97, 102, 101, 57, 45, 102, 56, 98, 49, 57, 100, 97, 101, 99, 55, 50, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 49, 57, 46, 54, 50, 54, 53, 52, 55, 48, 50, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 48, 58, 50, 49, 46, 50, 57, 49, 51, 56, 50, 57, 55, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 98, 55, 99, 115, 113, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 58, 32, 82, 101, 97, 100, 121, 85, 110, 107, 110, 111, 119, 110, 58, 32, 42, 32, 78, 111, 100, 101, 72, 101, 97, 108, 116, 104, 121, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 110, 111, 100, 101, 112, 111, 111, 108, 45, 100, 101, 108, 101, 116, 101, 45, 110, 103, 57, 54, 99, 115, 99, 100, 52, 54, 107, 104, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 121, 50, 101, 57, 121, 48, 104, 53, 121, 55, 98, 49, 108, 55, 114, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 98, 116, 56, 57, 106, 45, 104, 110, 107, 107, 103, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "3af8787f-942d-41b9-a8d4-1ae5d4856cd8",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "65b76431-6c2c-4f8f-ab9e-3592dd03f034",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:50:22Z\"}",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x325fd86f0100>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"name\": \"e2da8575-58f4-46e6-afe9-f8b19daec723\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:31:19.626547026Z\",\n  \"endTime\": \"2026-10-06T00:50:21.291382978Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-b7csq to exist\\nMachine y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg: ReadyUnknown: * NodeHealthy: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ng96cscd46kh--managed/providers/Microsoft.Compute/virtualMachines/y2e9y0h5y7b1l7r-np-deletable-bt89j-hnkkg to exist\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0xf77febeee80>: 
    failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-59nnck7b7ddj" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
      "name": "9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
      "status": "Failed",
      "startTime": "2026-10-06T00:42:41.848796269Z",
      "endTime": "2026-10-06T01:01:47.364609011Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n  \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xf77fe058740>{
            msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n  \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xf7800502930>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "33221c57-5c0c-4abf-b7e6-98abf13efab6",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 01:01:55 GMT",
                        ],
                        "Content-Length": ["1234"],
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0xf77fe058660>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 49, 46, 56, 52, 56, 55, 57, 54, 50, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 49, 58, 52, 55, 46, 51, 54, 52, 54, 48, 57, 48, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1234,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j0653312.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "487730a8-1aeb-4abb-8a9a-e21aaec92b9a",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "e8cf4544-9e1a-413a-ac74-ce09ca9fb545",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:01:55Z\"}",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j0653312.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0xf77fe8e06f0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13759147031339684878, 7869995520253709034],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926840305, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565705, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j0653312.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n  \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0xf77febeee80>: 
    failed to create NodePool np-deletable: failed waiting for nodepool="np-deletable" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-59nnck7b7ddj" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
      "name": "9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
      "status": "Failed",
      "startTime": "2026-10-06T00:42:41.848796269Z",
      "endTime": "2026-10-06T01:01:47.364609011Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-deletable: failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n  \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xf77fe058740>{
            msg: "failed waiting for nodepool=\"np-deletable\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-59nnck7b7ddj\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n  \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xf7800502930>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "33221c57-5c0c-4abf-b7e6-98abf13efab6",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 01:01:55 GMT",
                        ],
                        "Content-Length": ["1234"],
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0xf77fe058660>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 98, 56, 54, 51, 55, 102, 54, 45, 52, 101, 52, 101, 45, 52, 101, 49, 49, 45, 97, 100, 99, 53, 45, 53, 50, 102, 57, 100, 102, 50, 56, 49, 100, 54, 102, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 52, 49, 46, 56, 52, 56, 55, 57, 54, 50, 54, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 49, 58, 52, 55, 46, 51, 54, 52, 54, 48, 57, 48, 49, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 103, 106, 113, 104, 108, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 98, 50, 119, 50, 120, 49, 116, 57, 106, 51, 109, 53, 107, 56, 119, 45, 110, 112, 45, 100, 101, 108, 101, 116, 97, 98, 108, 101, 45, 54, 100, 98, 56, 54, 45, 110, 108, 107, 52, 98, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1234,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j0653312.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "487730a8-1aeb-4abb-8a9a-e21aaec92b9a",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "e8cf4544-9e1a-413a-ac74-ce09ca9fb545",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:01:55Z\"}",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j0653312.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0xf77fe8e06f0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13759147031339684878, 7869995520253709034],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926840305, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565705, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j0653312.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"name\": \"9b8637f6-4e4e-4e11-adc5-52f9df281d6f\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:42:41.848796269Z\",\n  \"endTime\": \"2026-10-06T01:01:47.364609011Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-gjqhl: Creating: virtualmachine creating or updating\\nMachine b2w2x1t9j3m5k8w-np-deletable-6db86-nlk4b: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0x3b8837030ea0>: 
    failed to create NodePool np-delete-main: failed waiting for nodepool="np-delete-main" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-qn7rxq8vsgwr" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
      "name": "981cb8df-9c35-4549-a20c-83287e603506",
      "status": "Failed",
      "startTime": "2026-10-06T00:37:58.264221134Z",
      "endTime": "2026-10-06T00:57:04.189335399Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-delete-main: failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n  \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n  \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x3b883737f660>{
            msg: "failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n  \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n  \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x3b88381ab200>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "474511fc-52ec-4aa0-bd04-d3e41f10bbf8",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:57:10 GMT",
                        ],
                        "Content-Length": ["1242"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x3b883737f480>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 55, 58, 53, 56, 46, 50, 54, 52, 50, 50, 49, 49, 51, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 55, 58, 48, 52, 46, 49, 56, 57, 51, 51, 53, 51, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1242,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j9938304.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "5ba9f580-f6e2-462f-bd15-4fc5763b18a4",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "087963ac-e16d-4e23-a64e-401f0b3a2a3e",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:57:10Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j9938304.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x3b8837184b80>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13832122844420265345, 6972343662838108115],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839815, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565215, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
                                AuthorityKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j9938304.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n  \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n  \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:128]: failed to create node pools
Expected success, but got an error:
    <*fmt.wrapError | 0x3b8837030ea0>: 
    failed to create NodePool np-delete-main: failed waiting for nodepool="np-delete-main" for cluster "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-qn7rxq8vsgwr" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
      "name": "981cb8df-9c35-4549-a20c-83287e603506",
      "status": "Failed",
      "startTime": "2026-10-06T00:37:58.264221134Z",
      "endTime": "2026-10-06T00:57:04.189335399Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-delete-main: failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n  \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n  \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x3b883737f660>{
            msg: "failed waiting for nodepool=\"np-delete-main\" for cluster \"np-delete-hcp-cluster\" in resourcegroup=\"nodepool-delete-qn7rxq8vsgwr\" to finish creating: GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n  \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n  \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x3b88381ab200>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "474511fc-52ec-4aa0-bd04-d3e41f10bbf8",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:57:10 GMT",
                        ],
                        "Content-Length": ["1242"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x3b883737f480>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 57, 56, 49, 99, 98, 56, 100, 102, 45, 57, 99, 51, 53, 45, 52, 53, 52, 57, 45, 97, 50, 48, 99, 45, 56, 51, 50, 56, 55, 101, 54, 48, 51, 53, 48, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 55, 58, 53, 56, 46, 50, 54, 52, 50, 50, 49, 49, 51, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 53, 55, 58, 48, 52, 46, 49, 56, 57, 51, 51, 53, 51, 57, 57, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 100, 54, 116, 56, 118, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 103, 49, 117, 48, 120, 53, 105, 48, 103, 48, 104, 57, 116, 48, 120, 45, 110, 112, 45, 100, 101, 108, 101, 116, 101, 45, 109, 97, 105, 110, 45, 115, 102, 99, 55, 55, 45, 122, 122, 109, 107, 110, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1242,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j9938304.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506",
                            Fragment: "",
                            RawQuery: "api-version=2026-09-01-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Correlation-Request-Id": [
                                "5ba9f580-f6e2-462f-bd15-4fc5763b18a4",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "087963ac-e16d-4e23-a64e-401f0b3a2a3e",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:57:10Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j9938304.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j9938304.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 96, 194, 189, 158, 203, 105, 79, 211, 191, 245, 146, 112, 247, 60, 85, 129, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 203, 117, 185, 198, 76, 212, 191, 117, 110, 44, 13, 213, 77, 186, 6, 114, 97, 159, 92, 238, 16, 232, 11, 220, 30, 68, 84, 236, 144, 54, 84, 170, 21, 225, 238, 212, 169, 147, 207, 169, 88, 245, 197, 223, 118, 62, 183, 246, 252, 145, 96, 24, 10, 205, 200, 174, 21, 205, 76, 99, 239, 137, 91, 1, 36, 233, 73, 76, 221, 154, 188, 197, 81, 147, 42, 40, 148, 59, 116, 29, 106, 117, 28, 168, 65, 218, 248, 135, 123, 164, 138, 79, 164, 182, 52, 65, 233, 71, 252, 61, 218, 128, 146, 25, 151, 53, 119, 73, 61, 17, 220, 234, 186, 105, 213, 235, 85, 24, 130, 35, 46, 131, 167, 15, 4, 242, 33, 46, 125, 185, 40, 133, 27, 41, 105, 48, 227, 54, 190, 245, 71, 2, 198, 247, 177, 169, 202, 225, 186, 4, 11, 32, 104, 239, 65, 77, 51, 228, 72, 53, 197, 126, 53, 120, 86, 130, 68, 39, 84, 228, 150, 219, 144, 48, 105, 29, 220, 226, 136, 19, 185, 207, 34, 38, 128, 184, 227, 135, 166, 143, 119, 83, 185, 150, 116, 229, 68, 132, 56, 129, 150, 254, 77, 195, 176, 211, 212, 170, 194, 40, 166, 243, 122, 203, 208, 109, 192, 97, 230, 78, 124, 105, 30, 98, 58, 78, 1, 93, 184, 205, 104, 240, 48, 60, 192, 243, 232, 66, 41, 95, 53, 215, 110, 166, 65, 7, 36, 26, 19, 184, 94, 47, 188, 202, 174, 241, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 57, 57, 51, 56, 51, 48, 52, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [143, 51, 79, 196, 133, 79, 64, 223, 17, 63, 65, 79, 213, 125, 90, 140, 226, 7, 141, 228, 217, 205, 103, 246, 14, 254, 125, 211, 91, 0, 150, 108, 253, 51, 90, 88, 114, 159, 144, 124, 77, 140, 254, 137, 25, 143, 16, 39, 125, 115, 34, 61, 186, 114, 36, 115, 241, 111, 50, 244, 155, 137, 108, 232, 77, 252, 178, 187, 11, 16, 120, 9, 196, 72, 187, 25, 105, 252, 165, 109, 128, 160, 11, 71, 238, 218, 191, 72, 111, 159, 12, 156, 227, 1, 241, 159, 56, 136, 21, 231, 75, 214, 214, 186, 100, 154, 253, 60, 127, 86, 157, 127, 245, 69, 85, 235, 177, 230, 209, 93, 184, 1, 202, 199, 12, 164, 0, 48, 143, 205, 223, 158, 131, 81, 53, 188, 107, 42, 30, 155, 111, 79, 50, 245, 219, 234, 182, 18, 32, 205, 160, 75, 127, 40, 15, 156, 206, 210, 75, 47, 255, 166, 147, 165, 50, 200, 180, 33, 106, 156, 195, 175, 136, 141, 49, 235, 37, 90, 6, 121, 22, 97, 83, 32, 168, 184, 39, 44, 140, 102, 70, 81, 73, 19, 254, 95, 248, 249, 210, 227, 20, 174, 43, 248, 204, 199, 139, 13, 178, 43, 117, 173, 80, 83, 4, 105, 2, 41, 72, 254, 123, 172, 2, 169, 255, 244, 151, 222, 68, 174, 102, 70, 11, 183, 235, 138, 216, 149, 247, 208, 128, 36, 220, 233, 80, 132, 211, 207, 157, 31, 153, 80, 182, 80, 189, 162],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x3b8837184b80>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13832122844420265345, 6972343662838108115],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j9938304.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839815, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565215, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
                                AuthorityKeyId: [82, 82, 51, 11, 36, 48, 62, 152, 194, 248, 47, 16, 251, 186, 213, 170, 164, 28, 30, 134],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j9938304.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j9938304.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/981cb8df-9c35-4549-a20c-83287e603506\",\n  \"name\": \"981cb8df-9c35-4549-a20c-83287e603506\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:37:58.264221134Z\",\n  \"endTime\": \"2026-10-06T00:57:04.189335399Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-d6t8v: Creating: virtualmachine creating or updating\\nMachine g1u0x5i0g0h9t0x-np-delete-main-sfc77-zzmkn: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to delete a nodepool34
Affected runs (34)
ERROR CODE: DeadlineExceeded; provider Microsoft.Network
full failure pattern:
ERROR CODE: DeadlineExceeded; provider Microsoft.Network
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s)
e2e3038.96%30 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 2 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 20 · Oct 5: 78none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26"
Unexpected error:
    <*fmt.wrapError | 0x9b2aa98c820>: 
    failed to create NodePool np-cnrz26: failed waiting for nodepool="np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26" in resourcegroup="rg-candidate-4-20-t59xhk8kf8gv" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
      "name": "4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
      "status": "Failed",
      "startTime": "2026-10-06T00:10:04.605905756Z",
      "endTime": "2026-10-06T00:29:11.434639901Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-cnrz26: failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n  \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x9b2a98a8520>{
            msg: "failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n  \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x9b2ab3de5a0>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["6"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "b76f349f-d162-4e80-8d68-9ad1f44a1294",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:29:17 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x9b2a98a8340>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 48, 52, 46, 54, 48, 53, 57, 48, 53, 55, 53, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 57, 58, 49, 49, 46, 52, 51, 52, 54, 51, 57, 57, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "21f5f497-c676-4db6-ae72-1d4a52bd4c58",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "6fa3a6e2-8e70-48b5-b48b-af1365738b7f",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:29:17Z\"}",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x9b2aa01fc60>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n  \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26"
Unexpected error:
    <*fmt.wrapError | 0x9b2aa98c820>: 
    failed to create NodePool np-cnrz26: failed waiting for nodepool="np-cnrz26" for cluster "cluster-candidate-4-20-cnrz26" in resourcegroup="rg-candidate-4-20-t59xhk8kf8gv" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
      "name": "4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
      "status": "Failed",
      "startTime": "2026-10-06T00:10:04.605905756Z",
      "endTime": "2026-10-06T00:29:11.434639901Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-cnrz26: failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n  \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x9b2a98a8520>{
            msg: "failed waiting for nodepool=\"np-cnrz26\" for cluster \"cluster-candidate-4-20-cnrz26\" in resourcegroup=\"rg-candidate-4-20-t59xhk8kf8gv\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n  \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x9b2ab3de5a0>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["6"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "b76f349f-d162-4e80-8d68-9ad1f44a1294",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:29:17 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x9b2a98a8340>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 99, 50, 54, 97, 48, 98, 102, 45, 57, 101, 100, 54, 45, 52, 97, 57, 52, 45, 97, 52, 49, 56, 45, 98, 53, 102, 53, 51, 97, 98, 49, 52, 56, 100, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 48, 58, 48, 52, 46, 54, 48, 53, 57, 48, 53, 55, 53, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 57, 58, 49, 49, 46, 52, 51, 52, 54, 51, 57, 57, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 57, 116, 106, 109, 99, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 114, 103, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 52, 45, 50, 48, 45, 116, 53, 57, 120, 104, 107, 56, 107, 102, 56, 103, 118, 45, 99, 97, 110, 100, 105, 100, 97, 116, 101, 45, 99, 110, 114, 122, 50, 54, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 117, 52, 121, 52, 115, 57, 102, 54, 114, 57, 106, 50, 101, 55, 114, 45, 110, 112, 45, 99, 110, 114, 122, 50, 54, 45, 119, 57, 53, 120, 114, 45, 116, 104, 98, 53, 55, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "21f5f497-c676-4db6-ae72-1d4a52bd4c58",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "6fa3a6e2-8e70-48b5-b48b-af1365738b7f",
                            ],
                            "Authorization": ["redacted"],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:29:17Z\"}",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x9b2aa01fc60>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"name\": \"4c26a0bf-9ed6-4a94-a418-b5f53ab148da\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:10:04.605905756Z\",\n  \"endTime\": \"2026-10-06T00:29:11.434639901Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Compute/virtualMachines/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-9tjmc: Creating: virtualmachine creating or updating\\nMachine u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57: Failed: interfaces failed to create or update. err: failed to get existing resource rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-t59xhk8kf8gv-candidate-cnrz26--managed/providers/Microsoft.Network/networkInterfaces/u4y4s9f6r9j2e7r-np-cnrz26-w95xr-thb57-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' ... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:138]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapError | 0x2e2078a1dec0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-tb9m6klh44nq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
      "name": "32bc3eda-5158-4662-b3b6-59d79c4170a4",
      "status": "Failed",
      "startTime": "2026-10-06T00:12:59.67085605Z",
      "endTime": "2026-10-06T00:32:01.502118765Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n  \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x2e20791d0a00>{
            msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n  \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x2e2079014b10>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "51d257d1-1c22-488c-8519-e537d67ac3c6",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:32:02 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x2e20791d07c0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 53, 57, 46, 54, 55, 48, 56, 53, 54, 48, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 50, 58, 48, 49, 46, 53, 48, 50, 49, 49, 56, 55, 54, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "49e32d01-96ca-492a-940f-2ffaf9b46927",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "144d5ac7-df67-413f-8449-0642b93ebc52",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:32:02Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x2e20789f9950>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n  \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:138]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
    <*fmt.wrapError | 0x2e2078a1dec0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-tb9m6klh44nq" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
      "name": "32bc3eda-5158-4662-b3b6-59d79c4170a4",
      "status": "Failed",
      "startTime": "2026-10-06T00:12:59.67085605Z",
      "endTime": "2026-10-06T00:32:01.502118765Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-1: failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n  \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x2e20791d0a00>{
            msg: "failed waiting for nodepool=\"np-1\" for cluster \"private-kv-cluster\" in resourcegroup=\"private-keyvault-tb9m6klh44nq\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n  \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x2e2079014b10>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["8"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "51d257d1-1c22-488c-8519-e537d67ac3c6",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:32:02 GMT",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x2e20791d07c0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 50, 98, 99, 51, 101, 100, 97, 45, 53, 49, 53, 56, 45, 52, 54, 54, 50, 45, 98, 51, 98, 54, 45, 53, 57, 100, 55, 57, 99, 52, 49, 55, 48, 97, 52, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 53, 57, 46, 54, 55, 48, 56, 53, 54, 48, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 50, 58, 48, 49, 46, 53, 48, 50, 49, 49, 56, 55, 54, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 109, 102, 52, 110, 55, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 112, 114, 105, 118, 97, 116, 101, 45, 107, 101, 121, 118, 97, 117, 108, 116, 45, 116, 98, 57, 109, 54, 107, 108, 104, 52, 52, 110, 113, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 102, 53, 108, 55, 120, 55, 114, 55, 109, 53, 97, 49, 113, 51, 98, 45, 110, 112, 45, 49, 45, 112, 103, 106, 57, 107, 45, 107, 122, 115, 56, 53, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: -1,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5947136.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "49e32d01-96ca-492a-940f-2ffaf9b46927",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "144d5ac7-df67-413f-8449-0642b93ebc52",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:32:02Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5947136.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 117, 177, 166, 245, 127, 115, 68, 133, 177, 156, 230, 37, 173, 243, 201, 116, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 48, 49, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 48, 49, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 191, 234, 163, 18, 58, 27, 183, 30, 7, 250, 240, 47, 239, 91, 38, 192, 238, 7, 200, 164, 231, 0, 60, 98, 117, 119, 129, 246, 166, 253, 164, 78, 236, 84, 10, 28, 70, 66, 125, 228, 116, 86, 237, 182, 234, 27, 149, 123, 245, 121, 57, 188, 225, 157, 70, 114, 207, 118, 148, 56, 58, 192, 17, 75, 193, 47, 40, 213, 188, 246, 88, 7, 241, 254, 148, 5, 56, 223, 93, 213, 211, 111, 64, 172, 163, 211, 250, 19, 221, 185, 219, 34, 199, 94, 160, 125, 105, 132, 15, 219, 230, 160, 116, 14, 18, 57, 166, 116, 164, 193, 65, 26, 62, 113, 206, 168, 125, 20, 33, 89, 245, 20, 170, 6, 235, 41, 186, 86, 82, 209, 235, 57, 235, 242, 204, 169, 217, 69, 161, 132, 96, 114, 248, 23, 210, 84, 104, 188, 157, 174, 238, 167, 57, 104, 186, 32, 74, 88, 161, 90, 189, 118, 141, 75, 162, 124, 75, 87, 19, 47, 47, 171, 17, 236, 189, 4, 235, 172, 4, 172, 201, 167, 98, 19, 87, 25, 129, 99, 73, 17, 50, 242, 131, 111, 14, 186, 224, 169, 89, 189, 9, 152, 4, 249, 105, 128, 105, 189, 78, 103, 179, 139, 43, 187, 64, 134, 147, 134, 103, 156, 243, 183, 42, 78, 206, 148, 224, 246, 130, 72, 112, 130, 192, 136, 236, 232, 193, 32, 74, 242, 188, 175, 216, 71, 15, 28, 149, 78, 234, 138, 148, 96, 238, 61, 106, 197, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 57, 52, 55, 49, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [51, 128, 110, 133, 29, 234, 50, 37, 192, 138, 29, 107, 101, 72, 127, 172, 189, 216, 151, 204, 227, 114, 62, 184, 177, 162, 19, 153, 13, 138, 64, 221, 195, 222, 222, 139, 6, 249, 46, 60, 7, 175, 125, 227, 195, 51, 153, 191, 58, 78, 44, 77, 50, 56, 122, 153, 160, 58, 229, 126, 168, 125, 77, 218, 203, 113, 204, 22, 46, 50, 125, 131, 56, 245, 255, 126, 124, 80, 248, 85, 13, 53, 25, 82, 153, 157, 207, 101, 21, 64, 176, 195, 205, 216, 53, 159, 109, 2, 130, 101, 142, 104, 74, 167, 149, 117, 95, 109, 222, 191, 234, 204, 92, 85, 150, 26, 70, 2, 169, 26, 72, 255, 166, 1, 205, 147, 13, 154, 179, 55, 74, 19, 109, 23, 2, 166, 229, 254, 96, 160, 164, 162, 146, 184, 110, 230, 215, 82, 150, 219, 142, 52, 26, 170, 180, 32, 30, 20, 180, 220, 153, 85, 82, 190, 29, 165, 154, 168, 102, 59, 68, 135, 41, 149, 146, 200, 231, 44, 69, 222, 183, 125, 191, 74, 149, 229, 230, 1, 11, 190, 125, 149, 220, 190, 113, 30, 121, 35, 252, 228, 159, 179, 111, 163, 156, 198, 242, 23, 180, 242, 179, 223, 110, 1, 31, 157, 63, 220, 191, 174, 186, 42, 89, 5, 115, 123, 192, 189, 11, 194, 249, 204, 61, 188, 245, 199, 8, 124, 44, 70, 224, 182, 133, 119, 146, 196, 103, 81, 99, 107, 195, 83, 50, 189, 240, 191],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x2e20789f9950>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12798357290586720628, 8480743146650813573],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926839811, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565211, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                AuthorityKeyId: [50, 243, 206, 231, 46, 74, 101, 131, 227, 24, 239, 186, 46, 15, 230, 204, 179, 212, 93, 182],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5947136.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57ee760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"name\": \"32bc3eda-5158-4662-b3b6-59d79c4170a4\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:59.67085605Z\",\n  \"endTime\": \"2026-10-06T00:32:01.502118765Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85 to exist\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Compute/virtualMachines/f5l7x7r7m5a1q3b-np-1-pgj9k-mf4n7 to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85: Failed: interfaces failed to create or update. err: failed to get existing resource private-keyvault-tb9m6klh44nq--managed/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-tb9m6klh44nq--managed/providers/Microsoft.Network/networkInterfaces/f5l7x7r7m5a1q3b-np-1-pgj9k-kzs85-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are available. Refe... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0x2591190241f8>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-8jtnxl7527bt" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
      "name": "8a2eda1e-5b61-431e-9807-ec017ff31933",
      "status": "Failed",
      "startTime": "2026-10-06T00:12:27.991930257Z",
      "endTime": "2026-10-06T00:31:33.303872485Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x2591190241e0>{
                errs: [
                    <*fmt.wrapError | 0x2591189e64c0>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x259119689b80>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x2591189e6980>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                        err: <*fmt.wrapError | 0x2591189e6940>{
                            msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                            err: <*errors.errorString | 0x259119cf8240>{
                                s: "no cilium pods found in kube-system namespace",
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x2591184c3340>{
                msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n  \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x259119444c40>{
                    msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n  \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x2591193daae0>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "X-Envoy-Upstream-Service-Time": ["9"],
                                "Server": ["istio-envoy"],
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "7fa66e49-4e6a-4bf0-a4a8-a2d540d934f1",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:31:41 GMT",
                                ],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x259119444aa0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 50, 55, 46, 57, 57, 49, 57, 51, 48, 50, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 51, 51, 46, 51, 48, 51, 56, 55, 50, 52, 56, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: -1,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "Authorization": ["redacted"],
                                    "X-Ms-Correlation-Request-Id": [
                                        "163dc543-7acc-4d2a-a58d-111eee39e74f",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "c4ca5eed-06d7-48dd-8f0a-5e169ff93ad6",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:31:41Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x259118882f10>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57ee760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n  \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0x2591190241f8>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace
    failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-8jtnxl7527bt" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
      "name": "8a2eda1e-5b61-431e-9807-ec017ff31933",
      "status": "Failed",
      "startTime": "2026-10-06T00:12:27.991930257Z",
      "endTime": "2026-10-06T00:31:33.303872485Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x2591190241e0>{
                errs: [
                    <*fmt.wrapError | 0x2591189e64c0>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x259119689b80>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x2591189e6980>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                        err: <*fmt.wrapError | 0x2591189e6940>{
                            msg: "not all pods in kube-system namespace are running: no cilium pods found in kube-system namespace",
                            err: <*errors.errorString | 0x259119cf8240>{
                                s: "no cilium pods found in kube-system namespace",
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x2591184c3340>{
                msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n  \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x259119444c40>{
                    msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-8jtnxl7527bt\" to finish creating: GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n  \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x2591193daae0>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "X-Envoy-Upstream-Service-Time": ["9"],
                                "Server": ["istio-envoy"],
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "7fa66e49-4e6a-4bf0-a4a8-a2d540d934f1",
                                ],
                                "Date": [
                                    "Tue, 06 Oct 2026 00:31:41 GMT",
                                ],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x259119444aa0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 50, 101, 100, 97, 49, 101, 45, 53, 98, 54, 49, 45, 52, 51, 49, 101, 45, 57, 56, 48, 55, 45, 101, 99, 48, 49, 55, 102, 102, 51, 49, 57, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 49, 50, 58, 50, 55, 46, 57, 57, 49, 57, 51, 48, 50, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 51, 49, 58, 51, 51, 46, 51, 48, 51, 56, 55, 50, 52, 56, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 97, 32, 78, 111, 100, 101, 32, 119, 105, 116, 104, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 32, 97, 122, 117, 114, 101, 58, 47, 47, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 118, 105, 114, 116, 117, 97, 108, 77, 97, 99, 104, 105, 110, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 107, 110, 53, 120, 115, 32, 116, 111, 32, 101, 120, 105, 115, 116, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 58, 32, 70, 97, 105, 108, 101, 100, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 99, 114, 101, 97, 116, 101, 32, 111, 114, 32, 117, 112, 100, 97, 116, 101, 46, 32, 101, 114, 114, 58, 32, 102, 97, 105, 108, 101, 100, 32, 116, 111, 32, 103, 101, 116, 32, 101, 120, 105, 115, 116, 105, 110, 103, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 32, 40, 115, 101, 114, 118, 105, 99, 101, 58, 32, 105, 110, 116, 101, 114, 102, 97, 99, 101, 115, 41, 58, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 114, 101, 115, 111, 117, 114, 99, 101, 71, 114, 111, 117, 112, 115, 47, 99, 111, 109, 112, 108, 101, 120, 45, 99, 105, 108, 105, 117, 109, 45, 107, 118, 45, 56, 106, 116, 110, 120, 108, 55, 53, 50, 55, 98, 116, 45, 45, 109, 97, 110, 97, 103, 101, 100, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 78, 101, 116, 119, 111, 114, 107, 47, 110, 101, 116, 119, 111, 114, 107, 73, 110, 116, 101, 114, 102, 97, 99, 101, 115, 47, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 53, 118, 55, 98, 100, 45, 102, 100, 56, 112, 120, 45, 110, 105, 99, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 39, 32, 97, 99, 116, 111, 114, 32, 39, 102, 100, 51, 53, 97, 99, 53, 102, 45, 54, 52, 57, 51, 45, 52, 48, 99, 98, 45, 57, 49, 51, 49, 45, 100, 54, 54, 57, 97, 55, 48, 49, 49, 52, 99, 51, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 48, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 46, 46, 46, 32, 109, 101, 115, 115, 97, 103, 101, 32, 116, 114, 117, 110, 99, 97, 116, 101, 100, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: -1,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "Authorization": ["redacted"],
                                    "X-Ms-Correlation-Request-Id": [
                                        "163dc543-7acc-4d2a-a58d-111eee39e74f",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "c4ca5eed-06d7-48dd-8f0a-5e169ff93ad6",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:31:41Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j5947136.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j5947136.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x259118882f10>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57ee760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j5947136.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"name\": \"8a2eda1e-5b61-431e-9807-ec017ff31933\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:12:27.991930257Z\",\n  \"endTime\": \"2026-10-06T00:31:33.303872485Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-fd8px to exist\\nMachine cilium-cluster-cilium-np-5v7bd-kn5xs: InspectionFailed: Waiting for a Node with spec.providerID azure:///subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Compute/virtualMachines/cilium-cluster-cilium-np-5v7bd-kn5xs to exist\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-5v7bd-fd8px: Failed: interfaces failed to create or update. err: failed to get existing resource complex-cilium-kv-8jtnxl7527bt--managed/cilium-cluster-cilium-np-5v7bd-fd8px-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-8jtnxl7527bt--managed/providers/Microsoft.Network/networkInterfaces/cilium-cluster-cilium-np-5v7bd-fd8px-nic\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor 'fd35ac5f-6493-40cb-9131-d669a70114c3' exceeded. Please try again after '10' seconds after additional tokens are a... message truncated\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
Contributing tests (13)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.2010
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.09
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCreate HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API9
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public9
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.228
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.237
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.17
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.215
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to retrieve cluster and nodepool status active versions5
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster and node pools with aggregated advanced features4
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP HyperShift Presubmit should create a cluster and nodepool to completion3
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should upgrade control plane minor version when pods cannot be created from 4.22 minor to 4.23 minor1
Affected runs (30)
ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hype...
full failure pattern:
ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is <count>, want <count>; node pool condition AllNodesHealthy is False: <count> of <count> machines are not healthy Machine <node>: InspectionFailed: Waiting for AzureMachine to report spec.providerID; node pool condition AllMachinesReady is False: <count> of <count> machines are not ready Machine <node>: Creating: virtualmachine creating or updating; provider Microsoft.RedHatOpenShift
Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s)
e2e911.69%9 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 4 day(s)Show trend detailsSep 29: 0 · Sep 30: 1 · Oct 1: 0 · Oct 2: 2 · Oct 3: 0 · Oct 4: 4 · Oct 5: 11none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn"
Unexpected error:
    <*fmt.wrapError | 0x17e9091f29e0>: 
    failed to create NodePool np-9jh9gn: failed waiting for nodepool="np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn" in resourcegroup="rg-candidate-5-0-hhnc656zf7v8" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
      "name": "cc8a7713-2f0f-40da-953a-e1b9b99c5602",
      "status": "Failed",
      "startTime": "2026-10-06T00:23:17.637571157Z",
      "endTime": "2026-10-06T00:42:19.175724188Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-9jh9gn: failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n  \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x17e908176f80>{
            msg: "failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n  \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x17e909ab8a20>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "41e56312-6ea5-4a44-ae2e-628973948b84",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:42:20 GMT",
                        ],
                        "Content-Length": ["1222"],
                        "X-Envoy-Upstream-Service-Time": ["6"],
                        "Server": ["istio-envoy"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x17e908176a60>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 49, 55, 46, 54, 51, 55, 53, 55, 49, 49, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 49, 57, 46, 49, 55, 53, 55, 50, 52, 49, 56, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1222,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j0653312.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "a05be8f2-de1a-4de0-b563-c8435b71e8f7",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "f3e8143c-04a5-4a9a-abf6-e99ae982b4b5",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:20Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j0653312.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x17e908fc72b0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13759147031339684878, 7869995520253709034],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926840305, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565705, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j0653312.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n  \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn"
Unexpected error:
    <*fmt.wrapError | 0x17e9091f29e0>: 
    failed to create NodePool np-9jh9gn: failed waiting for nodepool="np-9jh9gn" for cluster "cluster-candidate-5-0-9jh9gn" in resourcegroup="rg-candidate-5-0-hhnc656zf7v8" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
      "name": "cc8a7713-2f0f-40da-953a-e1b9b99c5602",
      "status": "Failed",
      "startTime": "2026-10-06T00:23:17.637571157Z",
      "endTime": "2026-10-06T00:42:19.175724188Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-9jh9gn: failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n  \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x17e908176f80>{
            msg: "failed waiting for nodepool=\"np-9jh9gn\" for cluster \"cluster-candidate-5-0-9jh9gn\" in resourcegroup=\"rg-candidate-5-0-hhnc656zf7v8\" to finish creating: GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n  \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x17e909ab8a20>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "41e56312-6ea5-4a44-ae2e-628973948b84",
                        ],
                        "Date": [
                            "Tue, 06 Oct 2026 00:42:20 GMT",
                        ],
                        "Content-Length": ["1222"],
                        "X-Envoy-Upstream-Service-Time": ["6"],
                        "Server": ["istio-envoy"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x17e908176a60>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 99, 56, 97, 55, 55, 49, 51, 45, 50, 102, 48, 102, 45, 52, 48, 100, 97, 45, 57, 53, 51, 97, 45, 101, 49, 98, 57, 98, 57, 57, 99, 53, 54, 48, 50, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 51, 58, 49, 55, 46, 54, 51, 55, 53, 55, 49, 49, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 52, 50, 58, 49, 57, 46, 49, 55, 53, 55, 50, 52, 49, 56, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 56, 109, 104, 52, 106, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 122, 57, 102, 57, 97, 56, 107, 54, 121, 50, 122, 54, 97, 54, 106, 45, 110, 112, 45, 57, 106, 104, 57, 103, 110, 45, 98, 108, 52, 100, 115, 45, 102, 54, 55, 118, 56, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1222,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j0653312.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "a05be8f2-de1a-4de0-b563-c8435b71e8f7",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "f3e8143c-04a5-4a9a-abf6-e99ae982b4b5",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T00:42:20Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j0653312.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j0653312.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 109, 55, 215, 58, 136, 163, 74, 234, 190, 242, 79, 83, 111, 95, 84, 14, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 56, 50, 53, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 56, 50, 53, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 178, 88, 116, 111, 131, 158, 100, 51, 226, 241, 129, 182, 4, 58, 255, 16, 79, 49, 199, 69, 166, 175, 136, 61, 102, 99, 209, 209, 73, 173, 175, 197, 58, 115, 72, 136, 30, 164, 46, 232, 112, 29, 183, 100, 176, 93, 159, 171, 165, 114, 249, 171, 25, 24, 220, 44, 72, 78, 11, 50, 55, 19, 209, 146, 50, 50, 60, 107, 180, 166, 15, 242, 95, 7, 195, 165, 171, 77, 115, 0, 197, 194, 156, 91, 250, 37, 14, 95, 135, 115, 61, 202, 240, 61, 255, 154, 140, 62, 59, 254, 65, 151, 117, 109, 210, 206, 54, 57, 254, 39, 123, 101, 212, 208, 20, 192, 160, 33, 229, 240, 176, 208, 236, 54, 114, 24, 134, 201, 84, 43, 153, 75, 109, 231, 120, 44, 129, 185, 104, 70, 216, 89, 37, 146, 249, 58, 184, 59, 44, 158, 113, 150, 255, 17, 201, 201, 217, 167, 176, 42, 35, 132, 56, 185, 63, 62, 145, 95, 24, 220, 60, 53, 2, 12, 192, 195, 112, 171, 1, 91, 236, 114, 97, 151, 204, 101, 138, 46, 224, 128, 102, 239, 203, 47, 93, 107, 243, 183, 244, 22, 145, 204, 237, 121, 21, 229, 220, 87, 200, 164, 239, 84, 111, 182, 41, 131, 214, 247, 60, 47, 11, 69, 205, 153, 16, 37, 51, 39, 49, 7, 15, 172, 208, 233, 13, 222, 236, 126, 72, 10, 208, 96, 106, 70, 128, 143, 225, 0, 66, 31, 74, 236, 203, 246, 161, 45, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 48, 54, 53, 51, 51, 49, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [132, 92, 4, 252, 74, 203, 93, 221, 155, 108, 18, 237, 252, 22, 65, 239, 209, 138, 217, 69, 125, 208, 227, 237, 106, 112, 70, 63, 23, 1, 182, 123, 74, 94, 66, 126, 77, 197, 249, 46, 189, 244, 51, 145, 0, 158, 158, 147, 88, 116, 18, 129, 97, 164, 141, 219, 171, 116, 61, 31, 193, 253, 211, 134, 238, 184, 48, 86, 145, 62, 8, 51, 165, 128, 198, 244, 107, 5, 104, 110, 195, 123, 19, 176, 125, 35, 102, 252, 110, 130, 83, 152, 218, 65, 150, 29, 196, 67, 80, 235, 235, 43, 230, 86, 138, 52, 61, 117, 68, 7, 164, 225, 142, 79, 49, 144, 182, 24, 17, 163, 92, 84, 177, 79, 48, 120, 197, 79, 163, 14, 215, 152, 32, 105, 247, 200, 230, 45, 171, 240, 103, 146, 219, 106, 197, 87, 255, 173, 17, 37, 175, 49, 59, 227, 179, 60, 159, 34, 254, 67, 126, 130, 148, 89, 115, 172, 217, 105, 130, 180, 60, 4, 54, 247, 139, 193, 73, 34, 199, 116, 144, 194, 246, 175, 180, 54, 143, 58, 177, 142, 208, 152, 67, 217, 197, 106, 186, 183, 104, 154, 73, 188, 55, 156, 60, 173, 123, 32, 126, 172, 60, 31, 60, 168, 129, 132, 188, 145, 224, 166, 187, 195, 178, 164, 24, 120, 225, 71, 24, 9, 147, 49, 24, 198, 104, 47, 175, 60, 157, 175, 71, 54, 173, 99, 174, 173, 112, 18, 32, 173, 216, 15, 164, 149, 110, 110],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x17e908fc72b0>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13759147031339684878, 7869995520253709034],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j0653312.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926840305, loc: nil},
                                NotAfter: {wall: 0, ext: 63942565705, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                AuthorityKeyId: [146, 77, 20, 123, 131, 71, 6, 202, 247, 4, 235, 9, 210, 206, 227, 84, 152, 17, 144, 143],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j0653312.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j0653312.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"name\": \"cc8a7713-2f0f-40da-953a-e1b9b99c5602\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:23:17.637571157Z\",\n  \"endTime\": \"2026-10-06T00:42:19.175724188Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-8mh4j: Creating: virtualmachine creating or updating\\nMachine z9f9a8k6y2z6a6j-np-9jh9gn-bl4ds-f67v8: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4"
Unexpected error:
    <*fmt.wrapError | 0x3b72184d8a40>: 
    failed to create NodePool np-t5hfj4: failed waiting for nodepool="np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4" in resourcegroup="rg-candidate-5-0-2v55vjrk7dfm" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
      "name": "eff3fb29-4e2b-4687-a19e-15a4aa893133",
      "status": "Failed",
      "startTime": "2026-10-05T21:05:57.84981301Z",
      "endTime": "2026-10-05T21:25:06.303015406Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-t5hfj4: failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n  \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x3b7218500920>{
            msg: "failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n  \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x3b7219402930>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["10"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "22ce707c-b71f-46ef-bf90-dcf6f867c005",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 21:25:11 GMT",
                        ],
                        "Content-Length": ["1221"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x3b7218500780>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 48, 53, 58, 53, 55, 46, 56, 52, 57, 56, 49, 51, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 50, 53, 58, 48, 54, 46, 51, 48, 51, 48, 49, 53, 52, 48, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1221,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5671936.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "0d7d56a0-1031-45a3-8395-fdaed234a6d6",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "83ed7df8-bc83-4538-8779-dd64bcdd8b8f",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:25:11Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5671936.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x3b7217dc8a30>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12022333654747854199, 2189047073065291717],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926827859, loc: nil},
                                NotAfter: {wall: 0, ext: 63942553259, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
                                AuthorityKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5671936.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n  \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:176]: failed to create node pool "np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4"
Unexpected error:
    <*fmt.wrapError | 0x3b72184d8a40>: 
    failed to create NodePool np-t5hfj4: failed waiting for nodepool="np-t5hfj4" for cluster "cluster-candidate-5-0-t5hfj4" in resourcegroup="rg-candidate-5-0-2v55vjrk7dfm" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
      "name": "eff3fb29-4e2b-4687-a19e-15a4aa893133",
      "status": "Failed",
      "startTime": "2026-10-05T21:05:57.84981301Z",
      "endTime": "2026-10-05T21:25:06.303015406Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool np-t5hfj4: failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n  \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x3b7218500920>{
            msg: "failed waiting for nodepool=\"np-t5hfj4\" for cluster \"cluster-candidate-5-0-t5hfj4\" in resourcegroup=\"rg-candidate-5-0-2v55vjrk7dfm\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n  \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x3b7219402930>{
                ErrorCode: "DeadlineExceeded",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Envoy-Upstream-Service-Time": ["10"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "22ce707c-b71f-46ef-bf90-dcf6f867c005",
                        ],
                        "Date": [
                            "Mon, 05 Oct 2026 21:25:11 GMT",
                        ],
                        "Content-Length": ["1221"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x3b7218500780>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 101, 102, 102, 51, 102, 98, 50, 57, 45, 52, 101, 50, 98, 45, 52, 54, 56, 55, 45, 97, 49, 57, 101, 45, 49, 53, 97, 52, 97, 97, 56, 57, 51, 49, 51, 51, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 48, 53, 58, 53, 55, 46, 56, 52, 57, 56, 49, 51, 48, 49, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 50, 53, 58, 48, 54, 46, 51, 48, 51, 48, 49, 53, 52, 48, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 102, 113, 54, 109, 115, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 101, 50, 104, 55, 112, 49, 111, 50, 104, 49, 102, 50, 99, 57, 117, 45, 110, 112, 45, 116, 53, 104, 102, 106, 52, 45, 103, 54, 112, 57, 120, 45, 106, 112, 55, 55, 116, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1221,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j5671936.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "0d7d56a0-1031-45a3-8395-fdaed234a6d6",
                            ],
                            "X-Ms-Client-Request-Id": [
                                "83ed7df8-bc83-4538-8779-dd64bcdd8b8f",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:25:11Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j5671936.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 30, 97, 14, 183, 2, 170, 79, 197, 166, 215, 232, 195, 14, 120, 53, 119, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 48, 49, 48, 53, 57, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 48, 50, 48, 53, 57, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 208, 52, 107, 158, 24, 162, 58, 246, 247, 100, 25, 165, 188, 120, 178, 50, 150, 18, 88, 139, 80, 219, 129, 210, 92, 75, 45, 56, 129, 125, 76, 84, 3, 45, 170, 254, 81, 64, 145, 144, 202, 33, 210, 227, 2, 65, 90, 13, 223, 240, 176, 25, 24, 166, 60, 25, 115, 237, 148, 154, 224, 93, 59, 211, 248, 19, 159, 37, 43, 63, 177, 79, 92, 8, 59, 222, 119, 65, 50, 185, 115, 219, 224, 95, 122, 158, 50, 126, 203, 36, 202, 47, 90, 97, 29, 64, 153, 4, 176, 70, 67, 36, 50, 33, 117, 66, 173, 152, 10, 148, 148, 23, 231, 51, 114, 246, 227, 227, 17, 201, 178, 59, 202, 113, 71, 118, 104, 85, 204, 211, 130, 101, 39, 68, 123, 253, 4, 156, 221, 31, 183, 107, 125, 86, 161, 36, 53, 233, 248, 159, 48, 180, 32, 66, 83, 96, 75, 226, 215, 70, 182, 205, 57, 246, 40, 101, 62, 96, 48, 0, 252, 188, 162, 162, 173, 236, 33, 201, 115, 202, 91, 82, 61, 7, 85, 245, 129, 8, 182, 202, 141, 80, 38, 240, 219, 49, 151, 171, 88, 248, 128, 233, 116, 10, 134, 82, 97, 128, 188, 32, 27, 219, 82, 174, 4, 222, 189, 223, 8, 232, 104, 10, 59, 238, 102, 116, 0, 91, 117, 141, 17, 191, 44, 252, 50, 112, 68, 51, 17, 82, 229, 98, 1, 175, 62, 143, 219, 161, 109, 243, 220, 13, 164, 9, 60, 153, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 53, 54, 55, 49, 57, 51, 54, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [34, 138, 183, 177, 196, 6, 163, 227, 242, 231, 107, 169, 23, 218, 3, 15, 224, 125, 135, 143, 185, 192, 61, 116, 213, 140, 10, 238, 101, 114, 113, 236, 115, 4, 123, 184, 73, 176, 151, 225, 249, 49, 173, 130, 231, 175, 113, 13, 52, 46, 85, 113, 42, 8, 142, 171, 12, 147, 245, 144, 198, 240, 213, 213, 249, 55, 7, 71, 59, 55, 48, 160, 17, 203, 192, 207, 0, 231, 180, 60, 46, 124, 221, 174, 56, 215, 240, 169, 169, 8, 60, 23, 81, 201, 46, 67, 119, 87, 144, 34, 70, 37, 173, 148, 206, 229, 63, 150, 194, 134, 166, 125, 37, 133, 47, 51, 46, 224, 109, 71, 17, 100, 21, 45, 18, 32, 214, 243, 203, 226, 52, 107, 252, 20, 215, 215, 18, 46, 173, 109, 174, 154, 107, 53, 58, 127, 185, 76, 216, 223, 83, 128, 159, 0, 31, 4, 65, 43, 173, 28, 223, 138, 127, 12, 73, 18, 190, 199, 41, 235, 45, 76, 147, 240, 179, 40, 200, 51, 84, 244, 74, 24, 114, 116, 9, 195, 78, 205, 87, 254, 134, 160, 225, 31, 111, 71, 33, 206, 197, 238, 83, 110, 67, 254, 223, 160, 86, 152, 246, 115, 114, 94, 76, 5, 144, 13, 195, 182, 68, 218, 225, 17, 222, 177, 216, 18, 237, 105, 214, 181, 204, 67, 244, 23, 201, 246, 156, 29, 15, 13, 254, 137, 172, 157, 162, 188, 169, 39, 194, 230, 172, 160, 50, 80, 242, 139],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x3b7217dc8a30>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [12022333654747854199, 2189047073065291717],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j5671936.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926827859, loc: nil},
                                NotAfter: {wall: 0, ext: 63942553259, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
                                AuthorityKeyId: [199, 105, 184, 11, 241, 26, 111, 195, 136, 96, 83, 39, 26, 170, 154, 155, 149, 126, 50, 149],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j5671936.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"name\": \"eff3fb29-4e2b-4687-a19e-15a4aa893133\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:05:57.84981301Z\",\n  \"endTime\": \"2026-10-05T21:25:06.303015406Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-fq6ms: Creating: virtualmachine creating or updating\\nMachine e2h7p1o2h1f2c9u-np-t5hfj4-g6p9x-jp77t: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0x2243588ac018>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-dklbwx4k8h7p" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
      "name": "4313eb46-0b05-4007-840d-8e81ff915eea",
      "status": "Failed",
      "startTime": "2026-10-05T20:52:58.706374258Z",
      "endTime": "2026-10-05T21:12:06.475127472Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x2243588ac000>{
                errs: [
                    <*fmt.wrapError | 0x224357647460>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x2243570fbc10>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x2243570ec8a0>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x2243570ec820>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x2243570ec740>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x2243570ec6e0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x2243586cd060>{
                msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n  \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x224357360000>{
                    msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n  \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x22435832c930>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "37082432-c7c9-4882-98ce-0027d6dea282",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 21:12:12 GMT",
                                ],
                                "Content-Length": ["1218"],
                                "X-Envoy-Upstream-Service-Time": ["7"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x224356319ba0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 48, 58, 53, 50, 58, 53, 56, 46, 55, 48, 54, 51, 55, 52, 50, 53, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 49, 50, 58, 48, 54, 46, 52, 55, 53, 49, 50, 55, 52, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1218,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j5671936.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "c58f606d-d104-427c-a178-b7cb4021a6e9",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "66043e95-d8d0-4c18-ad76-32d33b54c78e",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:12:12Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j5671936.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x224356b65dd0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n  \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:193]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0x2243588ac018>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-dklbwx4k8h7p" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
      "name": "4313eb46-0b05-4007-840d-8e81ff915eea",
      "status": "Failed",
      "startTime": "2026-10-05T20:52:58.706374258Z",
      "endTime": "2026-10-05T21:12:06.475127472Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x2243588ac000>{
                errs: [
                    <*fmt.wrapError | 0x224357647460>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x2243570fbc10>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x2243570ec8a0>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x2243570ec820>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x2243570ec740>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x2243570ec6e0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x2243586cd060>{
                msg: "failed to create NodePool cilium-np: failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n  \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x224357360000>{
                    msg: "failed waiting for nodepool=\"cilium-np\" for cluster \"cilium-cluster\" in resourcegroup=\"complex-cilium-kv-dklbwx4k8h7p\" to finish creating: GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n  \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x22435832c930>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "37082432-c7c9-4882-98ce-0027d6dea282",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 21:12:12 GMT",
                                ],
                                "Content-Length": ["1218"],
                                "X-Envoy-Upstream-Service-Time": ["7"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x224356319ba0>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 52, 51, 49, 51, 101, 98, 52, 54, 45, 48, 98, 48, 53, 45, 52, 48, 48, 55, 45, 56, 52, 48, 100, 45, 56, 101, 56, 49, 102, 102, 57, 49, 53, 101, 101, 97, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 48, 58, 53, 50, 58, 53, 56, 46, 55, 48, 54, 51, 55, 52, 50, 53, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 50, 49, 58, 49, 50, 58, 48, 54, 46, 52, 55, 53, 49, 50, 55, 52, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 50, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 115, 120, 122, 98, 119, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 99, 105, 108, 105, 117, 109, 45, 99, 108, 117, 115, 116, 101, 114, 45, 99, 105, 108, 105, 117, 109, 45, 110, 112, 45, 98, 57, 50, 106, 114, 45, 116, 116, 109, 103, 113, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1218,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j5671936.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "c58f606d-d104-427c-a178-b7cb4021a6e9",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "66043e95-d8d0-4c18-ad76-32d33b54c78e",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T21:12:12Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "Authorization": ["redacted"],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j5671936.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j5671936.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x224356b65dd0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j5671936.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"name\": \"4313eb46-0b05-4007-840d-8e81ff915eea\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:52:58.706374258Z\",\n  \"endTime\": \"2026-10-05T21:12:06.475127472Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine cilium-cluster-cilium-np-b92jr-sxzbw: Creating: virtualmachine creating or updating\\nMachine cilium-cluster-cilium-np-b92jr-ttmgq: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
Contributing tests (7)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.232
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.02
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCreate HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API2
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public2
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.211
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.11
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully1
Affected runs (9)
Date (UTC)Associated PRProw job
PR #73552107245759840653312
PR #72782107193887125671936
PR #73632107183062990196736
PR #73522107168871638110208
PR #73552107168836758278144
PR #73252107155963554304000
PR #70882107144096983289856
PR #73592107117812953649152
PR #73512107066931902156800
alert [svc] LeaderElectionLeaseStale fired
full failure pattern:
alert [svc] LeaderElectionLeaseStale fired
Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)
alert56.49%5 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 5none
Full failure examples (3)
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-06T01:01:28Z
  Severity:    Sev3
  Labels:      alertname="LeaderElectionLeaseStale", cluster="ci01-j6038912-mgmt-2", component="leader-election", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.230:8080", job="kube-state-metrics", lease="work-manager", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j6038912/providers/microsoft.monitor/accounts/services-j6038912", namespace="klusterlet-2t8uhfivnm450b2fl6uiq41b82l9m9fc", pod="arohcp-monitor-kube-state-metrics-7988dc648c-ws9wv", prometheus="prometheus/prometheus", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Leader election lease work-manager in namespace klusterlet-2t8uhfivnm450b2fl6uiq41b82l9m9fc on cluster ci01-j6038912-mgmt-2 has not been renewed for more than 37 minutes. The leadership election might be broken or the component stopped running.
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:41:11Z
  Severity:    Sev3
  Labels:      alertname="LeaderElectionLeaseStale", cluster="ci01-j9458816-mgmt-1", component="leader-election", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.203:8080", job="kube-state-metrics", lease="work-manager", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9458816/providers/microsoft.monitor/accounts/services-j9458816", namespace="klusterlet-2t8sos08t7f50ar87gub82859okilcug", pod="arohcp-monitor-kube-state-metrics-7988dc648c-pn8d2", prometheus="prometheus/prometheus", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Leader election lease work-manager in namespace klusterlet-2t8sos08t7f50ar87gub82859okilcug on cluster ci01-j9458816-mgmt-1 has not been renewed for more than 37 minutes. The leadership election might be broken or the component stopped running.
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T18:42:58Z
  Severity:    Sev3
  Labels:      alertname="LeaderElectionLeaseStale", cluster="ci01-j1560448-mgmt-2", component="leader-election", container="kube-state-metrics", endpoint="http", environment="ci01", instance="10.128.64.53:8080", job="kube-state-metrics", lease="work-manager", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j1560448/providers/microsoft.monitor/accounts/services-j1560448", namespace="klusterlet-2t8p380dnntirukhp2rf1g7u6glr2fjq", pod="arohcp-monitor-kube-state-metrics-7988dc648c-pfx2c", prometheus="prometheus/prometheus", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: Leader election lease work-manager in namespace klusterlet-2t8p380dnntirukhp2rf1g7u6glr2fjq on cluster ci01-j1560448-mgmt-2 has not been renewed for more than 37 minutes. The leadership election might be broken or the component stopped running.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert LeaderElectionLeaseStale does not fire5
Affected runs (5)
Date (UTC)Associated PRProw job
PR #73312107244242656038912
PR #73192107206250759458816
PR #73052107152898931560448
PR #73312107125784404561920
PR #69442107117611937435648
cluster <resource-group>/<cluster> entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
full failure pattern:
cluster <resource-group>/<cluster> entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)
e2e45.19%4 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 4none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.002s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-pmvwvlccl4hc/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
    <armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
    <armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.002s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-pmvwvlccl4hc/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
    <armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
    <armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.001s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-nzfbx8vgn7wz/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
    <armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
    <armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.001s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-nzfbx8vgn7wz/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
    <armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
    <armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.000s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-gnhv4nf2dxjt/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
    <armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
    <armredhatopenshifthcp.ProvisioningState>: Failed
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:227]: Timed out after 2580.000s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:223 with:
cluster delayed-rbac-gnhv4nf2dxjt/delayed-rbac-cluster entered terminal state "Failed" after role assignment deployment; expected "Succeeded"
Expected
    <armredhatopenshifthcp.ProvisioningState>: Failed
not to equal
    <armredhatopenshifthcp.ProvisioningState>: Failed
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation4
Affected runs (4)
Date (UTC)Associated PRProw job
PR #73652107245789225947136
PR #73322107196586068021248
PR #71432107127981024481280
PR #71582107096289194807296
ERROR CODE: DeadlineExceeded; detail message cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation "hypershift.openshi...
full failure pattern:
ERROR CODE: DeadlineExceeded; detail message cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation "hypershift.openshift.io/cluster-size-override" is "e2e_minimal; provider Microsoft.RedHatOpenShift
Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s)
e2e33.90%3 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 6 · Oct 3: 0 · Oct 4: 0 · Oct 5: 18none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-22-lwxlkb" on minor version 4.22
Unexpected error:
    <*fmt.wrapError | 0x2afb5dd946a0>: 
    failed waiting for hcpCluster="cluster-zstream-4-22-lwxlkb" in resourcegroup="rg-zstream-upgrade-4-22-5q7qc8tlh4kp" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
      "name": "3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
      "status": "Failed",
      "startTime": "2026-10-06T00:22:51.891905144Z",
      "endTime": "2026-10-06T01:06:59.493085695Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed waiting for hcpCluster=\"cluster-zstream-4-22-lwxlkb\" in resourcegroup=\"rg-zstream-upgrade-4-22-5q7qc8tlh4kp\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n  \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0x2afb5e2dcc30>{
            ErrorCode: "DeadlineExceeded",
            StatusCode: 200,
            RawResponse: {
                Status: "200 OK",
                StatusCode: 200,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Date": [
                        "Tue, 06 Oct 2026 01:06:59 GMT",
                    ],
                    "Content-Length": ["630"],
                    "X-Envoy-Upstream-Service-Time": ["7"],
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "65d4500a-52e6-47d9-8230-9c41799caff7",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0x2afb5dd94500>{
                    s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 53, 49, 46, 56, 57, 49, 57, 48, 53, 49, 52, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 53, 57, 46, 52, 57, 51, 48, 56, 53, 54, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 630,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "GET",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j1885952.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
                        Fragment: "",
                        RawQuery: "api-version=2024-06-10-preview",
                        RawPath: "",
                        RawFragment: "",
                        ForceQuery: false,
                        OmitHost: false,
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "Authorization": ["redacted"],
                        "User-Agent": [
                            "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                        ],
                        "X-Ms-Correlation-Request-Id": [
                            "188d1353-4bcc-4d38-8ca0-747098bc4fcc",
                        ],
                        "X-Ms-Client-Request-Id": [
                            "1f54466c-09d6-4184-aa66-a979833d7d9c",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
                            "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:59Z\"}",
                        ],
                        "X-Ms-Identity-Url": [
                            "https://dummyhost.identity.azure.net",
                        ],
                    },
                    Body: nil,
                    GetBody: nil,
                    ContentLength: 0,
                    TransferEncoding: nil,
                    Close: false,
                    Host: "rp.j1885952.hcpsvc.osadev.cloud",
                    Form: nil,
                    PostForm: nil,
                    MultipartForm: nil,
                    Trailer: nil,
                    RemoteAddr: "",
                    RequestURI: "",
                    TLS: nil,
                    Cancel: nil,
                    Response: nil,
                    Pattern: "",
                    ctx: <suppressed context>,
                    pat: nil,
                    matches: nil,
                    otherValues: nil,
                },
                TLS: {
                    Version: 772,
                    HandshakeComplete: true,
                    DidResume: false,
                    CipherSuite: 4865,
                    CurveID: 29,
                    NegotiatedProtocol: "h2",
                    NegotiatedProtocolIsMutual: true,
                    ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
                    PeerCertificates: [
                        {
                            Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
                            RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x2afb5d6a77f0>{
                                N: {
                                    neg: false,
                                    abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [12993975585620420545, 1688428045211159510],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926840348, loc: nil},
                            NotAfter: {wall: 0, ext: 63942565748, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "rp.j1885952.hcpsvc.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    VerifiedChains: nil,
                    SignedCertificateTimestamps: nil,
                    OCSPResponse: nil,
                    TLSUnique: nil,
                    ECHAccepted: false,
                    HelloRetryRequest: false,
                    ekm: 0x57bc760,
                    testingOnlyPeerSignatureAlgorithm: 2052,
                },
            },
            errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n  \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-22-lwxlkb" on minor version 4.22
Unexpected error:
    <*fmt.wrapError | 0x2afb5dd946a0>: 
    failed waiting for hcpCluster="cluster-zstream-4-22-lwxlkb" in resourcegroup="rg-zstream-upgrade-4-22-5q7qc8tlh4kp" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
      "name": "3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
      "status": "Failed",
      "startTime": "2026-10-06T00:22:51.891905144Z",
      "endTime": "2026-10-06T01:06:59.493085695Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed waiting for hcpCluster=\"cluster-zstream-4-22-lwxlkb\" in resourcegroup=\"rg-zstream-upgrade-4-22-5q7qc8tlh4kp\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n  \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0x2afb5e2dcc30>{
            ErrorCode: "DeadlineExceeded",
            StatusCode: 200,
            RawResponse: {
                Status: "200 OK",
                StatusCode: 200,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Date": [
                        "Tue, 06 Oct 2026 01:06:59 GMT",
                    ],
                    "Content-Length": ["630"],
                    "X-Envoy-Upstream-Service-Time": ["7"],
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "65d4500a-52e6-47d9-8230-9c41799caff7",
                    ],
                },
                Body: <*exported.nopClosingBytesReader | 0x2afb5dd94500>{
                    s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 51, 99, 102, 102, 50, 56, 101, 101, 45, 56, 98, 100, 52, 45, 52, 50, 100, 57, 45, 98, 101, 49, 99, 45, 100, 57, 98, 56, 99, 48, 51, 50, 57, 53, 101, 99, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 53, 49, 46, 56, 57, 49, 57, 48, 53, 49, 52, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 53, 57, 46, 52, 57, 51, 48, 56, 53, 54, 57, 53, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 630,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "GET",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j1885952.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec",
                        Fragment: "",
                        RawQuery: "api-version=2024-06-10-preview",
                        RawPath: "",
                        RawFragment: "",
                        ForceQuery: false,
                        OmitHost: false,
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "Authorization": ["redacted"],
                        "User-Agent": [
                            "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                        ],
                        "X-Ms-Correlation-Request-Id": [
                            "188d1353-4bcc-4d38-8ca0-747098bc4fcc",
                        ],
                        "X-Ms-Client-Request-Id": [
                            "1f54466c-09d6-4184-aa66-a979833d7d9c",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
                            "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:59Z\"}",
                        ],
                        "X-Ms-Identity-Url": [
                            "https://dummyhost.identity.azure.net",
                        ],
                    },
                    Body: nil,
                    GetBody: nil,
                    ContentLength: 0,
                    TransferEncoding: nil,
                    Close: false,
                    Host: "rp.j1885952.hcpsvc.osadev.cloud",
                    Form: nil,
                    PostForm: nil,
                    MultipartForm: nil,
                    Trailer: nil,
                    RemoteAddr: "",
                    RequestURI: "",
                    TLS: nil,
                    Cancel: nil,
                    Response: nil,
                    Pattern: "",
                    ctx: <suppressed context>,
                    pat: nil,
                    matches: nil,
                    otherValues: nil,
                },
                TLS: {
                    Version: 772,
                    HandshakeComplete: true,
                    DidResume: false,
                    CipherSuite: 4865,
                    CurveID: 29,
                    NegotiatedProtocol: "h2",
                    NegotiatedProtocolIsMutual: true,
                    ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
                    PeerCertificates: [
                        {
                            Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
                            RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x2afb5d6a77f0>{
                                N: {
                                    neg: false,
                                    abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [12993975585620420545, 1688428045211159510],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926840348, loc: nil},
                            NotAfter: {wall: 0, ext: 63942565748, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "rp.j1885952.hcpsvc.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    VerifiedChains: nil,
                    SignedCertificateTimestamps: nil,
                    OCSPResponse: nil,
                    TLSUnique: nil,
                    ECHAccepted: false,
                    HelloRetryRequest: false,
                    ekm: 0x57bc760,
                    testingOnlyPeerSignatureAlgorithm: 2052,
                },
            },
            errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"name\": \"3cff28ee-8bd4-42d9-be1c-d9b8c03295ec\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:51.891905144Z\",\n  \"endTime\": \"2026-10-06T01:06:59.493085695Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-21-tj5kjf" on minor version 4.21
Unexpected error:
    <*fmt.wrapError | 0x26f78b8967c0>: 
    failed waiting for hcpCluster="cluster-zstream-4-21-tj5kjf" in resourcegroup="rg-zstream-upgrade-4-21-crzxbjfcxnnm" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
      "name": "7d946330-06af-4b31-849f-9e212d73904e",
      "status": "Failed",
      "startTime": "2026-10-06T00:22:04.312589503Z",
      "endTime": "2026-10-06T01:06:09.501085874Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed waiting for hcpCluster=\"cluster-zstream-4-21-tj5kjf\" in resourcegroup=\"rg-zstream-upgrade-4-21-crzxbjfcxnnm\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n  \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n  \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0x26f78c3a4ff0>{
            ErrorCode: "DeadlineExceeded",
            StatusCode: 200,
            RawResponse: {
                Status: "200 OK",
                StatusCode: 200,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "84a68013-7692-40c1-a42f-7a39ffeaa3d1",
                    ],
                    "Date": [
                        "Tue, 06 Oct 2026 01:06:13 GMT",
                    ],
                    "Content-Length": ["630"],
                    "X-Envoy-Upstream-Service-Time": ["9"],
                },
                Body: <*exported.nopClosingBytesReader | 0x26f78b896680>{
                    s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 48, 52, 46, 51, 49, 50, 53, 56, 57, 53, 48, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 48, 57, 46, 53, 48, 49, 48, 56, 53, 56, 55, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 630,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "GET",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j1885952.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
                        Fragment: "",
                        RawQuery: "api-version=2024-06-10-preview",
                        RawPath: "",
                        RawFragment: "",
                        ForceQuery: false,
                        OmitHost: false,
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "X-Ms-Correlation-Request-Id": [
                            "b9a056a1-262e-4e2f-8046-2cd90ed8ac37",
                        ],
                        "Authorization": ["redacted"],
                        "X-Ms-Client-Request-Id": [
                            "0a0550d1-a804-40d5-8840-57f554281cdf",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
                            "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:13Z\"}",
                        ],
                        "X-Ms-Identity-Url": [
                            "https://dummyhost.identity.azure.net",
                        ],
                        "User-Agent": [
                            "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                        ],
                    },
                    Body: nil,
                    GetBody: nil,
                    ContentLength: 0,
                    TransferEncoding: nil,
                    Close: false,
                    Host: "rp.j1885952.hcpsvc.osadev.cloud",
                    Form: nil,
                    PostForm: nil,
                    MultipartForm: nil,
                    Trailer: nil,
                    RemoteAddr: "",
                    RequestURI: "",
                    TLS: nil,
                    Cancel: nil,
                    Response: nil,
                    Pattern: "",
                    ctx: <suppressed context>,
                    pat: nil,
                    matches: nil,
                    otherValues: nil,
                },
                TLS: {
                    Version: 772,
                    HandshakeComplete: true,
                    DidResume: false,
                    CipherSuite: 4865,
                    CurveID: 29,
                    NegotiatedProtocol: "h2",
                    NegotiatedProtocolIsMutual: true,
                    ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
                    PeerCertificates: [
                        {
                            Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
                            RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x26f78c3e7600>{
                                N: {
                                    neg: false,
                                    abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [12993975585620420545, 1688428045211159510],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926840348, loc: nil},
                            NotAfter: {wall: 0, ext: 63942565748, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "rp.j1885952.hcpsvc.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    VerifiedChains: nil,
                    SignedCertificateTimestamps: nil,
                    OCSPResponse: nil,
                    TLSUnique: nil,
                    ECHAccepted: false,
                    HelloRetryRequest: false,
                    ekm: 0x57bc760,
                    testingOnlyPeerSignatureAlgorithm: 2052,
                },
            },
            errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n  \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n  \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-21-tj5kjf" on minor version 4.21
Unexpected error:
    <*fmt.wrapError | 0x26f78b8967c0>: 
    failed waiting for hcpCluster="cluster-zstream-4-21-tj5kjf" in resourcegroup="rg-zstream-upgrade-4-21-crzxbjfcxnnm" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
      "name": "7d946330-06af-4b31-849f-9e212d73904e",
      "status": "Failed",
      "startTime": "2026-10-06T00:22:04.312589503Z",
      "endTime": "2026-10-06T01:06:09.501085874Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed waiting for hcpCluster=\"cluster-zstream-4-21-tj5kjf\" in resourcegroup=\"rg-zstream-upgrade-4-21-crzxbjfcxnnm\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n  \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n  \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0x26f78c3a4ff0>{
            ErrorCode: "DeadlineExceeded",
            StatusCode: 200,
            RawResponse: {
                Status: "200 OK",
                StatusCode: 200,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "84a68013-7692-40c1-a42f-7a39ffeaa3d1",
                    ],
                    "Date": [
                        "Tue, 06 Oct 2026 01:06:13 GMT",
                    ],
                    "Content-Length": ["630"],
                    "X-Envoy-Upstream-Service-Time": ["9"],
                },
                Body: <*exported.nopClosingBytesReader | 0x26f78b896680>{
                    s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 55, 100, 57, 52, 54, 51, 51, 48, 45, 48, 54, 97, 102, 45, 52, 98, 51, 49, 45, 56, 52, 57, 102, 45, 57, 101, 50, 49, 50, 100, 55, 51, 57, 48, 52, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 50, 58, 48, 52, 46, 51, 49, 50, 53, 56, 57, 53, 48, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 54, 58, 48, 57, 46, 53, 48, 49, 48, 56, 53, 56, 55, 52, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 630,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "GET",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j1885952.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e",
                        Fragment: "",
                        RawQuery: "api-version=2024-06-10-preview",
                        RawPath: "",
                        RawFragment: "",
                        ForceQuery: false,
                        OmitHost: false,
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "X-Ms-Correlation-Request-Id": [
                            "b9a056a1-262e-4e2f-8046-2cd90ed8ac37",
                        ],
                        "Authorization": ["redacted"],
                        "X-Ms-Client-Request-Id": [
                            "0a0550d1-a804-40d5-8840-57f554281cdf",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
                            "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:06:13Z\"}",
                        ],
                        "X-Ms-Identity-Url": [
                            "https://dummyhost.identity.azure.net",
                        ],
                        "User-Agent": [
                            "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                        ],
                    },
                    Body: nil,
                    GetBody: nil,
                    ContentLength: 0,
                    TransferEncoding: nil,
                    Close: false,
                    Host: "rp.j1885952.hcpsvc.osadev.cloud",
                    Form: nil,
                    PostForm: nil,
                    MultipartForm: nil,
                    Trailer: nil,
                    RemoteAddr: "",
                    RequestURI: "",
                    TLS: nil,
                    Cancel: nil,
                    Response: nil,
                    Pattern: "",
                    ctx: <suppressed context>,
                    pat: nil,
                    matches: nil,
                    otherValues: nil,
                },
                TLS: {
                    Version: 772,
                    HandshakeComplete: true,
                    DidResume: false,
                    CipherSuite: 4865,
                    CurveID: 29,
                    NegotiatedProtocol: "h2",
                    NegotiatedProtocolIsMutual: true,
                    ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
                    PeerCertificates: [
                        {
                            Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
                            RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x26f78c3e7600>{
                                N: {
                                    neg: false,
                                    abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [12993975585620420545, 1688428045211159510],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926840348, loc: nil},
                            NotAfter: {wall: 0, ext: 63942565748, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "rp.j1885952.hcpsvc.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    VerifiedChains: nil,
                    SignedCertificateTimestamps: nil,
                    OCSPResponse: nil,
                    TLSUnique: nil,
                    ECHAccepted: false,
                    HelloRetryRequest: false,
                    ekm: 0x57bc760,
                    testingOnlyPeerSignatureAlgorithm: 2052,
                },
            },
            errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/7d946330-06af-4b31-849f-9e212d73904e\",\n  \"name\": \"7d946330-06af-4b31-849f-9e212d73904e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:22:04.312589503Z\",\n  \"endTime\": \"2026-10-06T01:06:09.501085874Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-23-f5gz8r" on minor version 4.23
Unexpected error:
    <*fmt.wrapError | 0x169cfe02ad60>: 
    failed waiting for hcpCluster="cluster-zstream-4-23-f5gz8r" in resourcegroup="rg-zstream-upgrade-4-23-7hzrtxfzqp8x" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
      "name": "8a671219-b4b6-46d1-b97e-d8354f2e11d9",
      "status": "Failed",
      "startTime": "2026-10-06T00:25:50.933465836Z",
      "endTime": "2026-10-06T01:09:59.469391187Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed waiting for hcpCluster=\"cluster-zstream-4-23-f5gz8r\" in resourcegroup=\"rg-zstream-upgrade-4-23-7hzrtxfzqp8x\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n  \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0x169cff39e300>{
            ErrorCode: "DeadlineExceeded",
            StatusCode: 200,
            RawResponse: {
                Status: "200 OK",
                StatusCode: 200,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "b9c17f48-b284-45df-8122-30f6af52e540",
                    ],
                    "Date": [
                        "Tue, 06 Oct 2026 01:09:59 GMT",
                    ],
                    "Content-Length": ["630"],
                    "X-Envoy-Upstream-Service-Time": ["8"],
                    "Server": ["istio-envoy"],
                },
                Body: <*exported.nopClosingBytesReader | 0x169cfe02a040>{
                    s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 53, 58, 53, 48, 46, 57, 51, 51, 52, 54, 53, 56, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 57, 58, 53, 57, 46, 52, 54, 57, 51, 57, 49, 49, 56, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 630,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "GET",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j1885952.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
                        Fragment: "",
                        RawQuery: "api-version=2024-06-10-preview",
                        RawPath: "",
                        RawFragment: "",
                        ForceQuery: false,
                        OmitHost: false,
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "X-Ms-Identity-Url": [
                            "https://dummyhost.identity.azure.net",
                        ],
                        "User-Agent": [
                            "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                        ],
                        "X-Ms-Correlation-Request-Id": [
                            "06805ff0-2822-403a-a554-832ea22c86a3",
                        ],
                        "X-Ms-Client-Request-Id": [
                            "a742456a-0bbb-4dca-882a-af3f39e2ddd6",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
                            "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:09:59Z\"}",
                        ],
                        "Authorization": ["redacted"],
                    },
                    Body: nil,
                    GetBody: nil,
                    ContentLength: 0,
                    TransferEncoding: nil,
                    Close: false,
                    Host: "rp.j1885952.hcpsvc.osadev.cloud",
                    Form: nil,
                    PostForm: nil,
                    MultipartForm: nil,
                    Trailer: nil,
                    RemoteAddr: "",
                    RequestURI: "",
                    TLS: nil,
                    Cancel: nil,
                    Response: nil,
                    Pattern: "",
                    ctx: <suppressed context>,
                    pat: nil,
                    matches: nil,
                    otherValues: nil,
                },
                TLS: {
                    Version: 772,
                    HandshakeComplete: true,
                    DidResume: false,
                    CipherSuite: 4865,
                    CurveID: 29,
                    NegotiatedProtocol: "h2",
                    NegotiatedProtocolIsMutual: true,
                    ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
                    PeerCertificates: [
                        {
                            Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
                            RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x169cff186df0>{
                                N: {
                                    neg: false,
                                    abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [12993975585620420545, 1688428045211159510],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926840348, loc: nil},
                            NotAfter: {wall: 0, ext: 63942565748, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "rp.j1885952.hcpsvc.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    VerifiedChains: nil,
                    SignedCertificateTimestamps: nil,
                    OCSPResponse: nil,
                    TLSUnique: nil,
                    ECHAccepted: false,
                    HelloRetryRequest: false,
                    ekm: 0x57bc760,
                    testingOnlyPeerSignatureAlgorithm: 2052,
                },
            },
            errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n  \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:157]: failed to enable immediate z-stream updates for cluster "cluster-zstream-4-23-f5gz8r" on minor version 4.23
Unexpected error:
    <*fmt.wrapError | 0x169cfe02ad60>: 
    failed waiting for hcpCluster="cluster-zstream-4-23-f5gz8r" in resourcegroup="rg-zstream-upgrade-4-23-7hzrtxfzqp8x" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
      "name": "8a671219-b4b6-46d1-b97e-d8354f2e11d9",
      "status": "Failed",
      "startTime": "2026-10-06T00:25:50.933465836Z",
      "endTime": "2026-10-06T01:09:59.469391187Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \"hypershift.openshift.io/cluster-size-override\" is \"e2e_minimal\", want unset"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed waiting for hcpCluster=\"cluster-zstream-4-23-f5gz8r\" in resourcegroup=\"rg-zstream-upgrade-4-23-7hzrtxfzqp8x\" to finish updating: GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n  \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0x169cff39e300>{
            ErrorCode: "DeadlineExceeded",
            StatusCode: 200,
            RawResponse: {
                Status: "200 OK",
                StatusCode: 200,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "Content-Type": ["application/json"],
                    "X-Ms-Request-Id": [
                        "b9c17f48-b284-45df-8122-30f6af52e540",
                    ],
                    "Date": [
                        "Tue, 06 Oct 2026 01:09:59 GMT",
                    ],
                    "Content-Length": ["630"],
                    "X-Envoy-Upstream-Service-Time": ["8"],
                    "Server": ["istio-envoy"],
                },
                Body: <*exported.nopClosingBytesReader | 0x169cfe02a040>{
                    s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 54, 50, 55, 97, 97, 55, 48, 45, 51, 54, 97, 51, 45, 52, 48, 98, 48, 45, 56, 101, 54, 56, 45, 57, 55, 53, 50, 54, 57, 101, 51, 57, 100, 55, 98, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 119, 101, 115, 116, 117, 115, 51, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 56, 97, 54, 55, 49, 50, 49, 57, 45, 98, 52, 98, 54, 45, 52, 54, 100, 49, 45, 98, 57, 55, 101, 45, 100, 56, 51, 53, 52, 102, 50, 101, 49, 49, 100, 57, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 48, 58, 50, 53, 58, 53, 48, 46, 57, 51, 51, 52, 54, 53, 56, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 54, 84, 48, 49, 58, 48, 57, 58, 53, 57, 46, 52, 54, 57, 51, 57, 49, 49, 56, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 99, 108, 117, 115, 116, 101, 114, 32, 117, 112, 100, 97, 116, 101, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 72, 111, 115, 116, 101, 100, 67, 108, 117, 115, 116, 101, 114, 32, 97, 110, 110, 111, 116, 97, 116, 105, 111, 110, 32, 92, 34, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 46, 111, 112, 101, 110, 115, 104, 105, 102, 116, 46, 105, 111, 47, 99, 108, 117, 115, 116, 101, 114, 45, 115, 105, 122, 101, 45, 111, 118, 101, 114, 114, 105, 100, 101, 92, 34, 32, 105, 115, 32, 92, 34, 101, 50, 101, 95, 109, 105, 110, 105, 109, 97, 108, 92, 34, 44, 32, 119, 97, 110, 116, 32, 117, 110, 115, 101, 116, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 630,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "GET",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j1885952.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9",
                        Fragment: "",
                        RawQuery: "api-version=2024-06-10-preview",
                        RawPath: "",
                        RawFragment: "",
                        ForceQuery: false,
                        OmitHost: false,
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "X-Ms-Identity-Url": [
                            "https://dummyhost.identity.azure.net",
                        ],
                        "User-Agent": [
                            "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                        ],
                        "X-Ms-Correlation-Request-Id": [
                            "06805ff0-2822-403a-a554-832ea22c86a3",
                        ],
                        "X-Ms-Client-Request-Id": [
                            "a742456a-0bbb-4dca-882a-af3f39e2ddd6",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
                            "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-06T01:09:59Z\"}",
                        ],
                        "Authorization": ["redacted"],
                    },
                    Body: nil,
                    GetBody: nil,
                    ContentLength: 0,
                    TransferEncoding: nil,
                    Close: false,
                    Host: "rp.j1885952.hcpsvc.osadev.cloud",
                    Form: nil,
                    PostForm: nil,
                    MultipartForm: nil,
                    Trailer: nil,
                    RemoteAddr: "",
                    RequestURI: "",
                    TLS: nil,
                    Cancel: nil,
                    Response: nil,
                    Pattern: "",
                    ctx: <suppressed context>,
                    pat: nil,
                    matches: nil,
                    otherValues: nil,
                },
                TLS: {
                    Version: 772,
                    HandshakeComplete: true,
                    DidResume: false,
                    CipherSuite: 4865,
                    CurveID: 29,
                    NegotiatedProtocol: "h2",
                    NegotiatedProtocolIsMutual: true,
                    ServerName: "rp.j1885952.hcpsvc.osadev.cloud",
                    PeerCertificates: [
                        {
                            Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 23, 110, 128, 92, 135, 158, 75, 214, 180, 83, 223, 243, 57, 0, 231, 193, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 50, 51, 51, 57, 48, 56, 90, 23, 13, 50, 55, 48, 52, 48, 53, 50, 51, 52, 57, 48, 56, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 221, 74, 214, 191, 166, 41, 237, 168, 16, 140, 15, 165, 186, 2, 150, 145, 52, 55, 237, 83, 197, 156, 222, 242, 139, 146, 245, 190, 48, 186, 131, 63, 9, 248, 202, 196, 157, 168, 237, 17, 4, 178, 137, 250, 58, 37, 174, 236, 96, 180, 161, 139, 76, 206, 227, 248, 70, 2, 239, 42, 25, 116, 46, 89, 38, 140, 228, 62, 64, 42, 174, 66, 71, 188, 249, 99, 189, 253, 85, 8, 161, 219, 183, 35, 225, 153, 24, 83, 207, 220, 163, 8, 220, 28, 147, 158, 42, 76, 154, 85, 212, 208, 146, 121, 103, 188, 85, 85, 68, 138, 33, 27, 152, 16, 147, 102, 43, 176, 111, 31, 53, 21, 4, 214, 44, 107, 111, 204, 7, 189, 175, 45, 20, 101, 98, 169, 128, 18, 152, 71, 184, 249, 0, 196, 121, 182, 186, 111, 235, 119, 220, 135, 25, 194, 2, 127, 84, 39, 229, 91, 151, 115, 171, 75, 101, 54, 26, 203, 20, 113, 170, 63, 134, 96, 23, 158, 232, 75, 0, 217, 215, 234, 211, 65, 126, 226, 56, 168, 6, 58, 168, 222, 225, 18, 165, 235, 177, 240, 116, 224, 176, 175, 27, 248, 81, 121, 172, 157, 111, 49, 6, 115, 91, 222, 19, 65, 201, 91, 80, 188, 202, 84, 79, 255, 60, 121, 184, 24, 57, 39, 233, 131, 15, 222, 71, 48, 228, 255, 146, 50, 235, 167, 31, 1, 160, 245, 167, 130, 42, 149, 189, 201, 76, 74, 235, 181, 2, 3, 1, 0, 1],
                            RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                            Signature: [15, 71, 173, 143, 50, 34, 153, 83, 52, 239, 239, 83, 228, 224, 91, 63, 114, 235, 134, 59, 132, 230, 153, 107, 179, 150, 193, 17, 16, 255, 163, 221, 7, 232, 169, 199, 159, 25, 35, 39, 161, 221, 95, 71, 80, 252, 114, 196, 24, 24, 62, 195, 88, 221, 243, 194, 9, 134, 177, 174, 9, 91, 84, 66, 38, 158, 191, 65, 177, 185, 152, 17, 154, 155, 74, 118, 202, 180, 229, 84, 76, 253, 30, 67, 228, 52, 32, 239, 86, 226, 190, 2, 201, 218, 193, 94, 143, 121, 107, 197, 245, 148, 175, 133, 0, 69, 221, 174, 190, 91, 91, 209, 208, 207, 42, 12, 107, 178, 228, 243, 118, 173, 160, 61, 68, 149, 165, 36, 168, 218, 142, 69, 135, 205, 46, 228, 207, 60, 135, 113, 59, 154, 109, 9, 220, 242, 212, 125, 145, 247, 220, 200, 155, 113, 98, 5, 196, 211, 184, 251, 13, 205, 142, 105, 130, 127, 194, 40, 169, 112, 70, 218, 187, 104, 22, 50, 15, 217, 216, 109, 205, 230, 222, 203, 69, 96, 30, 175, 59, 20, 51, 124, 107, 210, 55, 159, 13, 209, 203, 65, 202, 175, 20, 216, 74, 184, 210, 36, 141, 68, 207, 89, 243, 217, 128, 128, 143, 175, 252, 151, 35, 133, 106, 150, 170, 144, 183, 208, 15, 61, 147, 139, 253, 151, 110, 230, 156, 41, 42, 231, 97, 101, 58, 197, 66, 82, 126, 26, 139, 27, 30, 9, 169, 173, 248, 70],
                            SignatureAlgorithm: 4,
                            PublicKeyAlgorithm: 1,
                            PublicKey: <*rsa.PublicKey | 0x169cff186df0>{
                                N: {
                                    neg: false,
                                    abs: [3068567393388915637, 16980575011879626626, 1143429630724641330, 4357716528635308419, 14509279396282781695, 8012192304601109313, 12731425424932449437, 16218207639835800800, 9142932487825696990, 16738473375682974529, 1473145742940968862, 10913254662357785291, 1856048742326068571, 8770402314205256839, 9228606020248993988, 557794537014387369, 3824968776435855308, 10957419960421347103, 7474943306238664987, 3047980741256319609, 14978025719175353246, 11663117024742676563, 5169280679099061512, 2777846026196397634, 5044857496703086169, 6968372143110153208, 338484629816585964, 718547086373088529, 10057371115081859903, 3762736957744799474, 1192345205811091089, 15945793549273525672],
                                },
                                E: 65537,
                            },
                            Version: 3,
                            SerialNumber: {
                                neg: false,
                                abs: [12993975585620420545, 1688428045211159510],
                            },
                            Issuer: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            Subject: {
                                Country: nil,
                                Organization: nil,
                                OrganizationalUnit: nil,
                                Locality: nil,
                                Province: nil,
                                StreetAddress: nil,
                                PostalCode: nil,
                                SerialNumber: "",
                                CommonName: "rp.j1885952.hcpsvc.osadev.cloud",
                                Names: [
                                    {
                                        Type: [..., ..., ..., ...],
                                        Value: <string>"rp.j1885952.hcpsvc.osadev.cloud",
                                    },
                                ],
                                ExtraNames: nil,
                            },
                            NotBefore: {wall: 0, ext: 63926840348, loc: nil},
                            NotAfter: {wall: 0, ext: 63942565748, loc: nil},
                            KeyUsage: 5,
                            Extensions: [
                                {
                                    Id: [2, 5, 29, 15],
                                    Critical: true,
                                    Value: [3, 2, 5, 160],
                                },
                                {Id: [2, 5, 29, 19], Critical: false, Value: [48, 0]},
                                {
                                    Id: [2, 5, 29, 37],
                                    Critical: false,
                                    Value: [48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2],
                                },
                                {
                                    Id: [2, 5, 29, 17],
                                    Critical: false,
                                    Value: [48, 33, 130, 31, 114, 112, 46, 106, 49, 56, 56, 53, 57, 53, 50, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                },
                                {
                                    Id: [2, 5, 29, 35],
                                    Critical: false,
                                    Value: [48, 22, 128, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                                {
                                    Id: [2, 5, 29, 14],
                                    Critical: false,
                                    Value: [4, 20, 232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                                },
                            ],
                            ExtraExtensions: nil,
                            UnhandledCriticalExtensions: nil,
                            ExtKeyUsage: [1, 2],
                            UnknownExtKeyUsage: nil,
                            BasicConstraintsValid: true,
                            IsCA: false,
                            MaxPathLen: -1,
                            MaxPathLenZero: false,
                            SubjectKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            AuthorityKeyId: [232, 18, 149, 208, 24, 186, 189, 102, 49, 128, 20, 210, 238, 145, 65, 229, 27, 53, 146, 115],
                            OCSPServer: nil,
                            IssuingCertificateURL: nil,
                            DNSNames: [
                                "rp.j1885952.hcpsvc.osadev.cloud",
                            ],
                            EmailAddresses: nil,
                            IPAddresses: nil,
                            URIs: nil,
                            PermittedDNSDomainsCritical: false,
                            PermittedDNSDomains: nil,
                            ExcludedDNSDomains: nil,
                            PermittedIPRanges: nil,
                            ExcludedIPRanges: nil,
                            PermittedEmailAddresses: nil,
                            ExcludedEmailAddresses: nil,
                            PermittedURIDomains: nil,
                            ExcludedURIDomains: nil,
                            CRLDistributionPoints: nil,
                            PolicyIdentifiers: nil,
                            Policies: nil,
                            InhibitAnyPolicy: 0,
                            InhibitAnyPolicyZero: false,
                            InhibitPolicyMapping: 0,
                            InhibitPolicyMappingZero: false,
                            RequireExplicitPolicy: 0,
                            RequireExplicitPolicyZero: false,
                            PolicyMappings: nil,
                        },
                    ],
                    VerifiedChains: nil,
                    SignedCertificateTimestamps: nil,
                    OCSPResponse: nil,
                    TLSUnique: nil,
                    ECHAccepted: false,
                    HelloRetryRequest: false,
                    ekm: 0x57bc760,
                    testingOnlyPeerSignatureAlgorithm: 2052,
                },
            },
            errMsg: "GET https://rp.j1885952.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"name\": \"8a671219-b4b6-46d1-b97e-d8354f2e11d9\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-06T00:25:50.933465836Z\",\n  \"endTime\": \"2026-10-06T01:09:59.469391187Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"cluster update did not complete before the deadline; [hypershiftHostedCluster] hypershift HostedCluster annotation \\\"hypershift.openshift.io/cluster-size-override\\\" is \\\"e2e_minimal\\\", want unset\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        },
    }
occurred
Contributing tests (6)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelService Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.203
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelService Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.213
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelService Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.223
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelService Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.233
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelService Provider should upgrade the control plane z-stream automatically on behalf of the customer for 5.03
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelUpdate HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request3
Affected runs (3)
Date (UTC)Associated PRProw job
PR #73132107245793541885952
PR #73132107168826272518144
PR #73132107092599713042432
alert [svc] ArobitForwarderJobUp fired
full failure pattern:
alert [svc] ArobitForwarderJobUp fired
Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)
alert33.90%3 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)Show trend detailsSep 29: 0 · Sep 30: 4 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 3none
Full failure examples (3)
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:34:44Z
  Severity:    Sev3
  Labels:      alertname="ArobitForwarderJobUp", cluster="ci01-j0130560-svc", component="monitoring-infrastructure", region="canadacentral", severity="warning"
  Description: The Arobit forwarder metrics endpoint on cluster ci01-j0130560-svc has been unreachable for 15 minutes.
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:10:15Z
  Severity:    Sev3
  Labels:      alertname="ArobitForwarderJobUp", cluster="ci01-j9785984-svc", component="monitoring-infrastructure", region="westus3", severity="warning"
  Description: The Arobit forwarder metrics endpoint on cluster ci01-j9785984-svc has been unreachable for 15 minutes.
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T19:07:43Z
  Severity:    Sev3
  Labels:      alertname="ArobitForwarderJobUp", cluster="ci01-j8411136-svc", component="monitoring-infrastructure", region="westus3", severity="warning"
  Description: The Arobit forwarder metrics endpoint on cluster ci01-j8411136-svc has been unreachable for 15 minutes.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert ArobitForwarderJobUp does not fire3
Affected runs (3)
Date (UTC)Associated PRProw job
PR #68202107237896200130560
PR #68202107215529679785984
PR #68202107170660328411136
alert [svc] KubeDaemonSetRolloutStuck fired
full failure pattern:
alert [svc] KubeDaemonSetRolloutStuck fired
Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)
alert33.90%3 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)Show trend detailsSep 29: 0 · Sep 30: 5 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 3none
Full failure examples (3)
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:35:03Z
  Severity:    Sev3
  Labels:      alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.53:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0130560/providers/microsoft.monitor/accounts/services-j0130560", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-qz6vc", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T23:35:03Z
  Severity:    Sev3
  Labels:      alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j0130560-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.53:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j0130560/providers/microsoft.monitor/accounts/services-j0130560", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-qz6vc", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="canadacentral", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes.
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:10:28Z
  Severity:    Sev3
  Labels:      alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.66:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9785984/providers/microsoft.monitor/accounts/services-j9785984", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-dk89c", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:10:29Z
  Severity:    Sev3
  Labels:      alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j9785984-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.66:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j9785984/providers/microsoft.monitor/accounts/services-j9785984", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-dk89c", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes.
alert fired 2 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T19:08:23Z
  Severity:    Sev3
  Labels:      alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.44:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8411136/providers/microsoft.monitor/accounts/services-j8411136", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-l989f", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-1", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes.
Firing 2:
  State:       Fired (not resolved)
  Started:     2026-10-05T19:08:23Z
  Severity:    Sev3
  Labels:      alertname="KubeDaemonSetRolloutStuck", cluster="ci01-j8411136-svc", component="kubernetes-infrastructure", container="kube-state-metrics", daemonset="arobit-forwarder", endpoint="http", environment="ci01", instance="10.128.64.44:8080", job="kube-state-metrics", microsoft.amwresourceid="/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-ci01-j8411136/providers/microsoft.monitor/accounts/services-j8411136", namespace="arobit", pod="arohcp-monitor-kube-state-metrics-79b88f5699-l989f", prometheus="prometheus/prometheus", prometheus_replica="prom-agent-prometheus-0", region="westus3", service="arohcp-monitor-kube-state-metrics", severity="warning"
  Description: DaemonSet arobit/arobit-forwarder has not finished or progressed for at least 15 minutes.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert KubeDaemonSetRolloutStuck does not fire3
Affected runs (3)
Date (UTC)Associated PRProw job
PR #68202107237896200130560
PR #68202107215529679785984
PR #68202107170660328411136
clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "<url>
full failure pattern:
clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "<url>
Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)
e2e22.60%2 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)Show trend detailsSep 29: 1 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2none
Full failure examples (2)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.000s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
    <*errors.errorString | 0x5170293c200>: 
    clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused
    {
        s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused",
    }
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.000s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
    <*errors.errorString | 0x5170293c200>: 
    clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused
    {
        s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.10:46939->172.30.0.10:53: read: connection refused",
    }
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.001s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
    <*errors.errorString | 0x559801b44d0>: 
    clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused
    {
        s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused",
    }
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:356]: Timed out after 300.001s.
ClusterIssuer should become Ready (ACME account registered)
Expected success, but got an error:
    <*errors.errorString | 0x559801b44d0>: 
    clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get "https://acme-staging-v02.api.letsencrypt.org/directory": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused
    {
        s: "clusterIssuer not ready: reason=ErrRegisterACMEAccount message=Failed to register ACME account: Get \"https://acme-staging-v02.api.letsencrypt.org/directory\": dial tcp: lookup acme-staging-v02.api.letsencrypt.org on 172.30.0.10:53: read udp 10.128.0.11:56812->172.30.0.10:53: read: connection refused",
    }
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to issue the default ingress serving certificate from Let's Encrypt using cert-manager with ACME DNS-01 challenges2
Affected runs (2)
Date (UTC)Associated PRProw job
PR #73562107245750499938304
PR #73192107206250759458816
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServic...
full failure pattern:
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServiceStatus] state is "uninstalling"; [hostedCluster] HostedCluster still exists; [resourceTeardown] tearing down namespaces; [descendantResources] remaining resources: serviceProviderClusters; provider Microsoft.RedHatOpenShift
Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)
e2e22.60%2 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2none
Full failure examples (2)
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0xc8fdac18360>: 
    resource group "customer-rg-cs869d4j8jj9": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster2" in resourcegroup="customer-rg-cs869d4j8jj9" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0",
      "name": "b17ce299-24e5-4459-a33b-52d98a9b26e0",
      "status": "Failed",
      "startTime": "2026-10-05T20:41:18.783157102Z",
      "endTime": "2026-10-05T21:05:28.437788206Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0xc8fdaf103c0>{
                msg: "resource group \"customer-rg-cs869d4j8jj9\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0xc8fdaf103a0>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0xc8fdaf10380>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0xc8fdaf10360>{
                            msg: "failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0xc8fdbb7c4e0>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0xc8fdaf101c0>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 943,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j6160640.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j6160640.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57ee760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0xc8fdac18360>: 
    resource group "customer-rg-cs869d4j8jj9": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster2" in resourcegroup="customer-rg-cs869d4j8jj9" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0",
      "name": "b17ce299-24e5-4459-a33b-52d98a9b26e0",
      "status": "Failed",
      "startTime": "2026-10-05T20:41:18.783157102Z",
      "endTime": "2026-10-05T21:05:28.437788206Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0xc8fdaf103c0>{
                msg: "resource group \"customer-rg-cs869d4j8jj9\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0xc8fdaf103a0>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0xc8fdaf10380>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0xc8fdaf10360>{
                            msg: "failed waiting for hcpCluster=\"basic-hcp-cluster2\" in resourcegroup=\"customer-rg-cs869d4j8jj9\" to finish deleting: GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0xc8fdbb7c4e0>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0xc8fdaf101c0>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 943,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j6160640.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j6160640.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57ee760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j6160640.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"name\": \"b17ce299-24e5-4459-a33b-52d98a9b26e0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T20:41:18.783157102Z\",\n  \"endTime\": \"2026-10-05T21:05:28.437788206Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rlsnvlojc3o6k3ro3dmb1ua5ahukl still exists (deletion dispatched at 2026-10-05T20:41:19Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x1dc907926ba0>: 
    resource group "admin-api-breakglass-wtffcnm884t4": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-wtffcnm884t4" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
      "name": "2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
      "status": "Failed",
      "startTime": "2026-10-05T19:28:57.280324623Z",
      "endTime": "2026-10-05T19:53:00.492724804Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x1dc907f30260>{
                msg: "resource group \"admin-api-breakglass-wtffcnm884t4\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x1dc907f30240>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x1dc907f30220>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x1dc907f30200>{
                            msg: "failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x1dc908664870>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x1dc907f30120>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 943,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j8110208.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57bc760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x1dc907926ba0>: 
    resource group "admin-api-breakglass-wtffcnm884t4": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-wtffcnm884t4" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
      "name": "2f465ddd-f1b5-440a-870c-8ec05b0abdb0",
      "status": "Failed",
      "startTime": "2026-10-05T19:28:57.280324623Z",
      "endTime": "2026-10-05T19:53:00.492724804Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x1dc907f30260>{
                msg: "resource group \"admin-api-breakglass-wtffcnm884t4\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x1dc907f30240>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x1dc907f30220>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x1dc907f30200>{
                            msg: "failed waiting for hcpCluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-wtffcnm884t4\" to finish deleting: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x1dc908664870>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                        "Server": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x1dc907f30120>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 943,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j8110208.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57bc760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"name\": \"2f465ddd-f1b5-440a-870c-8ec05b0abdb0\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:28:57.280324623Z\",\n  \"endTime\": \"2026-10-05T19:53:00.492724804Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8qe7cl2vqs57mhnl6riih1jdrphubn still exists (deletion dispatched at 2026-10-05T19:28:58Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
Contributing tests (2)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group1
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelSRE should be able to log into a cluster via a breakglass session1
Affected runs (2)
Date (UTC)Associated PRProw job
PR #73652107198083426160640
PR #73522107168871638110208
ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hype...
full failure pattern:
ERROR CODE: DeadlineExceeded; detail message node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \>= 2 (autoscaling min); node pool condition AllNodesHealthy is False: <count> of <count> machines are not healthy Machine <node>: InspectionFailed: Waiting for AzureMachine to report spec.providerID; node pool condition AllMachinesReady is False: <count> of <count> machines are not ready Machine <node>: Creating: virtualmachine creating or updating; provider Microsoft.RedHatOpenShift
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e22.60%2 of 77 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2none
Full failure examples (2)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x19372dd76210>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-mpvrctw9vt46" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
      "name": "c6b0c5c6-e258-472c-9703-899e89bbd15e",
      "status": "Failed",
      "startTime": "2026-10-05T19:21:04.389518057Z",
      "endTime": "2026-10-05T19:40:10.093617853Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x19372dd761f8>{
                errs: [
                    <*fmt.wrapError | 0x19373010d360>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x19372f563a10>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x19373010c280>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x19373010c260>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x19373010c220>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x19373010c200>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x19372fdf4f20>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n  \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x19372fdf4340>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n  \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x19372e940960>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "47992352-ac2e-4611-b067-3f72722a8c50",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 19:40:17 GMT",
                                ],
                                "Content-Length": ["1228"],
                                "X-Envoy-Upstream-Service-Time": ["6"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x19372fdf4260>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 50, 49, 58, 48, 52, 46, 51, 56, 57, 53, 49, 56, 48, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 52, 48, 58, 49, 48, 46, 48, 57, 51, 54, 49, 55, 56, 53, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1228,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j8110208.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Client-Request-Id": [
                                        "6a7c410b-746c-474b-8cb6-cd25d424b3f6",
                                    ],
                                    "Authorization": ["redacted"],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:40:17Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "47e50e50-1ce1-4f96-9071-58db4b27781c",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j8110208.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x19372f93f320>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n  \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x19372dd76210>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-mpvrctw9vt46" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
      "name": "c6b0c5c6-e258-472c-9703-899e89bbd15e",
      "status": "Failed",
      "startTime": "2026-10-05T19:21:04.389518057Z",
      "endTime": "2026-10-05T19:40:10.093617853Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x19372dd761f8>{
                errs: [
                    <*fmt.wrapError | 0x19373010d360>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x19372f563a10>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x19373010c280>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x19373010c260>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x19373010c220>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x19373010c200>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x19372fdf4f20>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n  \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x19372fdf4340>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-mpvrctw9vt46\" to finish creating: GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n  \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x19372e940960>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "47992352-ac2e-4611-b067-3f72722a8c50",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 19:40:17 GMT",
                                ],
                                "Content-Length": ["1228"],
                                "X-Envoy-Upstream-Service-Time": ["6"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x19372fdf4260>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 54, 98, 48, 99, 53, 99, 54, 45, 101, 50, 53, 56, 45, 52, 55, 50, 99, 45, 57, 55, 48, 51, 45, 56, 57, 57, 101, 56, 57, 98, 98, 100, 49, 53, 101, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 50, 49, 58, 48, 52, 46, 51, 56, 57, 53, 49, 56, 48, 53, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 52, 48, 58, 49, 48, 46, 48, 57, 51, 54, 49, 55, 56, 53, 51, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 114, 53, 57, 50, 104, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 119, 116, 120, 109, 106, 45, 119, 118, 118, 106, 107, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1228,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j8110208.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Client-Request-Id": [
                                        "6a7c410b-746c-474b-8cb6-cd25d424b3f6",
                                    ],
                                    "Authorization": ["redacted"],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:40:17Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "X-Ms-Correlation-Request-Id": [
                                        "47e50e50-1ce1-4f96-9071-58db4b27781c",
                                    ],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j8110208.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j8110208.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x19372f93f320>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j8110208.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"name\": \"c6b0c5c6-e258-472c-9703-899e89bbd15e\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:21:04.389518057Z\",\n  \"endTime\": \"2026-10-05T19:40:10.093617853Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-wtxmj-r592h: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-wtxmj-wvvjk: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x240541336060>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-xjrskw5rbsb8" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
      "name": "c3e6190f-6d0a-4437-b946-d5969f96f937",
      "status": "Failed",
      "startTime": "2026-10-05T16:07:16.344851872Z",
      "endTime": "2026-10-05T16:26:24.47612917Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x240541336030>{
                errs: [
                    <*fmt.wrapError | 0x240542de8500>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x240540c00e20>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x2405418c2280>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x2405418c2260>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x2405418c2220>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x2405418c21c0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x24054117cac0>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n  \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x24054185ac80>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n  \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x2405415bcab0>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "810934bd-51d5-4b1d-8362-3515a979c5bc",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 16:26:29 GMT",
                                ],
                                "Content-Length": ["1227"],
                                "X-Envoy-Upstream-Service-Time": ["10"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x24054185aa60>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 48, 55, 58, 49, 54, 46, 51, 52, 52, 56, 53, 49, 56, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 54, 58, 50, 52, 46, 52, 55, 54, 49, 50, 57, 49, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1227,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j4561920.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Correlation-Request-Id": [
                                        "df0ba451-c04d-46f0-895e-bc2e85d765e5",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "67ebdf96-cb38-4b47-90e6-8d990d752e02",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:26:29Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "Authorization": ["redacted"],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j4561920.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x240541bb34e0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n  \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:404]: failed to verify cilium is running and nodes are Ready for cluster "agg-cluster"
Unexpected error:
    <*errors.joinError | 0x240541336060>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool agg-np-a: failed waiting for nodepool="agg-np-a" for cluster "agg-cluster" in resourcegroup="feature-aggregation-xjrskw5rbsb8" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
      "name": "c3e6190f-6d0a-4437-b946-d5969f96f937",
      "status": "Failed",
      "startTime": "2026-10-05T16:07:16.344851872Z",
      "endTime": "2026-10-05T16:26:24.47612917Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*errors.joinError | 0x240541336030>{
                errs: [
                    <*fmt.wrapError | 0x240542de8500>{
                        msg: "VerifyNodesReady failed: no nodes found in the cluster",
                        err: <*errors.errorString | 0x240540c00e20>{
                            s: "no nodes found in the cluster",
                        },
                    },
                    <*fmt.wrapError | 0x2405418c2280>{
                        msg: "VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                        err: <*fmt.wrapError | 0x2405418c2260>{
                            msg: "not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                            err: <*fmt.wrapError | 0x2405418c2220>{
                                msg: "failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded",
                                err: <*fmt.wrapError | 0x2405418c21c0>{
                                    msg: "client rate limiter Wait returned an error: context deadline exceeded",
                                    err: <context.deadlineExceededError>{},
                                },
                            },
                        },
                    },
                ],
            },
            <*fmt.wrapError | 0x24054117cac0>{
                msg: "failed to create NodePool agg-np-a: failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n  \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x24054185ac80>{
                    msg: "failed waiting for nodepool=\"agg-np-a\" for cluster \"agg-cluster\" in resourcegroup=\"feature-aggregation-xjrskw5rbsb8\" to finish creating: GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n  \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*exported.ResponseError | 0x2405415bcab0>{
                        ErrorCode: "DeadlineExceeded",
                        StatusCode: 200,
                        RawResponse: {
                            Status: "200 OK",
                            StatusCode: 200,
                            Proto: "HTTP/2.0",
                            ProtoMajor: 2,
                            ProtoMinor: 0,
                            Header: {
                                "Content-Type": ["application/json"],
                                "X-Ms-Request-Id": [
                                    "810934bd-51d5-4b1d-8362-3515a979c5bc",
                                ],
                                "Date": [
                                    "Mon, 05 Oct 2026 16:26:29 GMT",
                                ],
                                "Content-Length": ["1227"],
                                "X-Envoy-Upstream-Service-Time": ["10"],
                                "Server": ["istio-envoy"],
                            },
                            Body: <*exported.nopClosingBytesReader | 0x24054185aa60>{
                                s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 99, 51, 101, 54, 49, 57, 48, 102, 45, 54, 100, 48, 97, 45, 52, 52, 51, 55, 45, 98, 57, 52, 54, 45, 100, 53, 57, 54, 57, 102, 57, 54, 102, 57, 51, 55, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 48, 55, 58, 49, 54, 46, 51, 52, 52, 56, 53, 49, 56, 55, 50, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 54, 58, 50, 54, 58, 50, 52, 46, 52, 55, 54, 49, 50, 57, 49, 55, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 68, 101, 97, 100, 108, 105, 110, 101, 69, 120, 99, 101, 101, 100, 101, 100, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 114, 101, 97, 116, 105, 111, 110, 32, 100, 105, 100, 32, 110, 111, 116, 32, 99, 111, 109, 112, 108, 101, 116, 101, 32, 98, 101, 102, 111, 114, 101, 32, 116, 104, 101, 32, 100, 101, 97, 100, 108, 105, 110, 101, 59, 32, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 99, 108, 117, 115, 116, 101, 114, 32, 115, 101, 114, 118, 105, 99, 101, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 105, 115, 32, 105, 110, 115, 116, 97, 108, 108, 105, 110, 103, 59, 32, 91, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 78, 111, 100, 101, 80, 111, 111, 108, 93, 32, 104, 121, 112, 101, 114, 115, 104, 105, 102, 116, 32, 78, 111, 100, 101, 80, 111, 111, 108, 32, 115, 116, 97, 116, 117, 115, 32, 114, 101, 112, 108, 105, 99, 97, 115, 32, 105, 115, 32, 48, 44, 32, 119, 97, 110, 116, 32, 92, 117, 48, 48, 51, 101, 61, 32, 50, 32, 40, 97, 117, 116, 111, 115, 99, 97, 108, 105, 110, 103, 32, 109, 105, 110, 41, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 78, 111, 100, 101, 115, 72, 101, 97, 108, 116, 104, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 104, 101, 97, 108, 116, 104, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 73, 110, 115, 112, 101, 99, 116, 105, 111, 110, 70, 97, 105, 108, 101, 100, 58, 32, 87, 97, 105, 116, 105, 110, 103, 32, 102, 111, 114, 32, 65, 122, 117, 114, 101, 77, 97, 99, 104, 105, 110, 101, 32, 116, 111, 32, 114, 101, 112, 111, 114, 116, 32, 115, 112, 101, 99, 46, 112, 114, 111, 118, 105, 100, 101, 114, 73, 68, 92, 110, 59, 32, 110, 111, 100, 101, 32, 112, 111, 111, 108, 32, 99, 111, 110, 100, 105, 116, 105, 111, 110, 32, 65, 108, 108, 77, 97, 99, 104, 105, 110, 101, 115, 82, 101, 97, 100, 121, 32, 105, 115, 32, 70, 97, 108, 115, 101, 58, 32, 50, 32, 111, 102, 32, 50, 32, 109, 97, 99, 104, 105, 110, 101, 115, 32, 97, 114, 101, 32, 110, 111, 116, 32, 114, 101, 97, 100, 121, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 106, 108, 113, 56, 100, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 77, 97, 99, 104, 105, 110, 101, 32, 97, 103, 103, 45, 99, 108, 117, 115, 116, 101, 114, 45, 97, 103, 103, 45, 110, 112, 45, 97, 45, 56, 104, 50, 122, 118, 45, 118, 52, 112, 120, 54, 58, 32, 67, 114, 101, 97, 116, 105, 110, 103, 58, 32, 118, 105, 114, 116, 117, 97, 108, 109, 97, 99, 104, 105, 110, 101, 32, 99, 114, 101, 97, 116, 105, 110, 103, 32, 111, 114, 32, 117, 112, 100, 97, 116, 105, 110, 103, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                                i: 0,
                            },
                            ContentLength: 1227,
                            TransferEncoding: nil,
                            Close: false,
                            Uncompressed: false,
                            Trailer: nil,
                            Request: {
                                Method: "GET",
                                URL: {
                                    Scheme: "https",
                                    Opaque: "",
                                    User: nil,
                                    Host: "rp.j4561920.hcpsvc.osadev.cloud",
                                    Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937",
                                    Fragment: "",
                                    RawQuery: "api-version=2025-12-23-preview",
                                    RawPath: "",
                                    RawFragment: "",
                                    ForceQuery: false,
                                    OmitHost: false,
                                },
                                Proto: "HTTP/1.1",
                                ProtoMajor: 1,
                                ProtoMinor: 1,
                                Header: {
                                    "X-Ms-Correlation-Request-Id": [
                                        "df0ba451-c04d-46f0-895e-bc2e85d765e5",
                                    ],
                                    "X-Ms-Client-Request-Id": [
                                        "67ebdf96-cb38-4b47-90e6-8d990d752e02",
                                    ],
                                    "X-Ms-Arm-Resource-System-Data": [
                                        "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T16:26:29Z\"}",
                                    ],
                                    "X-Ms-Identity-Url": [
                                        "https://dummyhost.identity.azure.net",
                                    ],
                                    "User-Agent": [
                                        "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                                    ],
                                    "Authorization": ["redacted"],
                                },
                                Body: nil,
                                GetBody: nil,
                                ContentLength: 0,
                                TransferEncoding: nil,
                                Close: false,
                                Host: "rp.j4561920.hcpsvc.osadev.cloud",
                                Form: nil,
                                PostForm: nil,
                                MultipartForm: nil,
                                Trailer: nil,
                                RemoteAddr: "",
                                RequestURI: "",
                                TLS: nil,
                                Cancel: nil,
                                Response: nil,
                                Pattern: "",
                                ctx: <suppressed context>,
                                pat: nil,
                                matches: nil,
                                otherValues: nil,
                            },
                            TLS: {
                                Version: 772,
                                HandshakeComplete: true,
                                DidResume: false,
                                CipherSuite: 4865,
                                CurveID: 29,
                                NegotiatedProtocol: "h2",
                                NegotiatedProtocolIsMutual: true,
                                ServerName: "rp.j4561920.hcpsvc.osadev.cloud",
                                PeerCertificates: [
                                    {
                                        Raw: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawTBSCertificate: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubjectPublicKeyInfo: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawSubject: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        RawIssuer: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        Signature: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        SignatureAlgorithm: 4,
                                        PublicKeyAlgorithm: 1,
                                        PublicKey: <*rsa.PublicKey | 0x240541bb34e0>{N: ..., E: ...},
                                        Version: 3,
                                        SerialNumber: {neg: ..., abs: ...},
                                        Issuer: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        Subject: {
                                            Country: ...,
                                            Organization: ...,
                                            OrganizationalUnit: ...,
                                            Locality: ...,
                                            Province: ...,
                                            StreetAddress: ...,
                                            PostalCode: ...,
                                            SerialNumber: ...,
                                            CommonName: ...,
                                            Names: ...,
                                            ExtraNames: ...,
                                        },
                                        NotBefore: {wall: ..., ext: ..., loc: ...},
                                        NotAfter: {wall: ..., ext: ..., loc: ...},
                                        KeyUsage: 5,
                                        Extensions: [..., ..., ..., ..., ..., ...],
                                        ExtraExtensions: nil,
                                        UnhandledCriticalExtensions: nil,
                                        ExtKeyUsage: [..., ...],
                                        UnknownExtKeyUsage: nil,
                                        BasicConstraintsValid: true,
                                        IsCA: false,
                                        MaxPathLen: -1,
                                        MaxPathLenZero: false,
                                        SubjectKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        AuthorityKeyId: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        OCSPServer: nil,
                                        IssuingCertificateURL: nil,
                                        DNSNames: [...],
                                        EmailAddresses: nil,
                                        IPAddresses: nil,
                                        URIs: nil,
                                        PermittedDNSDomainsCritical: false,
                                        PermittedDNSDomains: nil,
                                        ExcludedDNSDomains: nil,
                                        PermittedIPRanges: nil,
                                        ExcludedIPRanges: nil,
                                        PermittedEmailAddresses: nil,
                                        ExcludedEmailAddresses: nil,
                                        PermittedURIDomains: nil,
                                        ExcludedURIDomains: nil,
                                        CRLDistributionPoints: nil,
                                        PolicyIdentifiers: nil,
                                        Policies: nil,
                                        InhibitAnyPolicy: 0,
                                        InhibitAnyPolicyZero: false,
                                        InhibitPolicyMapping: 0,
                                        InhibitPolicyMappingZero: false,
                                        RequireExplicitPolicy: 0,
                                        RequireExplicitPolicyZero: false,
                                        PolicyMappings: nil,
                                    },
                                ],
                                VerifiedChains: nil,
                                SignedCertificateTimestamps: nil,
                                OCSPResponse: nil,
                                TLSUnique: nil,
                                ECHAccepted: false,
                                HelloRetryRequest: false,
                                ekm: 0x57bc760,
                                testingOnlyPeerSignatureAlgorithm: 2052,
                            },
                        },
                        errMsg: "GET https://rp.j4561920.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeadlineExceeded\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"name\": \"c3e6190f-6d0a-4437-b946-d5969f96f937\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T16:07:16.344851872Z\",\n  \"endTime\": \"2026-10-05T16:26:24.47612917Z\",\n  \"error\": {\n    \"code\": \"DeadlineExceeded\",\n    \"message\": \"node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want \\u003e= 2 (autoscaling min); node pool condition AllNodesHealthy is False: 2 of 2 machines are not healthy\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: InspectionFailed: Waiting for AzureMachine to report spec.providerID\\n; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\\nMachine agg-cluster-agg-np-a-8h2zv-jlq8d: Creating: virtualmachine creating or updating\\nMachine agg-cluster-agg-np-a-8h2zv-v4px6: Creating: virtualmachine creating or updating\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    },
                },
            },
        ],
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create a cluster and node pools with aggregated advanced features2
Affected runs (2)
Date (UTC)Associated PRProw job
PR #73522107168871638110208
PR #73312107125784404561920
failed to roll out Helm release: context deadline exceeded
full failure pattern:
failed to roll out Helm release: context deadline exceeded
Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)
provision22.60%2 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)Show trend detailsSep 29: 0 · Sep 30: 4 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 2none
Full failure examples (2)
time=2026-10-05T23:18:10.703Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n"
time=2026-10-05T23:18:11.131Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j0130560-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:ca kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:canadacentral role:hcp-underlay-ci01-j0130560-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:07c7a7dc-f584-486c-8d39-ebf1e695ebed region:canadacentral secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#07c7a7dc-f584-486c-8d39-ebf1e695ebed INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]"
time=2026-10-05T23:18:11.131Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:18:11.331Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit
time=2026-10-05T23:18:11.538Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false
time=2026-10-05T23:18:11.538Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:18:11.576Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:28:15.149Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T23:28:15.149Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T23:29:15.152Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n"
time=2026-10-05T23:29:15.561Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j0130560-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:ca kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:canadacentral role:hcp-underlay-ci01-j0130560-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:07c7a7dc-f584-486c-8d39-ebf1e695ebed region:canadacentral secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#07c7a7dc-f584-486c-8d39-ebf1e695ebed INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]"
time=2026-10-05T23:29:15.561Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:29:15.876Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit
time=2026-10-05T23:29:16.247Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:29:16.247Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:29:16.388Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1
time=2026-10-05T23:29:17.014Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:29:17.014Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:29:17.353Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:29:17.822Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder
time=2026-10-05T23:29:18.380Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder
time=2026-10-05T23:29:18.734Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:29:19.084Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:29:19.694Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:29:19.902Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false
time=2026-10-05T23:29:19.902Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:29:19.952Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1
time=2026-10-05T23:39:21.321Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T23:39:21.321Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T23:40:21.330Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n"
time=2026-10-05T23:40:21.850Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j0130560-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:ca kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:canadacentral role:hcp-underlay-ci01-j0130560-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:07c7a7dc-f584-486c-8d39-ebf1e695ebed region:canadacentral secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#07c7a7dc-f584-486c-8d39-ebf1e695ebed INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]"
time=2026-10-05T23:40:21.850Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:40:22.145Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit
time=2026-10-05T23:40:22.463Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:40:22.463Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:40:22.721Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2
time=2026-10-05T23:40:23.339Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:40:23.339Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:40:23.556Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:40:23.818Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder
time=2026-10-05T23:40:24.356Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder
time=2026-10-05T23:40:24.582Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:40:24.826Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:40:25.179Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder
time=2026-10-05T23:40:25.516Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false
time=2026-10-05T23:40:25.516Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T23:40:25.574Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2
time=2026-10-05T23:48:10.601Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="context deadline exceeded"
time=2026-10-05T23:48:10.601Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: context deadline exceeded"
time=2026-10-05T18:51:40.028Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n"
time=2026-10-05T18:51:40.439Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j8411136-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:us kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:westus3 role:hcp-underlay-ci01-j8411136-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:f30e3043-eff4-4c01-8097-12e7408108fa region:westus3 secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#f30e3043-eff4-4c01-8097-12e7408108fa INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]"
time=2026-10-05T18:51:40.440Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T18:51:40.692Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit
time=2026-10-05T18:51:41.342Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false
time=2026-10-05T18:51:41.342Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T18:51:41.468Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:01:45.280Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T19:01:45.280Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T19:02:45.281Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n"
time=2026-10-05T19:02:45.868Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j8411136-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:us kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:westus3 role:hcp-underlay-ci01-j8411136-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:f30e3043-eff4-4c01-8097-12e7408108fa region:westus3 secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#f30e3043-eff4-4c01-8097-12e7408108fa INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]"
time=2026-10-05T19:02:45.868Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:02:46.477Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit
time=2026-10-05T19:02:47.121Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:02:47.121Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:02:47.481Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1
time=2026-10-05T19:02:48.530Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:02:48.530Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:02:49.268Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:02:49.829Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder
time=2026-10-05T19:02:50.750Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder
time=2026-10-05T19:02:51.062Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:02:51.630Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:02:52.175Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:02:52.824Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false
time=2026-10-05T19:02:52.824Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:02:53.077Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=1
time=2026-10-05T19:12:55.941Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T19:12:55.941Z level=INFO msg="Retrying step" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit step=arobit error="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: resource DaemonSet/arobit/arobit-forwarder not ready. status: InProgress, message: Available: 0/3\ncontext deadline exceeded"
time=2026-10-05T19:13:55.943Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit description="Step arobit\n Kind: Helm\n"
time=2026-10-05T19:13:56.804Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit values="map[forwarder:map[azureCloudEnvironmentName:AzurePublicCloud clusterName:ci01-j8411136-svc clusterType:svc dynamicConfig:false environment:dev fluentbit:map[image:map[digest:sha256:70dea5e158860b7b59a9e9aae0e79fc5ab51f2c356fcc14aef38ce1ff6d7d577 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:oss/v2/fluent/fluent-bit] resources:map[limits:map[memory:1248Mi] requests:map[cpu:450m memory:472Mi]]] geoShortId:us kusto:map[blob_uri_length:128 buffer_dir:/var/kusto buffer_file_delete_early:false buffering:true buffering_enabled:true delete_on_max_upload_error:true enabled:true hostedControlPlaneLogsDatabase:HostedControlPlaneLogs ingestionEndpoint:https://ingest-hcp-dev-us-2.eastus2.kusto.windows.net io_timeout:60s scheduler_max_retries:9 serviceLogsDatabase:ServiceLogs store_dir_limit_size:1.8GB unify_tag:true upload_file_size:16M upload_timeout:1m] mdsd:map[enabled:false geneva:map[clusterLogsAccountName:placeholder clusterLogsNamespace: clusterLogsSan:empty-sentinel clusterLogsSecretName:clusterlogs configVersion:1 environment:Test region:westus3 role:hcp-underlay-ci01-j8411136-svc rpAccountName:placeholder rpNamespace: rpSan:empty-sentinel rpSecretName:rplogs] image:map[digest:sha256:8dcdcbb193278f21587a96cb958ab100c6140c2284b1e95a98ddf749d3cc0703 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:geneva/distroless/mdsd]] msiClientId:f30e3043-eff4-4c01-8097-12e7408108fa region:westus3 secretProvider:map[keyVault:aro-hcp-dev-svc-kv] securityContext:map[enabled:true runAsGroup:65532 runAsUser:65532] serviceAccountName:arobit-forwarder tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX watchdog:map[image:map[digest:sha256:161971cdd3bfe66be6a9b96d67fabf8c4b54a88b841add1aaced26b0a00358b4 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:aks/command/runtime] intervalSeconds:15 timeoutSeconds:300]] watson:map[env:map[AUTHENTICATION_ID:MsiClientId#f30e3043-eff4-4c01-8097-12e7408108fa INCOMING_QUEUE:/azure-watson/cores MDSD_ROLE_PREFIX:/var/run/mdsd/asa/ REPORT_QUEUE:/azure-watson/queue WA_CORE_PATTERN:/azure-watson/cores/%e.%p.%h.%t] image:map[digest:sha256:8e5ef3e76be33794cef7460712eb9ff0c73bce8b8e5ffc33c5c6bfe0762f5db0 pullPolicy:IfNotPresent registry:mcr.microsoft.com repository:azure-watson/agent/azlinux3] resources:map[limits:map[cpu:250m memory:512Mi] requests:map[cpu:50m memory:128Mi]] securityContext:map[privileged:true] volumes:map[crashdumpHostPath:/home/docker/azure-watson]]]"
time=2026-10-05T19:13:56.804Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:13:57.232Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit namespace=arobit
time=2026-10-05T19:13:58.023Z level=INFO msg="Doing dry-run of Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:13:58.023Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:13:58.259Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2
time=2026-10-05T19:13:59.227Z level=INFO msg="Removing old field manager from objects in release manifest." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:13:59.228Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ServiceAccount" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:14:00.003Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=ConfigMap" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:14:00.663Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRole" namespace="" name=arobit-forwarder
time=2026-10-05T19:14:01.629Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding" namespace="" name=arobit-forwarder
time=2026-10-05T19:14:02.281Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="/v1, Kind=Service" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:14:02.991Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="apps/v1, Kind=DaemonSet" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:14:03.683Z level=INFO msg="Decoded resource from manifests." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit gvk="monitoring.coreos.com/v1, Kind=ServiceMonitor" namespace=arobit name=arobit-forwarder
time=2026-10-05T19:14:04.305Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit dryRun=false
time=2026-10-05T19:14:04.305Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit
time=2026-10-05T19:14:04.560Z level=INFO msg="Found release history, upgrading..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit numVersions=2
time=2026-10-05T19:21:40.183Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="context deadline exceeded"
time=2026-10-05T19:21:40.183Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=arobit err="error running Helm release deployment Step, failed to deploy helm release: failed to roll out Helm release: context deadline exceeded"
Contributing tests (1)
Failed AtJobTestSupport
provisionpull-ci-Azure-ARO-HCP-main-e2e-parallelRun pipeline step Microsoft.Azure.ARO.HCP.Service.Infra/service/arobit2
Affected runs (2)
Date (UTC)Associated PRProw job
PR #68202107237896200130560
PR #68202107170660328411136
ERROR CODE: InternalServerError; detail code SubscriptionRequestsThrottled; detail message Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor ...
full failure pattern:
ERROR CODE: InternalServerError; detail code SubscriptionRequestsThrottled; detail message Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '<uuid>' exceeded. Please try again after '<seconds>' seconds after additional tokens are available.; provider Microsoft.Compute
Signal: IndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)
e2e11.30%1 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 3 prior week(s); active 2 day(s)Show trend detailsSep 29: 4 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:165]: failed to create node pool npupgrade-4-20 with version 4.20.40
Unexpected error:
    <*fmt.wrapError | 0x9537f6d3c20>: 
    failed to create NodePool npupgrade-4-20: failed waiting for nodepool="npupgrade-4-20" for cluster "np-version-upgrade-cluster-s84r9b" in resourcegroup="rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
      "name": "d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
      "status": "Failed",
      "startTime": "2026-10-05T19:07:58.071230128Z",
      "endTime": "2026-10-05T19:08:38.680974136Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\"\n  }\n}\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool npupgrade-4-20: failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n  \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x9537f6d3760>{
            msg: "failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n  \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x95381335020>{
                ErrorCode: "InternalServerError",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Date": [
                            "Mon, 05 Oct 2026 19:08:48 GMT",
                        ],
                        "Content-Length": ["1296"],
                        "X-Envoy-Upstream-Service-Time": ["7"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "bed67fbc-da19-4ff2-8581-7faaacde45b0",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x9537f6d2500>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 55, 58, 53, 56, 46, 48, 55, 49, 50, 51, 48, 49, 50, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 56, 58, 51, 56, 46, 54, 56, 48, 57, 55, 52, 49, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 115, 107, 117, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 52, 55, 102, 54, 57, 53, 48, 50, 45, 48, 48, 54, 53, 45, 52, 100, 57, 97, 45, 98, 49, 57, 98, 45, 100, 52, 48, 51, 101, 49, 56, 51, 100, 50, 102, 52, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 114, 32, 116, 111, 32, 104, 116, 116, 112, 115, 58, 47, 47, 97, 107, 97, 46, 109, 115, 47, 97, 114, 109, 45, 116, 104, 114, 111, 116, 116, 108, 105, 110, 103, 32, 102, 111, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 105, 110, 102, 111, 114, 109, 97, 116, 105, 111, 110, 46, 92, 34, 92, 110, 32, 32, 125, 92, 110, 125, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1296,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j4304000.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Client-Request-Id": [
                                "27c665b0-31fc-4d90-907b-4e83655f5e19",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:08:48Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "42212478-d84f-4f3c-ae6e-854ba7c22a6c",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j4304000.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j4304000.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x95380cc9380>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13288086171734095008, 9061348496961719078],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926819901, loc: nil},
                                NotAfter: {wall: 0, ext: 63942545301, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
                                AuthorityKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j4304000.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n  \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:165]: failed to create node pool npupgrade-4-20 with version 4.20.40
Unexpected error:
    <*fmt.wrapError | 0x9537f6d3c20>: 
    failed to create NodePool npupgrade-4-20: failed waiting for nodepool="npupgrade-4-20" for cluster "np-version-upgrade-cluster-s84r9b" in resourcegroup="rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
      "name": "d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
      "status": "Failed",
      "startTime": "2026-10-05T19:07:58.071230128Z",
      "endTime": "2026-10-05T19:08:38.680974136Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\"\n  }\n}\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool npupgrade-4-20: failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n  \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0x9537f6d3760>{
            msg: "failed waiting for nodepool=\"npupgrade-4-20\" for cluster \"np-version-upgrade-cluster-s84r9b\" in resourcegroup=\"rg-np-version-upgrade-s84r9b-rcmjqbkj5bqh\" to finish creating: GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n  \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0x95381335020>{
                ErrorCode: "InternalServerError",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Date": [
                            "Mon, 05 Oct 2026 19:08:48 GMT",
                        ],
                        "Content-Length": ["1296"],
                        "X-Envoy-Upstream-Service-Time": ["7"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Request-Id": [
                            "bed67fbc-da19-4ff2-8581-7faaacde45b0",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0x9537f6d2500>{
                        s: [123, 10, 32, 32, 32, 32, 34, 105, 100, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 82, 101, 100, 72, 97, 116, 79, 112, 101, 110, 83, 104, 105, 102, 116, 47, 108, 111, 99, 97, 116, 105, 111, 110, 115, 47, 99, 97, 110, 97, 100, 97, 99, 101, 110, 116, 114, 97, 108, 47, 104, 99, 112, 79, 112, 101, 114, 97, 116, 105, 111, 110, 83, 116, 97, 116, 117, 115, 101, 115, 47, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 110, 97, 109, 101, 34, 58, 32, 34, 100, 56, 102, 56, 98, 99, 97, 52, 45, 56, 99, 53, 56, 45, 52, 53, 57, 48, 45, 57, 102, 101, 53, 45, 99, 54, 100, 55, 99, 99, 48, 54, 101, 56, 54, 54, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 116, 117, 115, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 34, 44, 10, 32, 32, 32, 32, 34, 115, 116, 97, 114, 116, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 55, 58, 53, 56, 46, 48, 55, 49, 50, 51, 48, 49, 50, 56, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 110, 100, 84, 105, 109, 101, 34, 58, 32, 34, 50, 48, 50, 54, 45, 49, 48, 45, 48, 53, 84, 49, 57, 58, 48, 56, 58, 51, 56, 46, 54, 56, 48, 57, 55, 52, 49, 51, 54, 90, 34, 44, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 116, 101, 114, 110, 97, 108, 83, 101, 114, 118, 101, 114, 69, 114, 114, 111, 114, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 91, 99, 108, 117, 115, 116, 101, 114, 83, 101, 114, 118, 105, 99, 101, 78, 111, 100, 101, 80, 111, 111, 108, 83, 116, 97, 116, 117, 115, 93, 32, 71, 69, 84, 32, 104, 116, 116, 112, 115, 58, 47, 47, 109, 97, 110, 97, 103, 101, 109, 101, 110, 116, 46, 97, 122, 117, 114, 101, 46, 99, 111, 109, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 47, 112, 114, 111, 118, 105, 100, 101, 114, 115, 47, 77, 105, 99, 114, 111, 115, 111, 102, 116, 46, 67, 111, 109, 112, 117, 116, 101, 47, 115, 107, 117, 115, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 82, 69, 83, 80, 79, 78, 83, 69, 32, 52, 50, 57, 58, 32, 52, 50, 57, 32, 84, 111, 111, 32, 77, 97, 110, 121, 32, 82, 101, 113, 117, 101, 115, 116, 115, 92, 110, 69, 82, 82, 79, 82, 32, 67, 79, 68, 69, 58, 32, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 123, 92, 110, 32, 32, 92, 34, 101, 114, 114, 111, 114, 92, 34, 58, 32, 123, 92, 110, 32, 32, 32, 32, 92, 34, 99, 111, 100, 101, 92, 34, 58, 32, 92, 34, 83, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 82, 101, 113, 117, 101, 115, 116, 115, 84, 104, 114, 111, 116, 116, 108, 101, 100, 92, 34, 44, 92, 110, 32, 32, 32, 32, 92, 34, 109, 101, 115, 115, 97, 103, 101, 92, 34, 58, 32, 92, 34, 78, 117, 109, 98, 101, 114, 32, 111, 102, 32, 39, 114, 101, 97, 100, 39, 32, 114, 101, 113, 117, 101, 115, 116, 115, 32, 102, 111, 114, 32, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 32, 39, 101, 56, 99, 53, 97, 49, 49, 53, 45, 56, 52, 50, 100, 45, 52, 100, 55, 101, 45, 57, 56, 97, 100, 45, 99, 102, 98, 50, 99, 53, 48, 98, 50, 48, 57, 101, 39, 32, 97, 99, 116, 111, 114, 32, 39, 52, 55, 102, 54, 57, 53, 48, 50, 45, 48, 48, 54, 53, 45, 52, 100, 57, 97, 45, 98, 49, 57, 98, 45, 100, 52, 48, 51, 101, 49, 56, 51, 100, 50, 102, 52, 39, 32, 101, 120, 99, 101, 101, 100, 101, 100, 46, 32, 80, 108, 101, 97, 115, 101, 32, 116, 114, 121, 32, 97, 103, 97, 105, 110, 32, 97, 102, 116, 101, 114, 32, 39, 49, 39, 32, 115, 101, 99, 111, 110, 100, 115, 32, 97, 102, 116, 101, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 116, 111, 107, 101, 110, 115, 32, 97, 114, 101, 32, 97, 118, 97, 105, 108, 97, 98, 108, 101, 46, 32, 82, 101, 102, 101, 114, 32, 116, 111, 32, 104, 116, 116, 112, 115, 58, 47, 47, 97, 107, 97, 46, 109, 115, 47, 97, 114, 109, 45, 116, 104, 114, 111, 116, 116, 108, 105, 110, 103, 32, 102, 111, 114, 32, 97, 100, 100, 105, 116, 105, 111, 110, 97, 108, 32, 105, 110, 102, 111, 114, 109, 97, 116, 105, 111, 110, 46, 92, 34, 92, 110, 32, 32, 125, 92, 110, 125, 92, 110, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 45, 92, 110, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 1296,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Method: "GET",
                        URL: {
                            Scheme: "https",
                            Opaque: "",
                            User: nil,
                            Host: "rp.j4304000.hcpsvc.osadev.cloud",
                            Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866",
                            Fragment: "",
                            RawQuery: "api-version=2024-06-10-preview",
                            RawPath: "",
                            RawFragment: "",
                            ForceQuery: false,
                            OmitHost: false,
                        },
                        Proto: "HTTP/1.1",
                        ProtoMajor: 1,
                        ProtoMinor: 1,
                        Header: {
                            "X-Ms-Client-Request-Id": [
                                "27c665b0-31fc-4d90-907b-4e83655f5e19",
                            ],
                            "X-Ms-Arm-Resource-System-Data": [
                                "{\"createdBy\": \"e2e-test\", \"createdByType\": \"Application\", \"createdAt\": \"2026-10-05T19:08:48Z\"}",
                            ],
                            "X-Ms-Identity-Url": [
                                "https://dummyhost.identity.azure.net",
                            ],
                            "Authorization": ["redacted"],
                            "User-Agent": [
                                "e2e/development azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.26.7 (Red Hat 1.26.7-1.el9_8) X:strictfipsruntime; linux)",
                            ],
                            "X-Ms-Correlation-Request-Id": [
                                "42212478-d84f-4f3c-ae6e-854ba7c22a6c",
                            ],
                        },
                        Body: nil,
                        GetBody: nil,
                        ContentLength: 0,
                        TransferEncoding: nil,
                        Close: false,
                        Host: "rp.j4304000.hcpsvc.osadev.cloud",
                        Form: nil,
                        PostForm: nil,
                        MultipartForm: nil,
                        Trailer: nil,
                        RemoteAddr: "",
                        RequestURI: "",
                        TLS: nil,
                        Cancel: nil,
                        Response: nil,
                        Pattern: "",
                        ctx: <suppressed context>,
                        pat: nil,
                        matches: nil,
                        otherValues: nil,
                    },
                    TLS: {
                        Version: 772,
                        HandshakeComplete: true,
                        DidResume: false,
                        CipherSuite: 4865,
                        CurveID: 29,
                        NegotiatedProtocol: "h2",
                        NegotiatedProtocolIsMutual: true,
                        ServerName: "rp.j4304000.hcpsvc.osadev.cloud",
                        PeerCertificates: [
                            {
                                Raw: [48, 130, 3, 136, 48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 3, 130, 1, 1, 0, 199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
                                RawTBSCertificate: [48, 130, 2, 112, 160, 3, 2, 1, 2, 2, 16, 125, 192, 96, 114, 235, 108, 75, 38, 184, 104, 195, 248, 74, 253, 180, 160, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 11, 5, 0, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 30, 23, 13, 50, 54, 49, 48, 48, 53, 49, 55, 53, 56, 50, 49, 90, 23, 13, 50, 55, 48, 52, 48, 53, 49, 56, 48, 56, 50, 49, 90, 48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1, 163, 129, 169, 48, 129, 166, 48, 14, 6, 3, 85, 29, 15, 1, 1, 255, 4, 4, 3, 2, 5, 160, 48, 9, 6, 3, 85, 29, 19, 4, 2, 48, 0, 48, 29, 6, 3, 85, 29, 37, 4, 22, 48, 20, 6, 8, 43, 6, 1, 5, 5, 7, 3, 1, 6, 8, 43, 6, 1, 5, 5, 7, 3, 2, 48, 42, 6, 3, 85, 29, 17, 4, 35, 48, 33, 130, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100, 48, 31, 6, 3, 85, 29, 35, 4, 24, 48, 22, 128, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237, 48, 29, 6, 3, 85, 29, 14, 4, 22, 4, 20, 136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
                                RawSubjectPublicKeyInfo: [48, 130, 1, 34, 48, 13, 6, 9, 42, 134, 72, 134, 247, 13, 1, 1, 1, 5, 0, 3, 130, 1, 15, 0, 48, 130, 1, 10, 2, 130, 1, 1, 0, 220, 221, 78, 29, 190, 112, 112, 255, 38, 124, 11, 20, 125, 211, 210, 18, 45, 168, 76, 62, 161, 192, 190, 51, 103, 192, 255, 19, 95, 130, 78, 124, 89, 122, 74, 217, 180, 17, 12, 33, 5, 75, 56, 140, 78, 114, 189, 252, 214, 146, 96, 176, 238, 143, 52, 56, 250, 86, 242, 106, 206, 14, 249, 153, 230, 120, 146, 61, 181, 68, 17, 178, 36, 209, 23, 184, 94, 168, 141, 111, 8, 249, 23, 254, 169, 227, 12, 28, 38, 129, 160, 150, 74, 151, 130, 23, 139, 109, 167, 254, 67, 217, 146, 133, 231, 177, 32, 180, 248, 144, 151, 215, 236, 235, 141, 204, 169, 160, 186, 119, 135, 231, 26, 79, 172, 208, 244, 178, 217, 226, 228, 207, 177, 217, 16, 220, 19, 64, 12, 90, 222, 69, 224, 177, 91, 96, 222, 205, 93, 182, 216, 141, 158, 13, 175, 230, 120, 112, 2, 177, 45, 192, 64, 36, 33, 203, 15, 239, 81, 163, 211, 164, 244, 118, 208, 41, 103, 149, 45, 89, 115, 49, 148, 152, 14, 237, 12, 59, 104, 164, 33, 11, 223, 178, 233, 66, 247, 66, 125, 98, 121, 59, 138, 81, 173, 33, 81, 15, 32, 124, 213, 21, 147, 50, 225, 32, 212, 153, 204, 237, 240, 201, 44, 129, 4, 197, 123, 120, 211, 156, 124, 10, 195, 53, 103, 40, 254, 30, 214, 242, 125, 52, 163, 207, 126, 81, 66, 102, 98, 231, 1, 106, 88, 213, 227, 69, 2, 3, 1, 0, 1],
                                RawSubject: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                RawIssuer: [48, 42, 49, 40, 48, 38, 6, 3, 85, 4, 3, 19, 31, 114, 112, 46, 106, 52, 51, 48, 52, 48, 48, 48, 46, 104, 99, 112, 115, 118, 99, 46, 111, 115, 97, 100, 101, 118, 46, 99, 108, 111, 117, 100],
                                Signature: [199, 26, 90, 185, 59, 77, 86, 145, 220, 100, 188, 130, 194, 147, 184, 56, 242, 166, 222, 167, 132, 96, 238, 206, 248, 34, 68, 218, 178, 95, 120, 103, 233, 60, 32, 99, 139, 119, 119, 170, 247, 230, 151, 0, 29, 110, 243, 181, 255, 136, 101, 235, 201, 174, 50, 149, 201, 223, 50, 235, 91, 236, 210, 125, 230, 53, 108, 236, 78, 65, 59, 224, 131, 153, 146, 245, 128, 63, 113, 175, 83, 83, 29, 244, 20, 239, 43, 191, 253, 57, 97, 2, 236, 239, 22, 151, 207, 93, 22, 39, 187, 108, 26, 87, 41, 249, 184, 253, 91, 136, 72, 42, 179, 180, 222, 244, 221, 103, 189, 226, 59, 207, 248, 142, 140, 42, 237, 6, 166, 77, 156, 160, 37, 77, 229, 11, 198, 44, 216, 85, 45, 167, 155, 235, 124, 44, 220, 176, 225, 167, 173, 92, 243, 115, 136, 86, 179, 153, 173, 254, 28, 66, 81, 250, 103, 137, 60, 172, 247, 5, 236, 123, 65, 162, 240, 115, 218, 62, 130, 34, 215, 67, 39, 210, 131, 61, 204, 252, 27, 111, 89, 194, 250, 53, 86, 210, 166, 72, 19, 92, 143, 127, 48, 95, 182, 150, 150, 51, 97, 93, 195, 6, 120, 53, 115, 245, 152, 2, 104, 166, 141, 65, 255, 155, 63, 187, 126, 71, 210, 48, 207, 62, 81, 6, 239, 225, 76, 13, 49, 219, 166, 240, 200, 30, 182, 80, 148, 233, 253, 216, 196, 95, 79, 23, 29, 143],
                                SignatureAlgorithm: 4,
                                PublicKeyAlgorithm: 1,
                                PublicKey: <*rsa.PublicKey | 0x95380cc9380>{
                                    N: {
                                        neg: false,
                                        abs: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    E: 65537,
                                },
                                Version: 3,
                                SerialNumber: {
                                    neg: false,
                                    abs: [13288086171734095008, 9061348496961719078],
                                },
                                Issuer: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                Subject: {
                                    Country: nil,
                                    Organization: nil,
                                    OrganizationalUnit: nil,
                                    Locality: nil,
                                    Province: nil,
                                    StreetAddress: nil,
                                    PostalCode: nil,
                                    SerialNumber: "",
                                    CommonName: "rp.j4304000.hcpsvc.osadev.cloud",
                                    Names: [
                                        {Type: ..., Value: ...},
                                    ],
                                    ExtraNames: nil,
                                },
                                NotBefore: {wall: 0, ext: 63926819901, loc: nil},
                                NotAfter: {wall: 0, ext: 63942545301, loc: nil},
                                KeyUsage: 5,
                                Extensions: [
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: true,
                                        Value: [..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                    {
                                        Id: [..., ..., ..., ...],
                                        Critical: false,
                                        Value: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                    },
                                ],
                                ExtraExtensions: nil,
                                UnhandledCriticalExtensions: nil,
                                ExtKeyUsage: [1, 2],
                                UnknownExtKeyUsage: nil,
                                BasicConstraintsValid: true,
                                IsCA: false,
                                MaxPathLen: -1,
                                MaxPathLenZero: false,
                                SubjectKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
                                AuthorityKeyId: [136, 160, 118, 223, 191, 104, 242, 82, 102, 76, 44, 134, 35, 225, 217, 60, 6, 169, 195, 237],
                                OCSPServer: nil,
                                IssuingCertificateURL: nil,
                                DNSNames: [
                                    "rp.j4304000.hcpsvc.osadev.cloud",
                                ],
                                EmailAddresses: nil,
                                IPAddresses: nil,
                                URIs: nil,
                                PermittedDNSDomainsCritical: false,
                                PermittedDNSDomains: nil,
                                ExcludedDNSDomains: nil,
                                PermittedIPRanges: nil,
                                ExcludedIPRanges: nil,
                                PermittedEmailAddresses: nil,
                                ExcludedEmailAddresses: nil,
                                PermittedURIDomains: nil,
                                ExcludedURIDomains: nil,
                                CRLDistributionPoints: nil,
                                PolicyIdentifiers: nil,
                                Policies: nil,
                                InhibitAnyPolicy: 0,
                                InhibitAnyPolicyZero: false,
                                InhibitPolicyMapping: 0,
                                InhibitPolicyMappingZero: false,
                                RequireExplicitPolicy: 0,
                                RequireExplicitPolicyZero: false,
                                PolicyMappings: nil,
                            },
                        ],
                        VerifiedChains: nil,
                        SignedCertificateTimestamps: nil,
                        OCSPResponse: nil,
                        TLSUnique: nil,
                        ECHAccepted: false,
                        HelloRetryRequest: false,
                        ekm: 0x57bc760,
                        testingOnlyPeerSignatureAlgorithm: 2052,
                    },
                },
                errMsg: "GET https://rp.j4304000.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"name\": \"d8f8bca4-8c58-4590-9fe5-c6d7cc06e866\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T19:07:58.071230128Z\",\n  \"endTime\": \"2026-10-05T19:08:38.680974136Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"[clusterServiceNodePoolStatus] GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Compute/skus\\n--------------------------------------------------------------------------------\\nRESPONSE 429: 429 Too Many Requests\\nERROR CODE: SubscriptionRequestsThrottled\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"code\\\": \\\"SubscriptionRequestsThrottled\\\",\\n    \\\"message\\\": \\\"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '47f69502-0065-4d9a-b19b-d403e183d2f4' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https://aka.ms/arm-throttling for additional information.\\\"\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            },
        },
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73252107155963554304000
alert [svc] MaestroAgentMetricsProxyDown fired
full failure pattern:
alert [svc] MaestroAgentMetricsProxyDown fired
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)
alert11.30%1 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T22:07:54Z
  Severity:    Sev3
  Labels:      alertname="MaestroAgentMetricsProxyDown", cluster="ci01-j9785984-mgmt-2", component="monitoring-infrastructure", region="westus3", severity="3"
  Description: Prometheus has not scraped maestro-agent /metrics through the metrics-proxy sidecar (namespace=maestro, endpoint=metrics) for 10 minutes, while a kube-state-metrics scrape series still exists for this management cluster. Maestro agent metrics and any alerts that depend on them may be missing.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [svc] alert MaestroAgentMetricsProxyDown does not fire1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #68202107215529679785984
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServic...
full failure pattern:
ERROR CODE: InternalServerError; detail message cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster still exists; [clusterServiceStatus] state is "uninstalling"; [hostedCluster] HostedCluster still exists; [resourceTeardown] tearing down namespaces; [descendantResources] remaining resources: nodePools, serviceProviderClusters, serviceProviderNodePools; provider Microsoft.RedHatOpenShift
Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)
e2e11.30%1 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 1 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x3eb60aa820c0>: 
    resource group "rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cp-ystream-deny-pods-5-0-wsc7r8" in resourcegroup="rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3",
      "name": "d60bbb6e-33ce-417d-9990-65dcd65901f3",
      "status": "Failed",
      "startTime": "2026-10-05T21:11:20.151469184Z",
      "endTime": "2026-10-05T21:35:24.10560305Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x3eb60b558400>{
                msg: "resource group \"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x3eb60b5583c0>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x3eb60b5583a0>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x3eb60b558340>{
                            msg: "failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x3eb60c412720>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Server": [...],
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x3eb60b558200>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1087,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j8926720.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j8926720.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57bc760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:295]: Unexpected error:
    <*errors.joinError | 0x3eb60aa820c0>: 
    resource group "rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cp-ystream-deny-pods-5-0-wsc7r8" in resourcegroup="rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3",
      "name": "d60bbb6e-33ce-417d-9990-65dcd65901f3",
      "status": "Failed",
      "startTime": "2026-10-05T21:11:20.151469184Z",
      "endTime": "2026-10-05T21:35:24.10560305Z",
      "error": {
        "code": "InternalServerError",
        "message": "cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \"uninstalling\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        errs: [
            <*fmt.wrapError | 0x3eb60b558400>{
                msg: "resource group \"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\": failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                err: <*fmt.wrapError | 0x3eb60b5583c0>{
                    msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                    err: <*fmt.wrapError | 0x3eb60b5583a0>{
                        msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                        err: <*fmt.wrapError | 0x3eb60b558340>{
                            msg: "failed waiting for hcpCluster=\"cp-ystream-deny-pods-5-0-wsc7r8\" in resourcegroup=\"rg-cp-ystream-deny-pods-5-0-xrd7rn2dz7sv\" to finish deleting: GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            err: <*exported.ResponseError | 0x3eb60c412720>{
                                ErrorCode: "InternalServerError",
                                StatusCode: 200,
                                RawResponse: {
                                    Status: "200 OK",
                                    StatusCode: 200,
                                    Proto: "HTTP/2.0",
                                    ProtoMajor: 2,
                                    ProtoMinor: 0,
                                    Header: {
                                        "Server": [...],
                                        "Content-Type": [...],
                                        "X-Ms-Request-Id": [...],
                                        "Date": [...],
                                        "Content-Length": [...],
                                        "X-Envoy-Upstream-Service-Time": [...],
                                    },
                                    Body: <*exported.nopClosingBytesReader | 0x3eb60b558200>{
                                        s: [..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ..., ...],
                                        i: 0,
                                    },
                                    ContentLength: 1087,
                                    TransferEncoding: nil,
                                    Close: false,
                                    Uncompressed: false,
                                    Trailer: nil,
                                    Request: {
                                        Method: "GET",
                                        URL: {Scheme: ..., Opaque: ..., User: ..., Host: ..., Path: ..., Fragment: ..., RawQuery: ..., RawPath: ..., RawFragment: ..., ForceQuery: ..., OmitHost: ...},
                                        Proto: "HTTP/1.1",
                                        ProtoMajor: 1,
                                        ProtoMinor: 1,
                                        Header: {...: ..., ...: ..., ...: ..., ...: ..., ...: ..., ...: ...},
                                        Body: nil,
                                        GetBody: nil,
                                        ContentLength: 0,
                                        TransferEncoding: nil,
                                        Close: false,
                                        Host: "rp.j8926720.hcpsvc.osadev.cloud",
                                        Form: nil,
                                        PostForm: nil,
                                        MultipartForm: nil,
                                        Trailer: nil,
                                        RemoteAddr: "",
                                        RequestURI: "",
                                        TLS: nil,
                                        Cancel: nil,
                                        Response: nil,
                                        Pattern: "",
                                        ctx: <suppressed context>,
                                        pat: nil,
                                        matches: nil,
                                        otherValues: nil,
                                    },
                                    TLS: {
                                        Version: 772,
                                        HandshakeComplete: true,
                                        DidResume: false,
                                        CipherSuite: 4865,
                                        CurveID: 29,
                                        NegotiatedProtocol: "h2",
                                        NegotiatedProtocolIsMutual: true,
                                        ServerName: "rp.j8926720.hcpsvc.osadev.cloud",
                                        PeerCertificates: [...],
                                        VerifiedChains: nil,
                                        SignedCertificateTimestamps: nil,
                                        OCSPResponse: nil,
                                        TLSUnique: nil,
                                        ECHAccepted: false,
                                        HelloRetryRequest: false,
                                        ekm: 0x57bc760,
                                        testingOnlyPeerSignatureAlgorithm: 2052,
                                    },
                                },
                                errMsg: "GET https://rp.j8926720.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"name\": \"d60bbb6e-33ce-417d-9990-65dcd65901f3\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-10-05T21:11:20.151469184Z\",\n  \"endTime\": \"2026-10-05T21:35:24.10560305Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"cluster deletion did not complete before the deadline; [clusterServiceDeletion] ClusterService cluster /api/aro_hcp/v1alpha1/clusters/2t8rqeg64rdubkf4dn8i2cvdj9fkohjh still exists (deletion dispatched at 2026-10-05T21:11:20Z); [clusterServiceStatus] ClusterService state is \\\"uninstalling\\\"; [hostedCluster] HostedCluster still exists; [descendantResources] remaining resources: 1 Microsoft.RedHatOpenShift/hcpOpenShiftClusters/nodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/nodepools/serviceProviderNodePools, 1 microsoft.redhatopenshift/hcpopenshiftclusters/serviceProviderClusters; [resourceTeardown] tearing down namespaces (2)\"\n  }\n}\n--------------------------------------------------------------------------------\n",
                            },
                        },
                    },
                },
            },
        ],
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should upgrade control plane minor version when pods cannot be created from 4.22 minor to 5.0 minor1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #73492107193894448926720
alert [hcp] HCPClusterOperatorUnavailable fired
full failure pattern:
alert [hcp] HCPClusterOperatorUnavailable fired
Signal: IndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s)
alert11.30%1 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 1 prior week(s); active 2 day(s)Show trend detailsSep 29: 0 · Sep 30: 2 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
alert fired 1 time(s)
Firing 1:
  State:       Fired (not resolved)
  Started:     2026-10-05T02:45:49Z
  Severity:    Sev3
  Labels:      alertname="HCPClusterOperatorUnavailable", cluster="ci01-j0780544-mgmt-1", component="kubernetes-infrastructure", namespace="ocm-arohcpci01-2t8bd601duipv6rqvbm3to5tnsv67dll-d0u0b4t7n2l9k0b", region="westus3", severity="warning"
  Description: 2 cluster operator(s) on hosted cluster ocm-arohcpci01-2t8bd601duipv6rqvbm3to5tnsv67dll-d0u0b4t7n2l9k0b (management cluster ci01-j0780544-mgmt-1) have been reporting Available=false for more than 30 minutes. The version and console operators are excluded from this alert; the affected cluster has worker nodes present. An unavailable operator means the component it manages is down, not merely degraded.
Contributing tests (1)
Failed AtJobTestSupport
alertpull-ci-Azure-ARO-HCP-main-e2e-parallel[aro-hcp-observability] [hcp] alert HCPClusterOperatorUnavailable does not fire1
Affected runs (1)
Date (UTC)Associated PRProw job
PR #71782106913296060780544
failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded
full failure pattern:
failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)
e2e11.30%1 of 77 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)Show trend detailsSep 29: 0 · Sep 30: 0 · Oct 1: 0 · Oct 2: 0 · Oct 3: 0 · Oct 4: 0 · Oct 5: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:198]: failed to create node pool version 4.20.32 for back-level cluster
Unexpected error:
    <*fmt.wrapError | 0x1875a59d7800>: 
    failed waiting for nodepool="np-ver-4-20-32" for cluster "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-bmqkjhjjvzkv" to finish creating: context deadline exceeded
    {
        msg: "failed waiting for nodepool=\"np-ver-4-20-32\" for cluster \"cluster-ver-4-20\" in resourcegroup=\"rg-cluster-back-version-bmqkjhjjvzkv\" to finish creating: context deadline exceeded",
        err: <context.deadlineExceededError>{},
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:198]: failed to create node pool version 4.20.32 for back-level cluster
Unexpected error:
    <*fmt.wrapError | 0x1875a59d7800>: 
    failed waiting for nodepool="np-ver-4-20-32" for cluster "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-bmqkjhjjvzkv" to finish creating: context deadline exceeded
    {
        msg: "failed waiting for nodepool=\"np-ver-4-20-32\" for cluster \"cluster-ver-4-20\" in resourcegroup=\"rg-cluster-back-version-bmqkjhjjvzkv\" to finish creating: context deadline exceeded",
        err: <context.deadlineExceededError>{},
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2epull-ci-Azure-ARO-HCP-main-e2e-parallelCustomer should be able to create an HCP cluster with back-level version 4.201
Affected runs (1)
Date (UTC)Associated PRProw job
PR #71772107187025571483648