time=2026-02-25T00:44:40.468Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.RP.HypershiftOperator resourceGroup=global step=mirror-image description="Step mirror-image\n  Kind: ImageMirror\n  From {<nil> hypershift.image.registry <nil>}:{<nil> hypershift.image.repository <nil>}@{<nil> hypershift.image.digest <nil>} to {<nil> acr.svc.name <nil>}\n"
time=2026-02-25T00:44:41.888Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.RP.HypershiftOperator resourceGroup=global step=mirror-image err="error running Image Mirror Step, failed to execute shell command: Checking USE_OC_LOGIN_REGISTRIES: registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org\nFetch pull secret for source registry quay.io from arohcpdev-global KV.\nERROR: Invalid base64-encoded string: number of data characters (1325) cannot be 1 more than a multiple of 4\n exit status 1"

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0007ee228>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-5qr9x4" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc0007b93c0>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-5qr9x4\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0007b93a0>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-5qr9x4\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0007b9380>{
                        msg: "failed waiting for hcpCluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-5qr9x4\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0007ee228>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-5qr9x4" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc0007b93c0>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-5qr9x4\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0007b93a0>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-5qr9x4\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0007b9380>{
                        msg: "failed waiting for hcpCluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-5qr9x4\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00086a390>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-2c29mp" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc0006c1460>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-2c29mp\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0006c1440>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-2c29mp\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0006c1420>{
                        msg: "failed waiting for hcpCluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-2c29mp\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00086a390>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-2c29mp" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc0006c1460>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-2c29mp\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0006c1440>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-2c29mp\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0006c1420>{
                        msg: "failed waiting for hcpCluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-2c29mp\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:152]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e6dad0>: 
    failed waiting for nodepool="np-update-nodes" in cluster="np-update-nodes-hcp-cluster" resourcegroup="nodepool-update-nodes-t68zzs" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-update-nodes in cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-t68zzs, error: context deadline exceeded
    {
        msg: "failed waiting for nodepool=\"np-update-nodes\" in cluster=\"np-update-nodes-hcp-cluster\" resourcegroup=\"nodepool-update-nodes-t68zzs\" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-update-nodes in cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-t68zzs, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0003c8870>{
                s: "timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-update-nodes in cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-t68zzs",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:152]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e6dad0>: 
    failed waiting for nodepool="np-update-nodes" in cluster="np-update-nodes-hcp-cluster" resourcegroup="nodepool-update-nodes-t68zzs" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-update-nodes in cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-t68zzs, error: context deadline exceeded
    {
        msg: "failed waiting for nodepool=\"np-update-nodes\" in cluster=\"np-update-nodes-hcp-cluster\" resourcegroup=\"nodepool-update-nodes-t68zzs\" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-update-nodes in cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-t68zzs, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0003c8870>{
                s: "timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-update-nodes in cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-t68zzs",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0004da258>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="list-test-cluster-kwzbqb" in resourcegroup="cluster-listing-662rkp" to finish deleting: context canceled
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="list-test-cluster-ql7rlm" in resourcegroup="cluster-listing-d4p6qb" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc00040a180>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-kwzbqb\" in resourcegroup=\"cluster-listing-662rkp\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc00040a160>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-kwzbqb\" in resourcegroup=\"cluster-listing-662rkp\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc00040a120>{
                        msg: "failed waiting for hcpCluster=\"list-test-cluster-kwzbqb\" in resourcegroup=\"cluster-listing-662rkp\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
            <*fmt.wrapError | 0xc0007c9300>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-ql7rlm\" in resourcegroup=\"cluster-listing-d4p6qb\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0007c92e0>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-ql7rlm\" in resourcegroup=\"cluster-listing-d4p6qb\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0007c92c0>{
                        msg: "failed waiting for hcpCluster=\"list-test-cluster-ql7rlm\" in resourcegroup=\"cluster-listing-d4p6qb\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0004da258>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="list-test-cluster-kwzbqb" in resourcegroup="cluster-listing-662rkp" to finish deleting: context canceled
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="list-test-cluster-ql7rlm" in resourcegroup="cluster-listing-d4p6qb" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc00040a180>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-kwzbqb\" in resourcegroup=\"cluster-listing-662rkp\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc00040a160>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-kwzbqb\" in resourcegroup=\"cluster-listing-662rkp\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc00040a120>{
                        msg: "failed waiting for hcpCluster=\"list-test-cluster-kwzbqb\" in resourcegroup=\"cluster-listing-662rkp\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
            <*fmt.wrapError | 0xc0007c9300>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-ql7rlm\" in resourcegroup=\"cluster-listing-d4p6qb\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0007c92e0>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"list-test-cluster-ql7rlm\" in resourcegroup=\"cluster-listing-d4p6qb\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0007c92c0>{
                        msg: "failed waiting for hcpCluster=\"list-test-cluster-ql7rlm\" in resourcegroup=\"cluster-listing-d4p6qb\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0009de330>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-listkct9lt" in resourcegroup="ea-list-vk44sl" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc0007f3380>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listkct9lt\" in resourcegroup=\"ea-list-vk44sl\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0007f3360>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listkct9lt\" in resourcegroup=\"ea-list-vk44sl\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0007f3340>{
                        msg: "failed waiting for hcpCluster=\"ea-listkct9lt\" in resourcegroup=\"ea-list-vk44sl\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0009de330>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="ea-listkct9lt" in resourcegroup="ea-list-vk44sl" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc0007f3380>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listkct9lt\" in resourcegroup=\"ea-list-vk44sl\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc0007f3360>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"ea-listkct9lt\" in resourcegroup=\"ea-list-vk44sl\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc0007f3340>{
                        msg: "failed waiting for hcpCluster=\"ea-listkct9lt\" in resourcegroup=\"ea-list-vk44sl\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
    <*fmt.wrapError | 0xc000619500>: 
    failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-zjtpjf": PUT https://rp.j0702592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB
    --------------------------------------------------------------------------------
    RESPONSE 409: 409 Conflict
    ERROR CODE: Conflict
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "Conflict",
        "message": "Cannot create resource while parent resource is provisioning",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-zjtpjf\": PUT https://rp.j0702592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"Conflict\",\n    \"message\": \"Cannot create resource while parent resource is provisioning\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc0006194e0>{
            msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-zjtpjf\": PUT https://rp.j0702592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"Conflict\",\n    \"message\": \"Cannot create resource while parent resource is provisioning\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc000a85320>{
                ErrorCode: "Conflict",
                StatusCode: 409,
                RawResponse: {
                    Status: "409 Conflict",
                    StatusCode: 409,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Date": [
                            "Tue, 24 Feb 2026 22:07:01 GMT",
                        ],
                        "Content-Length": ["344"],
                        "X-Envoy-Upstream-Service-Time": ["112"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Error-Code": ["Conflict"],
                        "X-Ms-Request-Id": [
                            "4576eeac-3dc2-44fb-828d-c92ae89a64b9",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0xc0006193e0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 99, 114, 101, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 112, 97, 114, 101, 110, 116, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
    <*fmt.wrapError | 0xc000619500>: 
    failed to create NodePool nodepool-128GiB: failed starting nodepool creation "nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-zjtpjf": PUT https://rp.j0702592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB
    --------------------------------------------------------------------------------
    RESPONSE 409: 409 Conflict
    ERROR CODE: Conflict
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "Conflict",
        "message": "Cannot create resource while parent resource is provisioning",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create NodePool nodepool-128GiB: failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-zjtpjf\": PUT https://rp.j0702592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"Conflict\",\n    \"message\": \"Cannot create resource while parent resource is provisioning\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc0006194e0>{
            msg: "failed starting nodepool creation \"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-zjtpjf\": PUT https://rp.j0702592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: Conflict\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"Conflict\",\n    \"message\": \"Cannot create resource while parent resource is provisioning\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-zjtpjf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128/nodePools/nodepool-128GiB\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc000a85320>{
                ErrorCode: "Conflict",
                StatusCode: 409,
                RawResponse: {
                    Status: "409 Conflict",
                    StatusCode: 409,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "Date": [
                            "Tue, 24 Feb 2026 22:07:01 GMT",
                        ],
                        "Content-Length": ["344"],
                        "X-Envoy-Upstream-Service-Time": ["112"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                        "X-Ms-Error-Code": ["Conflict"],
                        "X-Ms-Request-Id": [
                            "4576eeac-3dc2-44fb-828d-c92ae89a64b9",
                        ],
                    },
                    Body: <*exported.nopClosingBytesReader | 0xc0006193e0>{
                        s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 67, 111, 110, 102, 108, 105, 99, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 67, 97, 110, 110, 111, 116, 32, 99, 114, 101, 97, 116, 101, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 119, 104, 105, 108, 101, 32, 112, 97, 114, 101, 110, 116, 32, 114, 101, 115, 111, 117, 114, 99, 101, 32, 105, 115, 32, 112, 114, 111, 118, 105, 115, 105, 111, 110, 105, 110, 103, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0006cac30>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-6nngrz" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000a99320>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-6nngrz\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000a99300>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-6nngrz\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000a992e0>{
                        msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-6nngrz\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0006cac30>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-6nngrz" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000a99320>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-6nngrz\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000a99300>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-6nngrz\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000a992e0>{
                        msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-6nngrz\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000b86198>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-qkd4rj" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000491860>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-qkd4rj\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000491820>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-qkd4rj\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000491800>{
                        msg: "failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-qkd4rj\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000b86198>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-qkd4rj" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000491860>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-qkd4rj\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000491820>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-qkd4rj\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000491800>{
                        msg: "failed waiting for hcpCluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-qkd4rj\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000fba138>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-lwnzr6" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000e28d20>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-lwnzr6\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000e28d00>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-lwnzr6\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000e28ce0>{
                        msg: "failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-lwnzr6\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000fba138>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-lwnzr6" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000e28d20>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-lwnzr6\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000e28d00>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-lwnzr6\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000e28ce0>{
                        msg: "failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-lwnzr6\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0008a01c8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-42sq82" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000abae80>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-42sq82\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000abae60>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-42sq82\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000abae40>{
                        msg: "failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-42sq82\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc0008a01c8>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-42sq82" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000abae80>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-42sq82\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000abae60>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-42sq82\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000abae40>{
                        msg: "failed waiting for hcpCluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-42sq82\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0x8207c70>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:174]: Unexpected error:
    <*errors.joinError | 0xc00081b500>: 
    VerifyBasicAccess failed: failed to list services: the server was unable to return a response in the time allotted, but may still be processing the request (get services)
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)
    {
        errs: [
            <*fmt.wrapError | 0xc0003da100>{
                msg: "VerifyBasicAccess failed: failed to list services: the server was unable to return a response in the time allotted, but may still be processing the request (get services)",
                err: <*fmt.wrapError | 0xc0003da0e0>{
                    msg: "failed to list services: the server was unable to return a response in the time allotted, but may still be processing the request (get services)",
                    err: <*errors.StatusError | 0xc000daf7c0>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                            },
                            Status: "Failure",
                            Message: "the server was unable to return a response in the time allotted, but may still be processing the request (get services)",
                            Reason: "Timeout",
                            Details: {
                                Name: "",
                                Group: "",
                                Kind: "services",
                                UID: "",
                                Causes: [
                                    {
                                        Type: "UnexpectedServerResponse",
                                        Message: "{\"metadata\":{},\"status\":\"Failure\",\"message\":\"Timeout: request did not complete within the allotted timeout\",\"reason\":\"Timeout\",\"details\":{},\"code\":504}",
                                        Field: "",
                                    },
                                ],
                                RetryAfterSeconds: 0,
                            },
                            Code: 504,
                        },
                    },
                },
            },
            <*fmt.wrapError | 0xc0003da1c0>{
                msg: "VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)",
                err: <*fmt.wrapError | 0xc0003da160>{
                    msg: "failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)",
                    err: <*errors.StatusError | 0xc000daf900>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                            },
                            Status: "Failure",
                            Message: "the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)",
                            Reason: "Timeout",
                            Details: {
                                Name: "",
                                Group: "apiregistration.k8s.io",
                                Kind: "apiservices",
                                UID: "",
                                Causes: [
                                    {
                                        Type: "UnexpectedServerResponse",
                                        Message: "{\"metadata\":{},\"status\":\"Failure\",\"message\":\"Timeout: request did not complete within the allotted timeout\",\"reason\":\"Timeout\",\"details\":{},\"code\":504}",
                  ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:174]: Unexpected error:
    <*errors.joinError | 0xc00081b500>: 
    VerifyBasicAccess failed: failed to list services: the server was unable to return a response in the time allotted, but may still be processing the request (get services)
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)
    {
        errs: [
            <*fmt.wrapError | 0xc0003da100>{
                msg: "VerifyBasicAccess failed: failed to list services: the server was unable to return a response in the time allotted, but may still be processing the request (get services)",
                err: <*fmt.wrapError | 0xc0003da0e0>{
                    msg: "failed to list services: the server was unable to return a response in the time allotted, but may still be processing the request (get services)",
                    err: <*errors.StatusError | 0xc000daf7c0>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                            },
                            Status: "Failure",
                            Message: "the server was unable to return a response in the time allotted, but may still be processing the request (get services)",
                            Reason: "Timeout",
                            Details: {
                                Name: "",
                                Group: "",
                                Kind: "services",
                                UID: "",
                                Causes: [
                                    {
                                        Type: "UnexpectedServerResponse",
                                        Message: "{\"metadata\":{},\"status\":\"Failure\",\"message\":\"Timeout: request did not complete within the allotted timeout\",\"reason\":\"Timeout\",\"details\":{},\"code\":504}",
                                        Field: "",
                                    },
                                ],
                                RetryAfterSeconds: 0,
                            },
                            Code: 504,
                        },
                    },
                },
            },
            <*fmt.wrapError | 0xc0003da1c0>{
                msg: "VerifyAllAPIServicesAvailable failed: failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)",
                err: <*fmt.wrapError | 0xc0003da160>{
                    msg: "failed to list all APIServices: the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)",
                    err: <*errors.StatusError | 0xc000daf900>{
                        ErrStatus: {
                            TypeMeta: {Kind: "", APIVersion: ""},
                            ListMeta: {
                                SelfLink: "",
                                ResourceVersion: "",
                                Continue: "",
                                RemainingItemCount: nil,
                            },
                            Status: "Failure",
                            Message: "the server was unable to return a response in the time allotted, but may still be processing the request (get apiservices.apiregistration.k8s.io)",
                            Reason: "Timeout",
                            Details: {
                                Name: "",
                                Group: "apiregistration.k8s.io",
                                Kind: "apiservices",
                                UID: "",
                                Causes: [
                                    {
                                        Type: "UnexpectedServerResponse",
                                        Message: "{\"metadata\":{},\"status\":\"Failure\",\"message\":\"Timeout: request did not complete within the allotted timeout\",\"reason\":\"Timeout\",\"details\":{},\"code\":504}",
                  ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.000s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.000s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty

time=2026-02-24T14:08:41.071Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n  Kind: ARM\n  Template: templates/region.bicep\n  Parameters: configurations/region.tmpl.bicepparam"
time=2026-02-24T14:08:43.087Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-02-24T14:08:44.472Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=645e88137942f0c1c75f8c92a38bb815b14e4910e34e71fec6780bd57ceaeb9f
time=2026-02-24T14:10:15.184Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j2748032/providers/Microsoft.Resources/deployments/645e88137942f0c1c75f8c92a38bb815b14e4910e34e71fec6780bd57ceaeb9f/operationStatuses/08584296647616888410\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j2748032/providers/Microsoft.Resources/deployments/maestro-infra-deployment\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n            \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j2748032/providers/Microsoft.EventGrid/namespaces/arohcp-prow-maestro-j2748032\\\",\\r\\n            \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n            \\\"details\\\": [\\r\\n              {\\r\\n                \\\"code\\\": \\\"Internal error\\\",\\r\\n                \\\"message\\\": \\\"The operation failed due to an internal server error. The initial state of the impacted resources (if any) are restored. Please try again in few minutes. If error still persists, report 958c15d6-8a37-46fc-ab58-2a84970569a3:2/24/2026 2:09:48 PM (UTC) to our forums for assistance or raise a support ticket .\\\"\\r\\n              }\\r\\n            ]\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.006s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.006s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty

fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.014s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc000546440>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc000546420>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc000546400>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc0005463e0>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000706af0>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000488360>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.014s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc000546440>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc000546420>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc000546400>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc0005463e0>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000706af0>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000488360>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }

fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.021s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc0008202a0>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc000820280>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc000820260>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc000820240>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000668550>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc0008e4150>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.021s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc0008202a0>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc000820280>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc000820260>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc000820240>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000668550>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc0008e4150>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }

fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.003s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc00070e360>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc00070e320>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc00070e300>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc00070e2e0>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000468a50>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc0004e2550>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.003s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc00070e360>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc00070e320>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc00070e300>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc00070e2e0>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000468a50>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc0004e2550>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }

time=2026-02-24T12:07:50.250Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output description="Step output\n  Kind: ARM\n  Template: templates/kusto-lookup.bicep\n  Parameters: configurations/kusto-lookup.tmpl.bicepparam"
time=2026-02-24T12:07:51.175Z level=DEBUG+2 msg="Waiting for existing deployment to complete" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output deployment=ef2bb3355bd54675e90926b2ffd43526b0e1367038533fb09dcdc29269b1ddf2
time=2026-02-24T12:07:51.175Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output err="failed to run ARM step: failed to poll previously-existing deployment: pre-existing deployment failed: {\"code\":\"DeploymentFailed\",\"details\":[{\"code\":\"ResourceNotFound\",\"message\":\"The Resource 'Microsoft.Kusto/clusters/hcp-dev-us' under resource group 'hcp-kusto-us' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix\"}],\"message\":\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\"}"

time=2026-02-24T12:11:25.801Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output description="Step output\n  Kind: ARM\n  Template: templates/kusto-lookup.bicep\n  Parameters: configurations/kusto-lookup.tmpl.bicepparam"
time=2026-02-24T12:11:26.577Z level=DEBUG+2 msg="Waiting for existing deployment to complete" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output deployment=ef2bb3355bd54675e90926b2ffd43526b0e1367038533fb09dcdc29269b1ddf2
time=2026-02-24T12:11:26.577Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output err="failed to run ARM step: failed to poll previously-existing deployment: pre-existing deployment failed: {\"code\":\"DeploymentFailed\",\"details\":[{\"code\":\"ResourceNotFound\",\"message\":\"The Resource 'Microsoft.Kusto/clusters/hcp-dev-us' under resource group 'hcp-kusto-us' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix\"}],\"message\":\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\"}"

time=2026-02-24T12:03:16.907Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output description="Step output\n  Kind: ARM\n  Template: templates/kusto-lookup.bicep\n  Parameters: configurations/kusto-lookup.tmpl.bicepparam"
time=2026-02-24T12:03:18.043Z level=DEBUG+2 msg="Waiting for existing deployment to complete" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output deployment=ef2bb3355bd54675e90926b2ffd43526b0e1367038533fb09dcdc29269b1ddf2
time=2026-02-24T12:03:18.043Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output err="failed to run ARM step: failed to poll previously-existing deployment: pre-existing deployment failed: {\"code\":\"DeploymentFailed\",\"details\":[{\"code\":\"ResourceNotFound\",\"message\":\"The Resource 'Microsoft.Kusto/clusters/hcp-dev-us' under resource group 'hcp-kusto-us' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix\"}],\"message\":\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\"}"

time=2026-02-24T12:04:38.312Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output description="Step output\n  Kind: ARM\n  Template: templates/kusto-lookup.bicep\n  Parameters: configurations/kusto-lookup.tmpl.bicepparam"
time=2026-02-24T12:04:39.352Z level=DEBUG+2 msg="Waiting for existing deployment to complete" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output deployment=ef2bb3355bd54675e90926b2ffd43526b0e1367038533fb09dcdc29269b1ddf2
time=2026-02-24T12:04:39.352Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output err="failed to run ARM step: failed to poll previously-existing deployment: pre-existing deployment failed: {\"code\":\"DeploymentFailed\",\"details\":[{\"code\":\"ResourceNotFound\",\"message\":\"The Resource 'Microsoft.Kusto/clusters/hcp-dev-us' under resource group 'hcp-kusto-us' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix\"}],\"message\":\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\"}"

time=2026-02-24T11:50:43.440Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=kusto step=output description="Step output\n  Kind: ARM\n  Template: templates/kusto-lookup.bicep\n  Parameters: configurations/kusto-lookup.tmpl.bicepparam"
time=2026-02-24T11:50:44.522Z level=DEBUG+2 msg="Waiting for existing deployment to complete" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=kusto step=output deployment=ef2bb3355bd54675e90926b2ffd43526b0e1367038533fb09dcdc29269b1ddf2
time=2026-02-24T11:50:59.676Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=kusto step=output err="failed to run ARM step: failed to poll previously-existing deployment: pre-existing deployment failed: {\"code\":\"DeploymentFailed\",\"details\":[{\"code\":\"ResourceNotFound\",\"message\":\"The Resource 'Microsoft.Kusto/clusters/hcp-dev-us' under resource group 'hcp-kusto-us' was not found. For more details please go to https://aka.ms/ARMResourceNotFoundFix\"}],\"message\":\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\"}"

time=2026-02-24T11:04:02.598Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output description="Step output\n  Kind: ARM\n  Template: templates/kusto-lookup.bicep\n  Parameters: configurations/kusto-lookup.tmpl.bicepparam"
time=2026-02-24T11:04:03.193Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=kusto step=output err="failed to run ARM step: failed to ensure resource group exists: failed to update resource group: PATCH https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-kusto-us\n--------------------------------------------------------------------------------\nRESPONSE 409: 409 Conflict\nERROR CODE: ResourceGroupBeingDeleted\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"ResourceGroupBeingDeleted\",\n    \"message\": \"The resource group 'hcp-kusto-us' is in deprovisioning state and cannot perform this operation.\"\n  }\n}\n--------------------------------------------------------------------------------\n"

fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.006s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc00050e2c0>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc00050e2a0>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc00050e260>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc00050e220>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc0007b8410>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000788150>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.006s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc00050e2c0>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc00050e2a0>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc00050e260>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc00050e220>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc0007b8410>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000788150>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty

fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.000s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc0002b8380>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc0002b8360>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc0002b8340>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc0002b8320>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc00057e460>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000592340>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.000s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc0002b8380>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc0002b8360>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc0002b8340>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc0002b8320>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc00057e460>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000592340>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }

fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.025s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc000450980>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc000450960>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc000450940>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc000450920>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000219860>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000ac0690>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:94]: Timed out after 600.025s.
Expected success, but got an error:
    <*fmt.wrapError | 0xc000450980>: 
    failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get "https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host
    {
        msg: "failed to gather logs: failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
        err: <*fmt.wrapError | 0xc000450960>{
            msg: "failed to execute cluster id query: failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
            err: <*fmt.wrapError | 0xc000450940>{
                msg: "failed to execute query: failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                err: <*fmt.wrapError | 0xc000450920>{
                    msg: "failed to execute query: Op(OpQuery): Kind(KInternal): Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                    err: <*errors.Error | 0xc000219860>{
                        Op: 1,
                        Kind: 2,
                        Err: <*errors.errorString | 0xc000ac0690>{
                            s: "Error while getting token : Get \"https://hcp-dev-us.westus3.kusto.windows.net/v1/rest/auth/metadata\": dial tcp: lookup hcp-dev-us.westus3.kusto.windows.net on 172.30.0.10:53: no such host",
                        },
                        restErrMsg: nil,
                        decoded: nil,
                        permanent: false,
                        inner: nil,
                    },
                },
            },
        },
    }

time=2026-02-24T10:11:41.439Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n  Kind: ARM\n  Template: templates/region.bicep\n  Parameters: configurations/region.tmpl.bicepparam"
time=2026-02-24T10:11:43.660Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-02-24T10:11:44.982Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=7fff49384223067a0cd4bbfa8818f0c2e75c1458baa6f8b6dbbe4b51459c4294
time=2026-02-24T10:13:15.687Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j6839424/providers/Microsoft.Resources/deployments/7fff49384223067a0cd4bbfa8818f0c2e75c1458baa6f8b6dbbe4b51459c4294/operationStatuses/08584296789812118124\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j6839424/providers/Microsoft.Resources/deployments/maestro-infra-deployment\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n            \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j6839424/providers/Microsoft.EventGrid/namespaces/arohcp-prow-maestro-j6839424\\\",\\r\\n            \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n            \\\"details\\\": [\\r\\n              {\\r\\n                \\\"code\\\": \\\"Internal error\\\",\\r\\n                \\\"message\\\": \\\"The operation failed due to an internal server error. The initial state of the impacted resources (if any) are restored. Please try again in few minutes. If error still persists, report 20dad687-6e1b-4d0b-a70f-27514e6b7907:2/24/2026 10:12:51 AM (UTC) to our forums for assistance or raise a support ticket .\\\"\\r\\n              }\\r\\n            ]\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.002s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.002s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:363]: Timed out after 300.003s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:348 with:
kubectl should execute successfully from authorized VM with OIDC token
Unexpected error:
    <*errors.errorString | 0xc0003c11c0>: 
    E0224 10:28:18.503461    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.525465    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.560136    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.585322    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.623097    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    error: You must be logged in to the server (the server has asked for the client to provide credentials)
    {
        s: "E0224 10:28:18.503461    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.525465    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.560136    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.585322    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.623097    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nerror: You must be logged in to the server (the server has asked for the client to provide credentials)",
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:363]: Timed out after 300.003s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:348 with:
kubectl should execute successfully from authorized VM with OIDC token
Unexpected error:
    <*errors.errorString | 0xc0003c11c0>: 
    E0224 10:28:18.503461    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.525465    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.560136    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.585322    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 10:28:18.623097    2537 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    error: You must be logged in to the server (the server has asked for the client to provide credentials)
    {
        s: "E0224 10:28:18.503461    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.525465    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.560136    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.585322    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 10:28:18.623097    2537 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nerror: You must be logged in to the server (the server has asked for the client to provide credentials)",
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:251]: Unexpected error:
    <*fmt.wrapErrors | 0xc00060ca20>: 
    failed waiting for hcpCluster="admin-cred-lifecycle-h8shdn" in resourcegroup="admin-credential-lifecycle-test-bbqrmn" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-h8shdn in resource group admin-credential-lifecycle-test-bbqrmn, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-h8shdn\" in resourcegroup=\"admin-credential-lifecycle-test-bbqrmn\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-h8shdn in resource group admin-credential-lifecycle-test-bbqrmn, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0003ff770>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-h8shdn in resource group admin-credential-lifecycle-test-bbqrmn",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:251]: Unexpected error:
    <*fmt.wrapErrors | 0xc00060ca20>: 
    failed waiting for hcpCluster="admin-cred-lifecycle-h8shdn" in resourcegroup="admin-credential-lifecycle-test-bbqrmn" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-h8shdn in resource group admin-credential-lifecycle-test-bbqrmn, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"admin-cred-lifecycle-h8shdn\" in resourcegroup=\"admin-credential-lifecycle-test-bbqrmn\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-h8shdn in resource group admin-credential-lifecycle-test-bbqrmn, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0003ff770>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster admin-cred-lifecycle-h8shdn in resource group admin-credential-lifecycle-test-bbqrmn",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:363]: Timed out after 300.002s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:348 with:
kubectl should execute successfully from authorized VM with OIDC token
Unexpected error:
    <*errors.errorString | 0xc0003c9880>: 
    E0224 09:17:27.844729    2565 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 09:17:27.885018    2565 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    {
        s: "E0224 09:17:27.844729    2565 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 09:17:27.885018    2565 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"",
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:363]: Timed out after 300.002s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:348 with:
kubectl should execute successfully from authorized VM with OIDC token
Unexpected error:
    <*errors.errorString | 0xc0003c9880>: 
    E0224 09:17:27.844729    2565 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    E0224 09:17:27.885018    2565 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: the server has asked for the client to provide credentials"
    {
        s: "E0224 09:17:27.844729    2565 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"\nE0224 09:17:27.885018    2565 memcache.go:265] \"Unhandled Error\" err=\"couldn't get current server API group list: the server has asked for the client to provide credentials\"",
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc000ac3480>: 
    cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc000ac3480>: 
    cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=False, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False), monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc00091f2b0>: 
    cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc00091f2b0>: 
    cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.002s.
NFD operator should be installed successfully
Expected success, but got an error:
    <*errors.errorString | 0xc0003c8e70>: 
    subscription state not found
    {
        s: "subscription state not found",
    }
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:314]: Timed out after 300.002s.
NFD operator should be installed successfully
Expected success, but got an error:
    <*errors.errorString | 0xc0003c8e70>: 
    subscription state not found
    {
        s: "subscription state not found",
    }

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.001s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.001s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013557a0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-58gc97" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-58gc97\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e828b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97",
            },
            <*fmt.wrapErrors | 0xc001355770>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-58gc97\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000e828b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013557a0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-58gc97" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-58gc97\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e828b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97",
            },
            <*fmt.wrapErrors | 0xc001355770>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-58gc97\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000e828b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-58gc97",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc000f9ad50>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-724pjh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-724pjh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001203090>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh",
            },
            <*fmt.wrapErrors | 0xc000f9ad20>{
                msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-724pjh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001203090>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc000f9ad50>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-724pjh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-724pjh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001203090>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh",
            },
            <*fmt.wrapErrors | 0xc000f9ad20>{
                msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-724pjh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001203090>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-724pjh",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010b2ff0>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-wv4tbg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-wv4tbg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f65570>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg",
            },
            <*fmt.wrapErrors | 0xc0010b2fc0>{
                msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-wv4tbg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f65570>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010b2ff0>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-wv4tbg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-wv4tbg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f65570>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg",
            },
            <*fmt.wrapErrors | 0xc0010b2fc0>{
                msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-wv4tbg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f65570>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-wv4tbg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013bbad0>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-c7f5pf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-c7f5pf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f41650>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf",
            },
            <*fmt.wrapErrors | 0xc0013bbaa0>{
                msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-c7f5pf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f41650>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013bbad0>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-c7f5pf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-c7f5pf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f41650>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf",
            },
            <*fmt.wrapErrors | 0xc0013bbaa0>{
                msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-c7f5pf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f41650>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-c7f5pf",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014db380>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-qpllgl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-qpllgl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00148fc70>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl",
            },
            <*fmt.wrapErrors | 0xc0014db350>{
                msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-qpllgl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00148fc70>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014db380>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-qpllgl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-qpllgl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00148fc70>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl",
            },
            <*fmt.wrapErrors | 0xc0014db350>{
                msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-qpllgl\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00148fc70>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-qpllgl",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014077a0>: 
    failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-w4gvsk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-w4gvsk, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-w4gvsk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-w4gvsk, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001756630>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-w4gvsk",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:147]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014077a0>: 
    failed waiting for cluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-w4gvsk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-w4gvsk, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-w4gvsk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-w4gvsk, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001756630>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterAndWait for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-w4gvsk",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d50b70>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-vn9dfj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-vn9dfj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010e7ed0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj",
            },
            <*fmt.wrapErrors | 0xc000d50b40>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-vn9dfj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0010e7ed0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d50b70>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-vn9dfj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-vn9dfj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010e7ed0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj",
            },
            <*fmt.wrapErrors | 0xc000d50b40>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-vn9dfj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0010e7ed0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-vn9dfj",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a93800>: 
    failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-95hl55" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-95hl55\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00100f430>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55",
            },
            <*fmt.wrapErrors | 0xc000a937a0>{
                msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-95hl55\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00100f430>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a93800>: 
    failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-95hl55" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-95hl55\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00100f430>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55",
            },
            <*fmt.wrapErrors | 0xc000a937a0>{
                msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-95hl55\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00100f430>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-95hl55",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc00101d7d0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-kqzftd" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-kqzftd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001090bb0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd",
            },
            <*fmt.wrapErrors | 0xc00101d7a0>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-kqzftd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001090bb0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc00101d7d0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-kqzftd" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-kqzftd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001090bb0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd",
            },
            <*fmt.wrapErrors | 0xc00101d7a0>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-kqzftd\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001090bb0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-kqzftd",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc001113770>: 
    failed to create HCP cluster list-test-cluster-8qm5tq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: failed waiting for cluster="list-test-cluster-8qm5tq" in resourcegroup="cluster-listing-jqq548" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-8qm5tq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: failed waiting for cluster=\"list-test-cluster-8qm5tq\" in resourcegroup=\"cluster-listing-jqq548\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000eadd00>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548",
            },
            <*fmt.wrapErrors | 0xc001113740>{
                msg: "failed waiting for cluster=\"list-test-cluster-8qm5tq\" in resourcegroup=\"cluster-listing-jqq548\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000eadd00>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc001113770>: 
    failed to create HCP cluster list-test-cluster-8qm5tq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: failed waiting for cluster="list-test-cluster-8qm5tq" in resourcegroup="cluster-listing-jqq548" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-8qm5tq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: failed waiting for cluster=\"list-test-cluster-8qm5tq\" in resourcegroup=\"cluster-listing-jqq548\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000eadd00>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548",
            },
            <*fmt.wrapErrors | 0xc001113740>{
                msg: "failed waiting for cluster=\"list-test-cluster-8qm5tq\" in resourcegroup=\"cluster-listing-jqq548\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000eadd00>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-8qm5tq in resource group cluster-listing-jqq548",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc0006def60>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-q68hjv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-q68hjv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0008429c0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv",
            },
            <*fmt.wrapErrors | 0xc0006def30>{
                msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-q68hjv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0008429c0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc0006def60>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-q68hjv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-q68hjv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0008429c0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv",
            },
            <*fmt.wrapErrors | 0xc0006def30>{
                msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-q68hjv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0008429c0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-q68hjv",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc00046f2f0>: 
    failed to create HCP cluster ea-listkmgjtd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: failed waiting for cluster="ea-listkmgjtd" in resourcegroup="ea-list-8t8xnr" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-listkmgjtd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: failed waiting for cluster=\"ea-listkmgjtd\" in resourcegroup=\"ea-list-8t8xnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000fd5500>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr",
            },
            <*fmt.wrapErrors | 0xc00046e4b0>{
                msg: "failed waiting for cluster=\"ea-listkmgjtd\" in resourcegroup=\"ea-list-8t8xnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000fd5500>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc00046f2f0>: 
    failed to create HCP cluster ea-listkmgjtd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: failed waiting for cluster="ea-listkmgjtd" in resourcegroup="ea-list-8t8xnr" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-listkmgjtd, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: failed waiting for cluster=\"ea-listkmgjtd\" in resourcegroup=\"ea-list-8t8xnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000fd5500>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr",
            },
            <*fmt.wrapErrors | 0xc00046e4b0>{
                msg: "failed waiting for cluster=\"ea-listkmgjtd\" in resourcegroup=\"ea-list-8t8xnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000fd5500>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listkmgjtd in resource group ea-list-8t8xnr",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc00104e8d0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-x98hnq" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-x98hnq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00119cc60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq",
            },
            <*fmt.wrapErrors | 0xc00104e8a0>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-x98hnq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00119cc60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc00104e8d0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-x98hnq" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-x98hnq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00119cc60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq",
            },
            <*fmt.wrapErrors | 0xc00104e8a0>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-x98hnq\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00119cc60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-x98hnq",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:35]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:35]: Interrupted by User

fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:87]: Unexpected error:
    <*fmt.wrapErrors | 0xc000cc5c80>: 
    failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: failed waiting for cluster="engineering-hcp-cluster" in resourcegroup="kusto-logs-vt2pgg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-vt2pgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0013c5330>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg",
            },
            <*fmt.wrapErrors | 0xc000cc5c50>{
                msg: "failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-vt2pgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0013c5330>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:87]: Unexpected error:
    <*fmt.wrapErrors | 0xc000cc5c80>: 
    failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: failed waiting for cluster="engineering-hcp-cluster" in resourcegroup="kusto-logs-vt2pgg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-vt2pgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0013c5330>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg",
            },
            <*fmt.wrapErrors | 0xc000cc5c50>{
                msg: "failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-vt2pgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0013c5330>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-vt2pgg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc001528ea0>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-d2xh6p" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-d2xh6p\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00110f090>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p",
            },
            <*fmt.wrapErrors | 0xc001528e70>{
                msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-d2xh6p\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00110f090>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc001528ea0>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-d2xh6p" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-d2xh6p\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00110f090>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p",
            },
            <*fmt.wrapErrors | 0xc001528e70>{
                msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-d2xh6p\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00110f090>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-d2xh6p",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
    <*fmt.wrapErrors | 0xc000b31a70>: 
    failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-rj9bvw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-rj9bvw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e970d0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw",
            },
            <*fmt.wrapErrors | 0xc000b31a40>{
                msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-rj9bvw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000e970d0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
    <*fmt.wrapErrors | 0xc000b31a70>: 
    failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-rj9bvw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-rj9bvw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e970d0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw",
            },
            <*fmt.wrapErrors | 0xc000b31a40>{
                msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-rj9bvw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000e970d0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-rj9bvw",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011ac450>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-vhtzd8" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-vhtzd8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00124a0e0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8",
            },
            <*fmt.wrapErrors | 0xc0011ac420>{
                msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-vhtzd8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00124a0e0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011ac450>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-vhtzd8" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-vhtzd8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00124a0e0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8",
            },
            <*fmt.wrapErrors | 0xc0011ac420>{
                msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-vhtzd8\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00124a0e0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-vhtzd8",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc0003873c0>: 
    cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc0003873c0>: 
    cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:390]: Timed out after 600.005s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:389 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
    <[]string | len:1, cap:1>: [
        "monitoring (Available=Unknown)",
    ]
to be empty

time=2026-02-24T01:50:27.398Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Velero resourceGroup=global step=mirror-hypershift-plugin-image description="Step mirror-hypershift-plugin-image\n  Kind: ImageMirror\n  From {<nil> velero.hypershiftPlugin.registry <nil>}:{<nil> velero.hypershiftPlugin.repository <nil>}@{<nil> velero.hypershiftPlugin.digest <nil>} to {<nil> acr.svc.name <nil>}\n"
time=2026-02-24T01:50:30.293Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Velero resourceGroup=global step=mirror-hypershift-plugin-image err="error running Image Mirror Step, failed to execute shell command: Checking USE_OC_LOGIN_REGISTRIES: registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org\nFetch pull secret for source registry registry.redhat.io from arohcpdev-global KV.\nLogging into target ACR arohcpsvcdev.\nLogin Succeeded\nMirroring image registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:f47f2f9099b6ad235ea1187556dc165aef725bcbe2b818ab62bb186ad485961e to arohcpsvcdev.azurecr.io/oadp/oadp-hypershift-velero-plugin-rhel9:f47f2f9099b6ad235ea1187556dc165aef725bcbe2b818ab62bb186ad485961e.\nThe image will still be available under it's original digest sha256:f47f2f9099b6ad235ea1187556dc165aef725bcbe2b818ab62bb186ad485961e in the target registry.\nError response from registry: failed to resolve sha256:f47f2f9099b6ad235ea1187556dc165aef725bcbe2b818ab62bb186ad485961e: GET \"https://registry.redhat.io/v2/oadp/oadp-hypershift-velero-plugin-rhel9/manifests/sha256:f47f2f9099b6ad235ea1187556dc165aef725bcbe2b818ab62bb186ad485961e\": unauthorized: Please login to the Red Hat Registry using your Customer Portal credentials. Further instructions can be found here: https://access.redhat.com/RegistryAuthentication\n exit status 1"

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc0004c0e30>: 
    cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:242]: Unexpected error:
    <*errors.errorString | 0xc0004c0e30>: 
    cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)
    {
        s: "cluster operators not available: monitoring (Available=Unknown, Degraded=Unknown, Progressing=True, Upgradeable=Unknown)",
    }
occurred