CIHealth
<
Single Day: Feb 27▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: PROD

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 12
e2e (12)
CreateOrUpdateExternalAuthAndWait timed out after <minutes> minutes; context deadline exceeded
02:00:51 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013c5b30>: 
    failed waiting for external auth "ea-list" in resourcegroup="ea-list-dwdpnj" for cluster="ea-list677v96" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-list677v96 in resource group ea-list-dwdpnj, error: context deadline exceeded
    {
        msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-dwdpnj\" for cluster=\"ea-list677v96\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-list677v96 in resource group ea-list-dwdpnj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000718220>{
                s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-list677v96 in resource group ea-list-dwdpnj",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
    <*fmt.wrapErrors | 0xc0013c5b30>: 
    failed waiting for external auth "ea-list" in resourcegroup="ea-list-dwdpnj" for cluster="ea-list677v96" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-list677v96 in resource group ea-list-dwdpnj, error: context deadline exceeded
    {
        msg: "failed waiting for external auth \"ea-list\" in resourcegroup=\"ea-list-dwdpnj\" for cluster=\"ea-list677v96\" to finish, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-list677v96 in resource group ea-list-dwdpnj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000718220>{
                s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ea-list in cluster ea-list677v96 in resource group ea-list-dwdpnj",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:51 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014baa20>: 
    failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-xkk5mj, error: failed waiting for nodepool="nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-xkk5mj" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-xkk5mj, error: failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-xkk5mj\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010e7c20>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-xkk5mj",
            },
            <*fmt.wrapError | 0xc0013b44a0>{
                msg: "failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-xkk5mj\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:94]: Unexpected error:
    <*fmt.wrapErrors | 0xc0014baa20>: 
    failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-xkk5mj, error: failed waiting for nodepool="nodepool-128GiB" for cluster "hcp-cluster-np-128" in resourcegroup="clusternp128-xkk5mj" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool nodepool-128GiB, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-xkk5mj, error: failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-xkk5mj\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010e7c20>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nodepool-128GiB in resource group clusternp128-xkk5mj",
            },
            <*fmt.wrapError | 0xc0013b44a0>{
                msg: "failed waiting for nodepool=\"nodepool-128GiB\" for cluster \"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-xkk5mj\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
Deserializaion Error: no output from command
02:00:51 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled · suite prod/parallel
Show raw failure
d a nodepool with autoscaling enabled (Spec Runtime: 1h29m59.956s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36
        In [It] (Node Runtime: 1h29m59.956s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36
          At [By Step] creating the autoscaling nodepool (Step Runtime: 43m12.88s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95

          Spec Goroutine
          goroutine 115 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x820b858, 0xc000b222d0}, 0x77f1e58?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x824f540, {0x820b858, 0xc000b222d0}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateNodePoolAndWait({0x820b8c8, 0xc000306b60}, 0xc000097788, {0xc000b3c0f0, 0x15}, {0x78182bc, 0x14}, {0x77f1e34, 0xc}, {0xc000809e30, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:718
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateNodePoolFromParam(0xc00087de60, {0x7f084c347788, 0xc00084cd80}, {0xc000b3c0f0, 0x15}, {0x78182bc, 0x14}, {{0x77d5c37, 0x6}, {0x78182bc, ...}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:384
          > github.com/Azure/ARO-HCP/test/e2e.init.func23.2({0x7f084c347788, 0xc00084cd80})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:96
                | 
                | By("creating the autoscaling nodepool")
                > err = tc.CreateNodePoolFromParam(ctx,
                | 	*resourceGroup.Name,
                | 	customerClusterName,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x82210c0?, 0xc00084cd80?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 112
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102 @ 02/27/26 03:34:06.87
  "ts"="2026-02-27 03:34:06.870227" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-27 03:34:06.870286" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-np-autoscale-cluster-vt8brb" "resourceGroup"="np-autoscaling-9pd7cm"
  "ts"="2026-02-27 03:34:07.029064" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-np-autoscale-cluster-vt8brb" "resourceGroup"=""
  "ts"="2026-02-27 03:34:08.813086" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-3ace844abea5a4d3a28ffc64801a1d716d83f775e2e8d3dceadd0cb72b88474b.yaml.gz"
  "ts"="2026-02-27 03:34:08.813201" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-3ace844abea5a4d3a28ffc64801a1d716d83f775e2e8d3dceadd0cb72b88474b.yaml.gz"
  "ts"="2026-02-27 03:34:08.813273" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-27 03:34:08.814251" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-10"
  "ts"="2026-02-27 03:34:08.814264" "level"=0 "msg"="collecting deployments" "resourceGroup"="np-autoscaling-9pd7cm"
  "ts"="2026-02-27 03:34:09.189947" "level"=0 "msg"="collecting operations" "resourceGroup"="np-autoscaling-9pd7cm" "deployment"="pooledNonMsiScopedAssignments-ssrwqrnhyyabs"
  "ts"="2026-02-27 03:34:09.337198" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-10" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-27 03:34:09.337744" "level"=0 "msg"="collecting operations" "resourceGroup"="np-autoscaling-9pd7cm" "deployment"="customer-infra-np-autoscale-cluster-vt8brb"
  "ts"="2026-02-27 03:34:09.474232" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-10" "deployment"="msi-deployment-10"
  "ts"="2026-02-27 03:34:09.613226" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-27 03:34:09.613375" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-27 03:34:09.613494" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="np-autoscaling-9pd7cm"
Command Error: signal: killed
Deserializaion Error: no output from command
d a nodepool with autoscaling enabled (Spec Runtime: 1h29m59.956s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36
        In [It] (Node Runtime: 1h29m59.956s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:36
          At [By Step] creating the autoscaling nodepool (Step Runtime: 43m12.88s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95

          Spec Goroutine
          goroutine 115 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x820b858, 0xc000b222d0}, 0x77f1e58?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x824f540, {0x820b858, 0xc000b222d0}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateNodePoolAndWait({0x820b8c8, 0xc000306b60}, 0xc000097788, {0xc000b3c0f0, 0x15}, {0x78182bc, 0x14}, {0x77f1e34, 0xc}, {0xc000809e30, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:718
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateNodePoolFromParam(0xc00087de60, {0x7f084c347788, 0xc00084cd80}, {0xc000b3c0f0, 0x15}, {0x78182bc, 0x14}, {{0x77d5c37, 0x6}, {0x78182bc, ...}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:384
          > github.com/Azure/ARO-HCP/test/e2e.init.func23.2({0x7f084c347788, 0xc00084cd80})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:96
                | 
                | By("creating the autoscaling nodepool")
                > err = tc.CreateNodePoolFromParam(ctx,
                | 	*resourceGroup.Name,
                | 	customerClusterName,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x82210c0?, 0xc00084cd80?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 112
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102 @ 02/27/26 03:34:06.87
  "ts"="2026-02-27 03:34:06.870227" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-27 03:34:06.870286" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-np-autoscale-cluster-vt8brb" "resourceGroup"="np-autoscaling-9pd7cm"
  "ts"="2026-02-27 03:34:07.029064" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-np-autoscale-cluster-vt8brb" "resourceGroup"=""
  "ts"="2026-02-27 03:34:08.813086" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-3ace844abea5a4d3a28ffc64801a1d716d83f775e2e8d3dceadd0cb72b88474b.yaml.gz"
  "ts"="2026-02-27 03:34:08.813201" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-3ace844abea5a4d3a28ffc64801a1d716d83f775e2e8d3dceadd0cb72b88474b.yaml.gz"
  "ts"="2026-02-27 03:34:08.813273" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-27 03:34:08.814251" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-10"
  "ts"="2026-02-27 03:34:08.814264" "level"=0 "msg"="collecting deployments" "resourceGroup"="np-autoscaling-9pd7cm"
  "ts"="2026-02-27 03:34:09.189947" "level"=0 "msg"="collecting operations" "resourceGroup"="np-autoscaling-9pd7cm" "deployment"="pooledNonMsiScopedAssignments-ssrwqrnhyyabs"
  "ts"="2026-02-27 03:34:09.337198" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-10" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-27 03:34:09.337744" "level"=0 "msg"="collecting operations" "resourceGroup"="np-autoscaling-9pd7cm" "deployment"="customer-infra-np-autoscale-cluster-vt8brb"
  "ts"="2026-02-27 03:34:09.474232" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-10" "deployment"="msi-deployment-10"
  "ts"="2026-02-27 03:34:09.613226" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-27 03:34:09.613375" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-27 03:34:09.613494" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="np-autoscaling-9pd7cm"
Command Error: signal: killed
Deserializaion Error: no output from command
Deserializaion Error: no output from command
02:00:51 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite prod/parallel
Show raw failure
: 1h29m59.786s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:39
        In [It] (Node Runtime: 1h29m59.786s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:39
          At [By Step] creating the node pool (Step Runtime: 43m10.278s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:103

          Spec Goroutine
          goroutine 112 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x820b858, 0xc000dd0550}, 0x77f1e58?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x824f540, {0x820b858, 0xc000dd0550}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateNodePoolAndWait({0x820b8c8, 0xc000705490}, 0xc0000976f8, {0xc0015469c0, 0x1b}, {0x782be91, 0x18}, {0x77d2568, 0x4}, {0xc0017f1a80, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:718
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateNodePoolFromParam(0xc000deb8c0, {0x7f2a7c514b98, 0xc000a42540}, {0xc0015469c0, 0x1b}, {0x782be91, 0x18}, {{0x77d5c37, 0x6}, {0x782be91, ...}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:384
          > github.com/Azure/ARO-HCP/test/e2e.init.func13.2({0x7f2a7c514b98, 0xc000a42540})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:108
                | nodePoolParams.NodePoolName = customerNodePoolName
                | 
                > err = tc.CreateNodePoolFromParam(ctx,
                | 	*resourceGroup.Name,
                | 	customerClusterName,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x82210c0?, 0xc000a42540?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 109
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:114 @ 02/27/26 03:34:05.194
  "ts"="2026-02-27 03:34:05.194982" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-27 03:34:05.195051" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-tls-endpoint-hcp-cluster-t8phmj" "resourceGroup"="tls-endpoint-cluster-8p26lt"
  "ts"="2026-02-27 03:34:05.722278" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-tls-endpoint-hcp-cluster-t8phmj" "resourceGroup"=""
  "ts"="2026-02-27 03:34:07.361055" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-81f205190df882aeed9c971ba5a51da44c00eb526b484755681d39236b7f3906.yaml.gz"
  "ts"="2026-02-27 03:34:07.361174" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-81f205190df882aeed9c971ba5a51da44c00eb526b484755681d39236b7f3906.yaml.gz"
  "ts"="2026-02-27 03:34:07.361242" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-27 03:34:07.362196" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-65"
  "ts"="2026-02-27 03:34:07.362211" "level"=0 "msg"="collecting deployments" "resourceGroup"="tls-endpoint-cluster-8p26lt"
  "ts"="2026-02-27 03:34:07.531799" "level"=0 "msg"="collecting operations" "resourceGroup"="tls-endpoint-cluster-8p26lt" "deployment"="pooledNonMsiScopedAssignments-oo7pyvaeowk44"
  "ts"="2026-02-27 03:34:07.673589" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-65" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-27 03:34:07.799985" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-65" "deployment"="msi-deployment-65"
  "ts"="2026-02-27 03:34:08.041514" "level"=0 "msg"="collecting operations" "resourceGroup"="tls-endpoint-cluster-8p26lt" "deployment"="customer-infra-tls-endpoint-hcp-cluster-t8phmj"
  "ts"="2026-02-27 03:34:08.198233" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-27 03:34:08.198349" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-27 03:34:08.198504" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="tls-endpoint-cluster-8p26lt"
Command Error: signal: killed
Deserializaion Error: no output from command
: 1h29m59.786s)
        /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:39
        In [It] (Node Runtime: 1h29m59.786s)
          /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:39
          At [By Step] creating the node pool (Step Runtime: 43m10.278s)
            /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:103

          Spec Goroutine
          goroutine 112 [select]
            github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x820b858, 0xc000dd0550}, 0x77f1e58?)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/internal/shared/shared.go:36
            github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x824f540, {0x820b858, 0xc000dd0550}, 0x0)
              /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.0/runtime/poller.go:284
            github.com/Azure/ARO-HCP/test/util/framework.CreateNodePoolAndWait({0x820b8c8, 0xc000705490}, 0xc0000976f8, {0xc0015469c0, 0x1b}, {0x782be91, 0x18}, {0x77d2568, 0x4}, {0xc0017f1a80, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:718
            github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CreateNodePoolFromParam(0xc000deb8c0, {0x7f2a7c514b98, 0xc000a42540}, {0xc0015469c0, 0x1b}, {0x782be91, 0x18}, {{0x77d5c37, 0x6}, {0x782be91, ...}, ...}, ...)
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/deployment_helper.go:384
          > github.com/Azure/ARO-HCP/test/e2e.init.func13.2({0x7f2a7c514b98, 0xc000a42540})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:108
                | nodePoolParams.NodePoolName = customerNodePoolName
                | 
                > err = tc.CreateNodePoolFromParam(ctx,
                | 	*resourceGroup.Name,
                | 	customerClusterName,
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x82210c0?, 0xc000a42540?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 109
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:114 @ 02/27/26 03:34:05.194
  "ts"="2026-02-27 03:34:05.194982" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-27 03:34:05.195051" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-tls-endpoint-hcp-cluster-t8phmj" "resourceGroup"="tls-endpoint-cluster-8p26lt"
  "ts"="2026-02-27 03:34:05.722278" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-tls-endpoint-hcp-cluster-t8phmj" "resourceGroup"=""
  "ts"="2026-02-27 03:34:07.361055" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-81f205190df882aeed9c971ba5a51da44c00eb526b484755681d39236b7f3906.yaml.gz"
  "ts"="2026-02-27 03:34:07.361174" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-81f205190df882aeed9c971ba5a51da44c00eb526b484755681d39236b7f3906.yaml.gz"
  "ts"="2026-02-27 03:34:07.361242" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-27 03:34:07.362196" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-prod-65"
  "ts"="2026-02-27 03:34:07.362211" "level"=0 "msg"="collecting deployments" "resourceGroup"="tls-endpoint-cluster-8p26lt"
  "ts"="2026-02-27 03:34:07.531799" "level"=0 "msg"="collecting operations" "resourceGroup"="tls-endpoint-cluster-8p26lt" "deployment"="pooledNonMsiScopedAssignments-oo7pyvaeowk44"
  "ts"="2026-02-27 03:34:07.673589" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-65" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-27 03:34:07.799985" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-prod-65" "deployment"="msi-deployment-65"
  "ts"="2026-02-27 03:34:08.041514" "level"=0 "msg"="collecting operations" "resourceGroup"="tls-endpoint-cluster-8p26lt" "deployment"="customer-infra-tls-endpoint-hcp-cluster-t8phmj"
  "ts"="2026-02-27 03:34:08.198233" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-27 03:34:08.198349" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-27 03:34:08.198504" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="tls-endpoint-cluster-8p26lt"
Command Error: signal: killed
Deserializaion Error: no output from command
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
02:00:51 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc00119a8d0>: 
    failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-b22djs" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-b22djs, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-b22djs\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-b22djs, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000646250>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-b22djs",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc00119a8d0>: 
    failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="basic-cluster-b22djs" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-b22djs, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-b22djs\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-b22djs, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000646250>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster basic-hcp-cluster in resource group basic-cluster-b22djs",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:51 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc00153e780>: 
    failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-rkpqpt, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-rkpqpt" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-rkpqpt, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-rkpqpt\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0012a7b00>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-rkpqpt",
            },
            <*fmt.wrapError | 0xc000dea540>{
                msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-rkpqpt\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:109]: Unexpected error:
    <*fmt.wrapErrors | 0xc00153e780>: 
    failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-rkpqpt, error: failed waiting for nodepool="arm64-vm-np-1" for cluster "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-rkpqpt" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool arm64-vm-np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-rkpqpt, error: failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-rkpqpt\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0012a7b00>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool arm64-vm-np-1 in resource group arm64-vm-cluster-rkpqpt",
            },
            <*fmt.wrapError | 0xc000dea540>{
                msg: "failed waiting for nodepool=\"arm64-vm-np-1\" for cluster \"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-rkpqpt\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:51 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010f6720>: 
    failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-6dqj72, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-6dqj72" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-6dqj72, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-6dqj72\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000760400>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-6dqj72",
            },
            <*fmt.wrapError | 0xc0008c3600>{
                msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-6dqj72\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:112]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010f6720>: 
    failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-6dqj72, error: failed waiting for nodepool="np-1" for cluster "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-6dqj72" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-6dqj72, error: failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-6dqj72\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000760400>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group pullsecret-test-6dqj72",
            },
            <*fmt.wrapError | 0xc0008c3600>{
                msg: "failed waiting for nodepool=\"np-1\" for cluster \"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-6dqj72\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
Interrupted by User
02:00:51 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:47]: Interrupted by User
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
02:00:51 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e9b110>: 
    failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-rxn4xb" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-rxn4xb, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-rxn4xb\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-rxn4xb, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000812100>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-rxn4xb",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:170]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e9b110>: 
    failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-rxn4xb" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-rxn4xb, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-rxn4xb\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-rxn4xb, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000812100>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster patch-tags-cluster in resource group patch-tags-rxn4xb",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:51 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:242]: Unexpected error:
    <*fmt.wrapErrors | 0xc00176eae0>: 
    failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-dcdzqf, error: failed waiting for nodepool="np-1" for cluster "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-dcdzqf" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-dcdzqf, error: failed waiting for nodepool=\"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-dcdzqf\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001099d80>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-dcdzqf",
            },
            <*fmt.wrapError | 0xc000a7a9c0>{
                msg: "failed waiting for nodepool=\"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-dcdzqf\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:242]: Unexpected error:
    <*fmt.wrapErrors | 0xc00176eae0>: 
    failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-dcdzqf, error: failed waiting for nodepool="np-1" for cluster "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-dcdzqf" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-dcdzqf, error: failed waiting for nodepool=\"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-dcdzqf\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001099d80>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-dcdzqf",
            },
            <*fmt.wrapError | 0xc000a7a9c0>{
                msg: "failed waiting for nodepool=\"np-1\" for cluster \"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-dcdzqf\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded
02:00:51 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011d2e70>: 
    failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-h5r2qd, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-h5r2qd" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-h5r2qd, error: failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-h5r2qd\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00068ba00>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-h5r2qd",
            },
            <*fmt.wrapError | 0xc000b8ad80>{
                msg: "failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-h5r2qd\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:124]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011d2e70>: 
    failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-h5r2qd, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-h5r2qd" to finish creating: context deadline exceeded
    {
        msg: "failed to create NodePool np-1, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-h5r2qd, error: failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-h5r2qd\" to finish creating: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00068ba00>{
                s: "timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-h5r2qd",
            },
            <*fmt.wrapError | 0xc000b8ad80>{
                msg: "failed waiting for nodepool=\"np-1\" for cluster \"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-h5r2qd\" to finish creating: context deadline exceeded",
                err: <context.deadlineExceededError>{},
            },
        ],
    }
occurred
timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds
02:00:51 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:156]: Unexpected error:
    <*fmt.wrapErrors | 0xc00118aa20>: 
    failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-fqjfbz" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-fqjfbz, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-fqjfbz\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-fqjfbz, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0008bb430>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-fqjfbz",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:156]: Unexpected error:
    <*fmt.wrapErrors | 0xc00118aa20>: 
    failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-fqjfbz" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-fqjfbz, error: context deadline exceeded
    {
        msg: "failed waiting for hcpCluster=\"cluster-ver-4-19\" in resourcegroup=\"rg-cluster-back-version-fqjfbz\" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-fqjfbz, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0008bb430>{
                s: "timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-fqjfbz",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred