fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-5-0-lvjsdl/cluster-nightly-5-0-hxzbgf should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0016204e0>: 
    failed to create HCP cluster cluster-nightly-5-0-hxzbgf, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-hxzbgf in resource group rg-nightly-5-0-lvjsdl, error: failed waiting for cluster="cluster-nightly-5-0-hxzbgf" in resourcegroup="rg-nightly-5-0-lvjsdl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-hxzbgf in resource group rg-nightly-5-0-lvjsdl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-nightly-5-0-lvjsdl/cluster-nightly-5-0-hxzbgf should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0016204e0>: 
    failed to create HCP cluster cluster-nightly-5-0-hxzbgf, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-hxzbgf in resource group rg-nightly-5-0-lvjsdl, error: failed waiting for cluster="cluster-nightly-5-0-hxzbgf" in resourcegroup="rg-nightly-5-0-lvjsdl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-0-hxzbgf in resource group rg-nightly-5-0-lvjsdl, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-55jt6c" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00146eb10>: 
    failed to create HCP cluster cluster-zstream-4-22-55jt6c, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-55jt6c in resource group rg-zstream-upgrade-4-22-gmxf8f, error: failed waiting for cluster="cluster-zstream-4-22-55jt6c" in resourcegroup="rg-zstream-upgrade-4-22-gmxf8f" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-55jt6c in resource group rg-zstream-upgrade-4-22-gmxf8f, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-55jt6c" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc00146eb10>: 
    failed to create HCP cluster cluster-zstream-4-22-55jt6c, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-55jt6c in resource group rg-zstream-upgrade-4-22-gmxf8f, error: failed waiting for cluster="cluster-zstream-4-22-55jt6c" in resourcegroup="rg-zstream-upgrade-4-22-gmxf8f" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-55jt6c in resource group rg-zstream-upgrade-4-22-gmxf8f, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000cf4240>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="patch-name-cluster" in resourcegroup="patch-name-t2dlwt" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000cf4240>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="patch-name-cluster" in resourcegroup="patch-name-t2dlwt" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.003s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <*net.OpError | 0xc0008c56d0>: 
    dial tcp: lookup console-openshift-console.apps.aro.f4y0j8z4x0b5v2h.j4r9.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.003s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <*net.OpError | 0xc0008c56d0>: 
    dial tcp: lookup console-openshift-console.apps.aro.f4y0j8z4x0b5v2h.j4r9.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:407]: Timed out after 605.076s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:403 with:
kubectl get clusteroperators should succeed from authorized VM
Unexpected error:
    <*errors.errorString | 0xc000a7a390>: 
    E0621 00:06:17.087501    3391 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://api.h5h5i6l8r7c3p7a.u2v6.brazilsouth.aroapp-hcp.io:443/api?timeout=32s\": dial tcp 74.163.139.192:443: i/o timeout"
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:407]: Timed out after 605.076s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:403 with:
kubectl get clusteroperators should succeed from authorized VM
Unexpected error:
    <*errors.errorString | 0xc000a7a390>: 
    E0621 00:06:17.087501    3391 memcache.go:265] "Unhandled Error" err="couldn't get current server API group list: Get \"https://api.h5h5i6l8r7c3p7a.u2v6.brazilsouth.aroapp-hcp.io:443/api?timeout=32s\": dial tcp 74.163.139.192:443: i/o timeout"
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-5-0-zf6pql"
Unexpected error:
    <*fmt.wrapError | 0xc00096e780>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-dvdt9.apps.aro.t9r5s9t0c4l3k0a.37yh.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-dvdt9.apps.aro.t9r5s9t0c4l3k0a.37yh.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-5-0-zf6pql"
Unexpected error:
    <*fmt.wrapError | 0xc00096e780>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-dvdt9.apps.aro.t9r5s9t0c4l3k0a.37yh.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-dvdt9.apps.aro.t9r5s9t0c4l3k0a.37yh.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-21-wxppcl"
Unexpected error:
    <*fmt.wrapError | 0xc00012ae20>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-4d2pm.apps.aro.f2j5d7e4q4x3n6o.g26p.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-4d2pm.apps.aro.f2j5d7e4q4x3n6o.g26p.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-21-wxppcl"
Unexpected error:
    <*fmt.wrapError | 0xc00012ae20>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-4d2pm.apps.aro.f2j5d7e4q4x3n6o.g26p.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-4d2pm.apps.aro.f2j5d7e4q4x3n6o.g26p.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-lklm69/cluster-candidate-4-22-f4gmfq should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0014d4690>: 
    failed to create HCP cluster cluster-candidate-4-22-f4gmfq, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-f4gmfq in resource group rg-candidate-4-22-lklm69, error: failed waiting for cluster="cluster-candidate-4-22-f4gmfq" in resourcegroup="rg-candidate-4-22-lklm69" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-f4gmfq in resource group rg-candidate-4-22-lklm69, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-lklm69/cluster-candidate-4-22-f4gmfq should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc0014d4690>: 
    failed to create HCP cluster cluster-candidate-4-22-f4gmfq, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-f4gmfq in resource group rg-candidate-4-22-lklm69, error: failed waiting for cluster="cluster-candidate-4-22-f4gmfq" in resourcegroup="rg-candidate-4-22-lklm69" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-f4gmfq in resource group rg-candidate-4-22-lklm69, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to verify simple web app on back-level cluster version 4.19
Unexpected error:
    <*fmt.wrapError | 0xc000f540e0>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-zgg49.apps.aro.h8q7w4u9x7c7g6v.x1ie.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-zgg49.apps.aro.h8q7w4u9x7c7g6v.x1ie.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to verify simple web app on back-level cluster version 4.19
Unexpected error:
    <*fmt.wrapError | 0xc000f540e0>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-zgg49.apps.aro.h8q7w4u9x7c7g6v.x1ie.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-zgg49.apps.aro.h8q7w4u9x7c7g6v.x1ie.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-20-6z4flh"
Unexpected error:
    <*fmt.wrapError | 0xc000954aa0>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-dg7r4.apps.aro.k4f9f7h5q5s9h1o.o4cb.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-dg7r4.apps.aro.k4f9f7h5q5s9h1o.o4cb.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-20-6z4flh"
Unexpected error:
    <*fmt.wrapError | 0xc000954aa0>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-dg7r4.apps.aro.k4f9f7h5q5s9h1o.o4cb.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-dg7r4.apps.aro.k4f9f7h5q5s9h1o.o4cb.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:170]: failed to run simple web app and connectivity check app with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc0012542a0>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-j5bdd.apps.aro.cilium-cl.17y9.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-j5bdd.apps.aro.cilium-cl.17y9.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:170]: failed to run simple web app and connectivity check app with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc0012542a0>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-j5bdd.apps.aro.cilium-cl.17y9.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-j5bdd.apps.aro.cilium-cl.17y9.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:194]: failed to run simple web app and connectivity check with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc0021b6000>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-8872n.apps.aro.cilium-cluster.moy3.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-8872n.apps.aro.cilium-cluster.moy3.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:194]: failed to run simple web app and connectivity check with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc0021b6000>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-8872n.apps.aro.cilium-cluster.moy3.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-8872n.apps.aro.cilium-cluster.moy3.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:244]: failed to verify cluster operators are available after external auth config creation
Unexpected error:
    <*errors.joinError | 0xc0013bc3f0>: 
    context deadline exceeded
    cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=True, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False)
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:244]: failed to verify cluster operators are available after external auth config creation
Unexpected error:
    <*errors.joinError | 0xc0013bc3f0>: 
    context deadline exceeded
    cluster operators not available: console (Degraded=True, Progressing=False, Available=False, Upgradeable=True, EvaluationConditionsDetected=Unknown), ingress (Available=False, Progressing=True, Degraded=True, Upgradeable=True, EvaluationConditionsDetected=False)
    ...
occurred

go:2125 +0x47 fp=0xc000be4d28 sp=0xc000be4cc8 pc=0x32e4407
bufio.(*Reader).fill(0xc00162c1e0)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc000be4d60 sp=0xc000be4d28 pc=0x3084943
bufio.(*Reader).Peek(0xc00162c1e0, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc000be4d80 sp=0xc000be4d60 pc=0x3084ad3
net/http.(*persistConn).readLoop(0xc001359d40)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc000be4fc8 sp=0xc000be4d80 pc=0x32e4f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc000be4fe0 sp=0xc000be4fc8 pc=0x32e38a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000be4fe8 sp=0xc000be4fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 173
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

goroutine 189 gp=0xc001001dc0 m=nil [select, 1 minutes]:
runtime.gopark(0xc0016b3f48?, 0x2?, 0xc0?, 0x3d?, 0xc0016b3ef4?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0016b3d78 sp=0xc0016b3d58 pc=0x2f1e50e
runtime.selectgo(0xc0016b3f48, 0xc0016b3ef0, 0xc000c97240?, 0x0, 0xc0018e37d0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc0016b3eb8 sp=0xc0016b3d78 pc=0x2ef92f7
net/http.(*persistConn).writeLoop(0xc001359d40)
	/usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc0016b3fc8 sp=0xc0016b3eb8 pc=0x32e6ba7
net/http.(*Transport).dialConn.gowrap3()
	/usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc0016b3fe0 sp=0xc0016b3fc8 pc=0x32e3845
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0016b3fe8 sp=0xc0016b3fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 173
	/usr/lib/golang/src/net/http/transport.go:1948 +0x17a5

goroutine 235 gp=0xc0016a4fc0 m=nil [select]:
runtime.gopark(0xc0013df768?, 0x2?, 0x90?, 0x1f?, 0xc0013df75c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0013df5e8 sp=0xc0013df5c8 pc=0x2f1e50e
runtime.selectgo(0xc0013df768, 0xc0013df758, 0xc000f5d760?, 0x0, 0x36ecd5c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc0013df728 sp=0xc0013df5e8 pc=0x2ef92f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x92b8658, 0xc0018e0b60}, 0x8704ddd?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc0013df798 sp=0xc0013df728 pc=0x36ec4b6
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x930a440, {0x92b8658, 0xc0018e0b60}, 0x2f1baf3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc0013dfa98 sp=0xc0013df798 pc=0x3ded372
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x92b8658, 0xc0018e0b60}, 0xc001037308, {0xc0010125e8, 0x12}, {0xc001546108, 0x12})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc0013dfc20 sp=0xc0013dfa98 pc=0x6c2ef65
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x92b8658?, 0xc0018e0b60?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc0013dfcc8 sp=0xc0013dfc20 pc=0x6c2e992
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x92b8658?, 0xc0018e0b60?}, 0xc0018e0b70?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc0013dfd20 sp=0xc0013dfcc8 pc=0x369fa82
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x92b8658, 0xc0018e0b60}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc0013dfe68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc0013dfd98 sp=0xc0013dfd20 pc=0x369db2e
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x92b85e8, 0xc0008bb540}, 0xc001037308, {0xc0010125e8, 0x12}, {0xc001546108, 0x12}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc0013dfef0 sp=0xc0013dfd98 pc=0x6c2e705
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc0013dff78 sp=0xc0013dfef0 pc=0x6c325fe
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc0013dffe0 sp=0xc0013dff78 pc=0x4a4be30
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0013dffe8 sp=0xc0013dffe0 pc=0x2f26cc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 214
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xca
rbx    0x0
rcx    0x2f28ae3
rdx    0x0
rdi    0xc90cc70
rsi    0x80
rbp    0x7ffcdfaaa7b0
rsp    0x7ffcdfaaa768
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1c
r13    0x1
r14    0xc90a6e0
r15    0x7
rip    0x2f28ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command
go:2125 +0x47 fp=0xc000be4d28 sp=0xc000be4cc8 pc=0x32e4407
bufio.(*Reader).fill(0xc00162c1e0)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc000be4d60 sp=0xc000be4d28 pc=0x3084943
bufio.(*Reader).Peek(0xc00162c1e0, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc000be4d80 sp=0xc000be4d60 pc=0x3084ad3
net/http.(*persistConn).readLoop(0xc001359d40)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc000be4fc8 sp=0xc000be4d80 pc=0x32e4f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc000be4fe0 sp=0xc000be4fc8 pc=0x32e38a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000be4fe8 sp=0xc000be4fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 173
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

goroutine 189 gp=0xc001001dc0 m=nil [select, 1 minutes]:
runtime.gopark(0xc0016b3f48?, 0x2?, 0xc0?, 0x3d?, 0xc0016b3ef4?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0016b3d78 sp=0xc0016b3d58 pc=0x2f1e50e
runtime.selectgo(0xc0016b3f48, 0xc0016b3ef0, 0xc000c97240?, 0x0, 0xc0018e37d0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc0016b3eb8 sp=0xc0016b3d78 pc=0x2ef92f7
net/http.(*persistConn).writeLoop(0xc001359d40)
	/usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc0016b3fc8 sp=0xc0016b3eb8 pc=0x32e6ba7
net/http.(*Transport).dialConn.gowrap3()
	/usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc0016b3fe0 sp=0xc0016b3fc8 pc=0x32e3845
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0016b3fe8 sp=0xc0016b3fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 173
	/usr/lib/golang/src/net/http/transport.go:1948 +0x17a5

goroutine 235 gp=0xc0016a4fc0 m=nil [select]:
runtime.gopark(0xc0013df768?, 0x2?, 0x90?, 0x1f?, 0xc0013df75c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0013df5e8 sp=0xc0013df5c8 pc=0x2f1e50e
runtime.selectgo(0xc0013df768, 0xc0013df758, 0xc000f5d760?, 0x0, 0x36ecd5c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc0013df728 sp=0xc0013df5e8 pc=0x2ef92f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x92b8658, 0xc0018e0b60}, 0x8704ddd?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc0013df798 sp=0xc0013df728 pc=0x36ec4b6
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x930a440, {0x92b8658, 0xc0018e0b60}, 0x2f1baf3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc0013dfa98 sp=0xc0013df798 pc=0x3ded372
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x92b8658, 0xc0018e0b60}, 0xc001037308, {0xc0010125e8, 0x12}, {0xc001546108, 0x12})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc0013dfc20 sp=0xc0013dfa98 pc=0x6c2ef65
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x92b8658?, 0xc0018e0b60?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc0013dfcc8 sp=0xc0013dfc20 pc=0x6c2e992
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x92b8658?, 0xc0018e0b60?}, 0xc0018e0b70?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc0013dfd20 sp=0xc0013dfcc8 pc=0x369fa82
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x92b8658, 0xc0018e0b60}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc0013dfe68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc0013dfd98 sp=0xc0013dfd20 pc=0x369db2e
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x92b85e8, 0xc0008bb540}, 0xc001037308, {0xc0010125e8, 0x12}, {0xc001546108, 0x12}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc0013dfef0 sp=0xc0013dfd98 pc=0x6c2e705
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc0013dff78 sp=0xc0013dfef0 pc=0x6c325fe
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc0013dffe0 sp=0xc0013dff78 pc=0x4a4be30
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0013dffe8 sp=0xc0013dffe0 pc=0x2f26cc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 214
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xca
rbx    0x0
rcx    0x2f28ae3
rdx    0x0
rdi    0xc90cc70
rsi    0x80
rbp    0x7ffcdfaaa7b0
rsp    0x7ffcdfaaa768
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x1c
r13    0x1
r14    0xc90a6e0
r15    0x7
rip    0x2f28ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-s6l4jx/cluster-candidate-4-22-gqscd7 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a36480>: 
    failed to create HCP cluster cluster-candidate-4-22-gqscd7, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gqscd7 in resource group rg-candidate-4-22-s6l4jx, error: failed waiting for cluster="cluster-candidate-4-22-gqscd7" in resourcegroup="rg-candidate-4-22-s6l4jx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gqscd7 in resource group rg-candidate-4-22-s6l4jx, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-s6l4jx/cluster-candidate-4-22-gqscd7 should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc000a36480>: 
    failed to create HCP cluster cluster-candidate-4-22-gqscd7, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gqscd7 in resource group rg-candidate-4-22-s6l4jx, error: failed waiting for cluster="cluster-candidate-4-22-gqscd7" in resourcegroup="rg-candidate-4-22-s6l4jx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-gqscd7 in resource group rg-candidate-4-22-s6l4jx, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-wfbfm6" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000a3ca80>: 
    failed to create HCP cluster cluster-zstream-4-22-wfbfm6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-wfbfm6 in resource group rg-zstream-upgrade-4-22-lwj2vb, error: failed waiting for cluster="cluster-zstream-4-22-wfbfm6" in resourcegroup="rg-zstream-upgrade-4-22-lwj2vb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-wfbfm6 in resource group rg-zstream-upgrade-4-22-lwj2vb, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-wfbfm6" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000a3ca80>: 
    failed to create HCP cluster cluster-zstream-4-22-wfbfm6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-wfbfm6 in resource group rg-zstream-upgrade-4-22-lwj2vb, error: failed waiting for cluster="cluster-zstream-4-22-wfbfm6" in resourcegroup="rg-zstream-upgrade-4-22-lwj2vb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-wfbfm6 in resource group rg-zstream-upgrade-4-22-lwj2vb, error: context deadline exceeded
    ...
occurred

fail [:0]: Interrupted by User
fail [:0]: Interrupted by User

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-21-rlb9dn"
Unexpected error:
    <*fmt.wrapError | 0xc000e98460>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-xnczv.apps.aro.w3y9b1h7k1a0m3a.ntaj.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-xnczv.apps.aro.w3y9b1h7k1a0m3a.ntaj.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-21-rlb9dn"
Unexpected error:
    <*fmt.wrapError | 0xc000e98460>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-xnczv.apps.aro.w3y9b1h7k1a0m3a.ntaj.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-xnczv.apps.aro.w3y9b1h7k1a0m3a.ntaj.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:194]: failed to run simple web app and connectivity check with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc0011fe378>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-6tkcv.apps.aro.cilium-cluster.aq51.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-6tkcv.apps.aro.cilium-cluster.aq51.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:194]: failed to run simple web app and connectivity check with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc0011fe378>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-6tkcv.apps.aro.cilium-cluster.aq51.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-6tkcv.apps.aro.cilium-cluster.aq51.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.005s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <*net.OpError | 0xc000a493b0>: 
    dial tcp: lookup console-openshift-console.apps.aro.s3s6l6j1t7z6u0i.vxvo.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.005s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <*net.OpError | 0xc000a493b0>: 
    dial tcp: lookup console-openshift-console.apps.aro.s3s6l6j1t7z6u0i.vxvo.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:244]: failed to verify cluster operators are available after external auth config creation
Unexpected error:
    <*errors.joinError | 0xc00160ea98>: 
    context deadline exceeded
    failed to list ClusterOperators: client rate limiter Wait returned an error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:244]: failed to verify cluster operators are available after external auth config creation
Unexpected error:
    <*errors.joinError | 0xc00160ea98>: 
    context deadline exceeded
    failed to list ClusterOperators: client rate limiter Wait returned an error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-22-pbdr47"
Unexpected error:
    <*fmt.wrapError | 0xc000e90800>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-gtxbf.apps.aro.c0d5y7d7l4p2v7s.4c6c.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-gtxbf.apps.aro.c0d5y7d7l4p2v7s.4c6c.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-22-pbdr47"
Unexpected error:
    <*fmt.wrapError | 0xc000e90800>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-gtxbf.apps.aro.c0d5y7d7l4p2v7s.4c6c.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-gtxbf.apps.aro.c0d5y7d7l4p2v7s.4c6c.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-5-0-qqg5xh"
Unexpected error:
    <*fmt.wrapError | 0xc000b1a060>: 
    failed to create namespace: Post "https://api.q8q3f7q1h7j5r8s.w6pe.brazilsouth.aroapp-hcp.io:443/api/v1/namespaces": dial tcp 74.163.139.192:443: i/o timeout
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-5-0-qqg5xh"
Unexpected error:
    <*fmt.wrapError | 0xc000b1a060>: 
    failed to create namespace: Post "https://api.q8q3f7q1h7j5r8s.w6pe.brazilsouth.aroapp-hcp.io:443/api/v1/namespaces": dial tcp 74.163.139.192:443: i/o timeout
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to verify simple web app on back-level cluster version 4.19
Unexpected error:
    <*fmt.wrapError | 0xc000f2e040>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-d7rns.apps.aro.f8w9v6v4z8w1e2e.bggi.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-d7rns.apps.aro.f8w9v6v4z8w1e2e.bggi.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to verify simple web app on back-level cluster version 4.19
Unexpected error:
    <*fmt.wrapError | 0xc000f2e040>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-d7rns.apps.aro.f8w9v6v4z8w1e2e.bggi.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-d7rns.apps.aro.f8w9v6v4z8w1e2e.bggi.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001502f30>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-knlcxx, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-knlcxx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-knlcxx, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:95]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001502f30>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-knlcxx, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-knlcxx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-knlcxx, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:126]: failed to create nodepool "np-1" for autoscaling cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000d52e10>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-5c9rf9, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-5c9rf9" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:126]: failed to create nodepool "np-1" for autoscaling cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc000d52e10>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group autoscaling-cluster-5c9rf9, error: failed waiting for nodepool="np-1" for cluster "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-5c9rf9" to finish creating: context deadline exceeded
    ...
occurred

fail [:0]: Interrupted by User
fail [:0]: Interrupted by User

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:170]: failed to run simple web app and connectivity check app with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc000e23290>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-rwks6.apps.aro.cilium-cl.23l1.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-rwks6.apps.aro.cilium-cl.23l1.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:170]: failed to run simple web app and connectivity check app with cilium CNI
Unexpected error:
    <*errors.joinError | 0xc000e23290>: 
    VerifySimpleWebApp failed: route was never reachable: Get "https://agnhost-e2e-serving-app-rwks6.apps.aro.cilium-cl.23l1.brazilsouth.aroapp-hcp.io": dial tcp: lookup agnhost-e2e-serving-app-rwks6.apps.aro.cilium-cl.23l1.brazilsouth.aroapp-hcp.io on 172.30.0.10:53: no such host
    ...
occurred

53 fp=0xc0000c9d80 sp=0xc0000c9d60 pc=0x3084ad3
net/http.(*persistConn).readLoop(0xc0010a6b40)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc0000c9fc8 sp=0xc0000c9d80 pc=0x32e4f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc0000c9fe0 sp=0xc0000c9fc8 pc=0x32e38a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0000c9fe8 sp=0xc0000c9fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 212
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

goroutine 236 gp=0xc000e1ec40 m=nil [select, 2 minutes]:
runtime.gopark(0xc001303f48?, 0x2?, 0xc0?, 0x3d?, 0xc001303ef4?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000382d78 sp=0xc000382d58 pc=0x2f1e50e
runtime.selectgo(0xc000382f48, 0xc001303ef0, 0xc0008e8b40?, 0x0, 0x0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000382eb8 sp=0xc000382d78 pc=0x2ef92f7
net/http.(*persistConn).writeLoop(0xc0018445a0)
	/usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc000382fc8 sp=0xc000382eb8 pc=0x32e6ba7
net/http.(*Transport).dialConn.gowrap3()
	/usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc000382fe0 sp=0xc000382fc8 pc=0x32e3845
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000382fe8 sp=0xc000382fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 197
	/usr/lib/golang/src/net/http/transport.go:1948 +0x17a5

goroutine 235 gp=0xc000682e00 m=nil [IO wait, 2 minutes]:
runtime.gopark(0xc0000d5760?, 0xc001105788?, 0xc5?, 0xbe?, 0xb?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc001105768 sp=0xc001105748 pc=0x2f1e50e
runtime.netpollblock(0x2f88ad8?, 0x2eaa066?, 0x0?)
	/usr/lib/golang/src/runtime/netpoll.go:575 +0xf7 fp=0xc0011057a0 sp=0xc001105768 pc=0x2eddfb7
internal/poll.runtime_pollWait(0x7f51f5ba3e00, 0x72)
	/usr/lib/golang/src/runtime/netpoll.go:351 +0x85 fp=0xc0011057c0 sp=0xc0011057a0 pc=0x2f1cda5
internal/poll.(*pollDesc).wait(0xc001866680?, 0xc001728a00?, 0x0)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0011057e8 sp=0xc0011057c0 pc=0x2fab907
internal/poll.(*pollDesc).waitRead(...)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001866680, {0xc001728a00, 0x2500, 0x2500})
	/usr/lib/golang/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc001105880 sp=0xc0011057e8 pc=0x2facd39
net.(*netFD).Read(0xc001866680, {0xc001728a00?, 0xc001728a00?, 0x5?})
	/usr/lib/golang/src/net/fd_posix.go:68 +0x25 fp=0xc0011058c8 sp=0xc001105880 pc=0x31712e5
net.(*conn).Read(0xc000d6aa10, {0xc001728a00?, 0x7f51f42af700?, 0x7f523c789f30?})
	/usr/lib/golang/src/net/net.go:196 +0x45 fp=0xc001105910 sp=0xc0011058c8 pc=0x3183385
crypto/tls.(*atLeastReader).Read(0xc001800f60, {0xc001728a00?, 0x240a?, 0x0?})
	/usr/lib/golang/src/crypto/tls/conn.go:819 +0x3b fp=0xc001105958 sp=0xc001105910 pc=0x31eef1b
bytes.(*Buffer).ReadFrom(0xc000c129a8, {0x9220320, 0xc001800f60})
	/usr/lib/golang/src/bytes/buffer.go:217 +0x98 fp=0xc0011059b0 sp=0xc001105958 pc=0x2fef578
crypto/tls.(*Conn).readFromUntil(0xc000c12708, {0x9221e00, 0xc000d6aa10}, 0xc001105a18?)
	/usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0011059e8 sp=0xc0011059b0 pc=0x31ef0fe
crypto/tls.(*Conn).readRecordOrCCS(0xc000c12708, 0x0)
	/usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc001105c60 sp=0xc0011059e8 pc=0x31ec17b
crypto/tls.(*Conn).readRecord(...)
	/usr/lib/golang/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc000c12708, {0xc001892000, 0x1000, 0xc0008673b0?})
	/usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc001105cc8 sp=0xc001105c60 pc=0x31f2a85
net/http.(*persistConn).Read(0xc0018445a0, {0xc001892000?, 0x32dcb05?, 0x921acc0?})
	/usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc001105d28 sp=0xc001105cc8 pc=0x32e4407
bufio.(*Reader).fill(0xc000e9db60)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc001105d60 sp=0xc001105d28 pc=0x3084943
bufio.(*Reader).Peek(0xc000e9db60, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc001105d80 sp=0xc001105d60 pc=0x3084ad3
net/http.(*persistConn).readLoop(0xc0018445a0)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc001105fc8 sp=0xc001105d80 pc=0x32e4f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc001105fe0 sp=0xc001105fc8 pc=0x32e38a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc001105fe8 sp=0xc001105fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 197
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

rax    0xca
rbx    0x0
rcx    0x2f28ae3
rdx    0x0
rdi    0xc90cc70
rsi    0x80
rbp    0x7fff4aa32180
rsp    0x7fff4aa32138
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x7fff4aa32180
r13    0x1
r14    0xc90a6e0
r15    0x5
rip    0x2f28ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command
53 fp=0xc0000c9d80 sp=0xc0000c9d60 pc=0x3084ad3
net/http.(*persistConn).readLoop(0xc0010a6b40)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc0000c9fc8 sp=0xc0000c9d80 pc=0x32e4f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc0000c9fe0 sp=0xc0000c9fc8 pc=0x32e38a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0000c9fe8 sp=0xc0000c9fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 212
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

goroutine 236 gp=0xc000e1ec40 m=nil [select, 2 minutes]:
runtime.gopark(0xc001303f48?, 0x2?, 0xc0?, 0x3d?, 0xc001303ef4?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000382d78 sp=0xc000382d58 pc=0x2f1e50e
runtime.selectgo(0xc000382f48, 0xc001303ef0, 0xc0008e8b40?, 0x0, 0x0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000382eb8 sp=0xc000382d78 pc=0x2ef92f7
net/http.(*persistConn).writeLoop(0xc0018445a0)
	/usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc000382fc8 sp=0xc000382eb8 pc=0x32e6ba7
net/http.(*Transport).dialConn.gowrap3()
	/usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc000382fe0 sp=0xc000382fc8 pc=0x32e3845
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000382fe8 sp=0xc000382fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 197
	/usr/lib/golang/src/net/http/transport.go:1948 +0x17a5

goroutine 235 gp=0xc000682e00 m=nil [IO wait, 2 minutes]:
runtime.gopark(0xc0000d5760?, 0xc001105788?, 0xc5?, 0xbe?, 0xb?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc001105768 sp=0xc001105748 pc=0x2f1e50e
runtime.netpollblock(0x2f88ad8?, 0x2eaa066?, 0x0?)
	/usr/lib/golang/src/runtime/netpoll.go:575 +0xf7 fp=0xc0011057a0 sp=0xc001105768 pc=0x2eddfb7
internal/poll.runtime_pollWait(0x7f51f5ba3e00, 0x72)
	/usr/lib/golang/src/runtime/netpoll.go:351 +0x85 fp=0xc0011057c0 sp=0xc0011057a0 pc=0x2f1cda5
internal/poll.(*pollDesc).wait(0xc001866680?, 0xc001728a00?, 0x0)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0011057e8 sp=0xc0011057c0 pc=0x2fab907
internal/poll.(*pollDesc).waitRead(...)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001866680, {0xc001728a00, 0x2500, 0x2500})
	/usr/lib/golang/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc001105880 sp=0xc0011057e8 pc=0x2facd39
net.(*netFD).Read(0xc001866680, {0xc001728a00?, 0xc001728a00?, 0x5?})
	/usr/lib/golang/src/net/fd_posix.go:68 +0x25 fp=0xc0011058c8 sp=0xc001105880 pc=0x31712e5
net.(*conn).Read(0xc000d6aa10, {0xc001728a00?, 0x7f51f42af700?, 0x7f523c789f30?})
	/usr/lib/golang/src/net/net.go:196 +0x45 fp=0xc001105910 sp=0xc0011058c8 pc=0x3183385
crypto/tls.(*atLeastReader).Read(0xc001800f60, {0xc001728a00?, 0x240a?, 0x0?})
	/usr/lib/golang/src/crypto/tls/conn.go:819 +0x3b fp=0xc001105958 sp=0xc001105910 pc=0x31eef1b
bytes.(*Buffer).ReadFrom(0xc000c129a8, {0x9220320, 0xc001800f60})
	/usr/lib/golang/src/bytes/buffer.go:217 +0x98 fp=0xc0011059b0 sp=0xc001105958 pc=0x2fef578
crypto/tls.(*Conn).readFromUntil(0xc000c12708, {0x9221e00, 0xc000d6aa10}, 0xc001105a18?)
	/usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0011059e8 sp=0xc0011059b0 pc=0x31ef0fe
crypto/tls.(*Conn).readRecordOrCCS(0xc000c12708, 0x0)
	/usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc001105c60 sp=0xc0011059e8 pc=0x31ec17b
crypto/tls.(*Conn).readRecord(...)
	/usr/lib/golang/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc000c12708, {0xc001892000, 0x1000, 0xc0008673b0?})
	/usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc001105cc8 sp=0xc001105c60 pc=0x31f2a85
net/http.(*persistConn).Read(0xc0018445a0, {0xc001892000?, 0x32dcb05?, 0x921acc0?})
	/usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc001105d28 sp=0xc001105cc8 pc=0x32e4407
bufio.(*Reader).fill(0xc000e9db60)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc001105d60 sp=0xc001105d28 pc=0x3084943
bufio.(*Reader).Peek(0xc000e9db60, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc001105d80 sp=0xc001105d60 pc=0x3084ad3
net/http.(*persistConn).readLoop(0xc0018445a0)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc001105fc8 sp=0xc001105d80 pc=0x32e4f12
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc001105fe0 sp=0xc001105fc8 pc=0x32e38a5
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc001105fe8 sp=0xc001105fe0 pc=0x2f26cc1
created by net/http.(*Transport).dialConn in goroutine 197
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

rax    0xca
rbx    0x0
rcx    0x2f28ae3
rdx    0x0
rdi    0xc90cc70
rsi    0x80
rbp    0x7fff4aa32180
rsp    0x7fff4aa32138
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x7fff4aa32180
r13    0x1
r14    0xc90a6e0
r15    0x5
rip    0x2f28ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc00106a780>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-26pckg, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-26pckg" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc00106a780>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-26pckg, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-26pckg" to finish creating: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-qmf5n6" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0007ccbd0>: 
    failed to create HCP cluster cluster-zstream-4-22-qmf5n6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-qmf5n6 in resource group rg-zstream-upgrade-4-22-swxbzb, error: failed waiting for cluster="cluster-zstream-4-22-qmf5n6" in resourcegroup="rg-zstream-upgrade-4-22-swxbzb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-qmf5n6 in resource group rg-zstream-upgrade-4-22-swxbzb, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-qmf5n6" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0007ccbd0>: 
    failed to create HCP cluster cluster-zstream-4-22-qmf5n6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-qmf5n6 in resource group rg-zstream-upgrade-4-22-swxbzb, error: failed waiting for cluster="cluster-zstream-4-22-qmf5n6" in resourcegroup="rg-zstream-upgrade-4-22-swxbzb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-qmf5n6 in resource group rg-zstream-upgrade-4-22-swxbzb, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:132]: failed to add password to app registration
Unexpected error:
    <*fmt.wrapErrors | 0xc0007bf3b0>: 
    add password after 1 attempts; last attempt error: error status code received from the API; polling error: error status code received from the API
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:132]: failed to add password to app registration
Unexpected error:
    <*fmt.wrapErrors | 0xc0007bf3b0>: 
    add password after 1 attempts; last attempt error: error status code received from the API; polling error: error status code received from the API
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-dmjkpc" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0009ef110>: 
    failed to create HCP cluster cluster-zstream-4-22-dmjkpc, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-dmjkpc in resource group rg-zstream-upgrade-4-22-jzf2r6, error: failed waiting for cluster="cluster-zstream-4-22-dmjkpc" in resourcegroup="rg-zstream-upgrade-4-22-jzf2r6" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-dmjkpc in resource group rg-zstream-upgrade-4-22-jzf2r6, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:102]: failed to create HCP cluster "cluster-zstream-4-22-dmjkpc" with version 4.22.0 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0009ef110>: 
    failed to create HCP cluster cluster-zstream-4-22-dmjkpc, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-dmjkpc in resource group rg-zstream-upgrade-4-22-jzf2r6, error: failed waiting for cluster="cluster-zstream-4-22-dmjkpc" in resourcegroup="rg-zstream-upgrade-4-22-jzf2r6" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-dmjkpc in resource group rg-zstream-upgrade-4-22-jzf2r6, error: context deadline exceeded
    ...
occurred