fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-19-v2vs79" with version 4.19.35 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000ce48a0>: 
    failed to create HCP cluster cluster-zstream-4-19-v2vs79, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-v2vs79 in resource group rg-zstream-upgrade-4-19-j968pf, error: failed waiting for cluster="cluster-zstream-4-19-v2vs79" in resourcegroup="rg-zstream-upgrade-4-19-j968pf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-v2vs79 in resource group rg-zstream-upgrade-4-19-j968pf, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-19-v2vs79" with version 4.19.35 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc000ce48a0>: 
    failed to create HCP cluster cluster-zstream-4-19-v2vs79, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-v2vs79 in resource group rg-zstream-upgrade-4-19-j968pf, error: failed waiting for cluster="cluster-zstream-4-19-v2vs79" in resourcegroup="rg-zstream-upgrade-4-19-j968pf" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-v2vs79 in resource group rg-zstream-upgrade-4-19-j968pf, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159]: failed to create HCP cluster for patch-tags test
Unexpected error:
    <*fmt.wrapErrors | 0xc0014e2420>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-kn28ct, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-kn28ct" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-kn28ct, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:159]: failed to create HCP cluster for patch-tags test
Unexpected error:
    <*fmt.wrapErrors | 0xc0014e2420>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-kn28ct, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-kn28ct" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-kn28ct, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-20-ndvw6g" with version 4.20.27 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0009a07e0>: 
    failed to create HCP cluster cluster-zstream-4-20-ndvw6g, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-ndvw6g in resource group rg-zstream-upgrade-4-20-9crtsh, error: failed waiting for cluster="cluster-zstream-4-20-ndvw6g" in resourcegroup="rg-zstream-upgrade-4-20-9crtsh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-ndvw6g in resource group rg-zstream-upgrade-4-20-9crtsh, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-20-ndvw6g" with version 4.20.27 on candidate channel
Unexpected error:
    <*fmt.wrapErrors | 0xc0009a07e0>: 
    failed to create HCP cluster cluster-zstream-4-20-ndvw6g, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-ndvw6g in resource group rg-zstream-upgrade-4-20-9crtsh, error: failed waiting for cluster="cluster-zstream-4-20-ndvw6g" in resourcegroup="rg-zstream-upgrade-4-20-9crtsh" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-ndvw6g in resource group rg-zstream-upgrade-4-20-9crtsh, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.001s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.001s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true

fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s.
Cluster should become ready within '20.000000' minutes
Expected
    <bool>: ...
to be true

c000ea0748)
	/usr/lib/golang/src/sync/waitgroup.go:206 +0x85 fp=0xc00158dac8 sp=0xc00158daa0 pc=0x2f5b405
golang.org/x/sync/errgroup.(*Group).Wait(0xc000ea0740)
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc00158dae8 sp=0xc00158dac8 pc=0x4a8aabe
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7f130446f260, 0xc00157e930}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc00158dd90 sp=0xc00158dae8 pc=0x6c8efde
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).cleanupResourceGroup(0xc000e4c840, {0x7f130446f260, 0xc00157e930}, {0xc000dc6ea0, 0x22}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc00158df08 sp=0xc00158dd90 pc=0x6cb215d
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7f130446f260?, 0xc00157e930?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc00158dfc0 sp=0xc00158df08 pc=0x6cb01f1
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.gowrap1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc00158dfe0 sp=0xc00158dfc0 pc=0x6cb0068
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00158dfe8 sp=0xc00158dfe0 pc=0x2f3ecc1
created by github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups in goroutine 517
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98

goroutine 533 gp=0xc001103340 m=nil [select]:
runtime.gopark(0xc00189d768?, 0x2?, 0x0?, 0x40?, 0xc00189d75c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00189d5e8 sp=0xc00189d5c8 pc=0x2f3650e
runtime.selectgo(0xc00189d768, 0xc00189d758, 0xc000a80180?, 0x0, 0x370521c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00189d728 sp=0xc00189d5e8 pc=0x2f112f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc000033490}, 0x8779154?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00189d798 sp=0xc00189d728 pc=0x3704976
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc000033490}, 0x2f33af3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00189da98 sp=0xc00189d798 pc=0x3e10172
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc000033490}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00189dc20 sp=0xc00189da98 pc=0x6c8bf85
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc000033490?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00189dcc8 sp=0xc00189dc20 pc=0x6c8b9b2
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc000033490?}, 0xc0000334a0?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00189dd20 sp=0xc00189dcc8 pc=0x36b7f42
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc000033490}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00189de68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00189dd98 sp=0xc00189dd20 pc=0x36b5fee
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc000e91b80}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00189def0 sp=0xc00189dd98 pc=0x6c8b725
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00189df78 sp=0xc00189def0 pc=0x6c8f61e
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00189dfe0 sp=0xc00189df78 pc=0x4a8ac10
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00189dfe8 sp=0xc00189dfe0 pc=0x2f3ecc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 526
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xca
rbx    0x0
rcx    0x2f40ae3
rdx    0x0
rdi    0xc9bba10
rsi    0x80
rbp    0x7ffc382442f0
rsp    0x7ffc382442a8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x3
r13    0x1
r14    0xc9b9480
r15    0x7
rip    0x2f40ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command
c000ea0748)
	/usr/lib/golang/src/sync/waitgroup.go:206 +0x85 fp=0xc00158dac8 sp=0xc00158daa0 pc=0x2f5b405
golang.org/x/sync/errgroup.(*Group).Wait(0xc000ea0740)
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc00158dae8 sp=0xc00158dac8 pc=0x4a8aabe
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7f130446f260, 0xc00157e930}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc00158dd90 sp=0xc00158dae8 pc=0x6c8efde
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).cleanupResourceGroup(0xc000e4c840, {0x7f130446f260, 0xc00157e930}, {0xc000dc6ea0, 0x22}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc00158df08 sp=0xc00158dd90 pc=0x6cb215d
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7f130446f260?, 0xc00157e930?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc00158dfc0 sp=0xc00158df08 pc=0x6cb01f1
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.gowrap1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc00158dfe0 sp=0xc00158dfc0 pc=0x6cb0068
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00158dfe8 sp=0xc00158dfe0 pc=0x2f3ecc1
created by github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups in goroutine 517
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98

goroutine 533 gp=0xc001103340 m=nil [select]:
runtime.gopark(0xc00189d768?, 0x2?, 0x0?, 0x40?, 0xc00189d75c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00189d5e8 sp=0xc00189d5c8 pc=0x2f3650e
runtime.selectgo(0xc00189d768, 0xc00189d758, 0xc000a80180?, 0x0, 0x370521c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00189d728 sp=0xc00189d5e8 pc=0x2f112f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc000033490}, 0x8779154?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00189d798 sp=0xc00189d728 pc=0x3704976
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc000033490}, 0x2f33af3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00189da98 sp=0xc00189d798 pc=0x3e10172
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc000033490}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00189dc20 sp=0xc00189da98 pc=0x6c8bf85
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc000033490?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00189dcc8 sp=0xc00189dc20 pc=0x6c8b9b2
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc000033490?}, 0xc0000334a0?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00189dd20 sp=0xc00189dcc8 pc=0x36b7f42
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc000033490}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00189de68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00189dd98 sp=0xc00189dd20 pc=0x36b5fee
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc000e91b80}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00189def0 sp=0xc00189dd98 pc=0x6c8b725
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00189df78 sp=0xc00189def0 pc=0x6c8f61e
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00189dfe0 sp=0xc00189df78 pc=0x4a8ac10
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00189dfe8 sp=0xc00189dfe0 pc=0x2f3ecc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 526
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xca
rbx    0x0
rcx    0x2f40ae3
rdx    0x0
rdi    0xc9bba10
rsi    0x80
rbp    0x7ffc382442f0
rsp    0x7ffc382442a8
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x3
r13    0x1
r14    0xc9b9480
r15    0x7
rip    0x2f40ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command

6cb01f1
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.gowrap1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000ecdfe0 sp=0xc000ecdfc0 pc=0x6cb0068
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000ecdfe8 sp=0xc000ecdfe0 pc=0x2f3ecc1
created by github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups in goroutine 282
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98

goroutine 315 gp=0xc0016b9340 m=nil [select]:
runtime.gopark(0xc000b05f48?, 0x2?, 0xc0?, 0x5d?, 0xc000b05ef4?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000b05d78 sp=0xc000b05d58 pc=0x2f3650e
runtime.selectgo(0xc000b05f48, 0xc000b05ef0, 0xc000e26c40?, 0x0, 0x0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000b05eb8 sp=0xc000b05d78 pc=0x2f112f7
net/http.(*persistConn).writeLoop(0xc000adefc0)
	/usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc000b05fc8 sp=0xc000b05eb8 pc=0x32fec87
net/http.(*Transport).dialConn.gowrap3()
	/usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc000b05fe0 sp=0xc000b05fc8 pc=0x32fb925
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b05fe8 sp=0xc000b05fe0 pc=0x2f3ecc1
created by net/http.(*Transport).dialConn in goroutine 283
	/usr/lib/golang/src/net/http/transport.go:1948 +0x17a5

goroutine 314 gp=0xc0016b96c0 m=nil [IO wait]:
runtime.gopark(0xc0009cc3a0?, 0xc0000c3788?, 0xc5?, 0x3e?, 0xb?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0000c3768 sp=0xc0000c3748 pc=0x2f3650e
runtime.netpollblock(0x2fa0ad8?, 0x2ec2066?, 0x0?)
	/usr/lib/golang/src/runtime/netpoll.go:575 +0xf7 fp=0xc0000c37a0 sp=0xc0000c3768 pc=0x2ef5fb7
internal/poll.runtime_pollWait(0x7f0ad6814a00, 0x72)
	/usr/lib/golang/src/runtime/netpoll.go:351 +0x85 fp=0xc0000c37c0 sp=0xc0000c37a0 pc=0x2f34da5
internal/poll.(*pollDesc).wait(0xc001816c80?, 0xc000dec000?, 0x0)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0000c37e8 sp=0xc0000c37c0 pc=0x2fc3907
internal/poll.(*pollDesc).waitRead(...)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001816c80, {0xc000dec000, 0x1300, 0x1300})
	/usr/lib/golang/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc0000c3880 sp=0xc0000c37e8 pc=0x2fc4d39
net.(*netFD).Read(0xc001816c80, {0xc000dec000?, 0xc000dec000?, 0x5?})
	/usr/lib/golang/src/net/fd_posix.go:68 +0x25 fp=0xc0000c38c8 sp=0xc0000c3880 pc=0x31893c5
net.(*conn).Read(0xc0000b4318, {0xc000dec000?, 0x7f0ad57c8a48?, 0x7f0b1d3fb5c0?})
	/usr/lib/golang/src/net/net.go:196 +0x45 fp=0xc0000c3910 sp=0xc0000c38c8 pc=0x319b465
crypto/tls.(*atLeastReader).Read(0xc0010f29d8, {0xc000dec000?, 0x120a?, 0x2ed79d6?})
	/usr/lib/golang/src/crypto/tls/conn.go:819 +0x3b fp=0xc0000c3958 sp=0xc0000c3910 pc=0x3206ffb
bytes.(*Buffer).ReadFrom(0xc0009a82a8, {0x92dd8a0, 0xc0010f29d8})
	/usr/lib/golang/src/bytes/buffer.go:217 +0x98 fp=0xc0000c39b0 sp=0xc0000c3958 pc=0x3007578
crypto/tls.(*Conn).readFromUntil(0xc0009a8008, {0x92df380, 0xc0000b4318}, 0xc0000c3a18?)
	/usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0000c39e8 sp=0xc0000c39b0 pc=0x32071de
crypto/tls.(*Conn).readRecordOrCCS(0xc0009a8008, 0x0)
	/usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc0000c3c60 sp=0xc0000c39e8 pc=0x320425b
crypto/tls.(*Conn).readRecord(...)
	/usr/lib/golang/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc0009a8008, {0xc000b0e000, 0x1000, 0xc000a4f650?})
	/usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc0000c3cc8 sp=0xc0000c3c60 pc=0x320ab65
net/http.(*persistConn).Read(0xc000adefc0, {0xc000b0e000?, 0x32f4be5?, 0x92d8260?})
	/usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc0000c3d28 sp=0xc0000c3cc8 pc=0x32fc4e7
bufio.(*Reader).fill(0xc000c2daa0)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc0000c3d60 sp=0xc0000c3d28 pc=0x309ca23
bufio.(*Reader).Peek(0xc000c2daa0, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc0000c3d80 sp=0xc0000c3d60 pc=0x309cbb3
net/http.(*persistConn).readLoop(0xc000adefc0)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc0000c3fc8 sp=0xc0000c3d80 pc=0x32fcff2
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc0000c3fe0 sp=0xc0000c3fc8 pc=0x32fb985
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0000c3fe8 sp=0xc0000c3fe0 pc=0x2f3ecc1
created by net/http.(*Transport).dialConn in goroutine 283
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

rax    0xca
rbx    0x0
rcx    0x2f40ae3
rdx    0x0
rdi    0xc9bba10
rsi    0x80
rbp    0x7fff7dbe62d0
rsp    0x7fff7dbe6288
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x0
r13    0x0
r14    0xc9b9480
r15    0x7
rip    0x2f40ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command
6cb01f1
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.gowrap1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000ecdfe0 sp=0xc000ecdfc0 pc=0x6cb0068
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000ecdfe8 sp=0xc000ecdfe0 pc=0x2f3ecc1
created by github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups in goroutine 282
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98

goroutine 315 gp=0xc0016b9340 m=nil [select]:
runtime.gopark(0xc000b05f48?, 0x2?, 0xc0?, 0x5d?, 0xc000b05ef4?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000b05d78 sp=0xc000b05d58 pc=0x2f3650e
runtime.selectgo(0xc000b05f48, 0xc000b05ef0, 0xc000e26c40?, 0x0, 0x0?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000b05eb8 sp=0xc000b05d78 pc=0x2f112f7
net/http.(*persistConn).writeLoop(0xc000adefc0)
	/usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc000b05fc8 sp=0xc000b05eb8 pc=0x32fec87
net/http.(*Transport).dialConn.gowrap3()
	/usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc000b05fe0 sp=0xc000b05fc8 pc=0x32fb925
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b05fe8 sp=0xc000b05fe0 pc=0x2f3ecc1
created by net/http.(*Transport).dialConn in goroutine 283
	/usr/lib/golang/src/net/http/transport.go:1948 +0x17a5

goroutine 314 gp=0xc0016b96c0 m=nil [IO wait]:
runtime.gopark(0xc0009cc3a0?, 0xc0000c3788?, 0xc5?, 0x3e?, 0xb?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0000c3768 sp=0xc0000c3748 pc=0x2f3650e
runtime.netpollblock(0x2fa0ad8?, 0x2ec2066?, 0x0?)
	/usr/lib/golang/src/runtime/netpoll.go:575 +0xf7 fp=0xc0000c37a0 sp=0xc0000c3768 pc=0x2ef5fb7
internal/poll.runtime_pollWait(0x7f0ad6814a00, 0x72)
	/usr/lib/golang/src/runtime/netpoll.go:351 +0x85 fp=0xc0000c37c0 sp=0xc0000c37a0 pc=0x2f34da5
internal/poll.(*pollDesc).wait(0xc001816c80?, 0xc000dec000?, 0x0)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0000c37e8 sp=0xc0000c37c0 pc=0x2fc3907
internal/poll.(*pollDesc).waitRead(...)
	/usr/lib/golang/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc001816c80, {0xc000dec000, 0x1300, 0x1300})
	/usr/lib/golang/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc0000c3880 sp=0xc0000c37e8 pc=0x2fc4d39
net.(*netFD).Read(0xc001816c80, {0xc000dec000?, 0xc000dec000?, 0x5?})
	/usr/lib/golang/src/net/fd_posix.go:68 +0x25 fp=0xc0000c38c8 sp=0xc0000c3880 pc=0x31893c5
net.(*conn).Read(0xc0000b4318, {0xc000dec000?, 0x7f0ad57c8a48?, 0x7f0b1d3fb5c0?})
	/usr/lib/golang/src/net/net.go:196 +0x45 fp=0xc0000c3910 sp=0xc0000c38c8 pc=0x319b465
crypto/tls.(*atLeastReader).Read(0xc0010f29d8, {0xc000dec000?, 0x120a?, 0x2ed79d6?})
	/usr/lib/golang/src/crypto/tls/conn.go:819 +0x3b fp=0xc0000c3958 sp=0xc0000c3910 pc=0x3206ffb
bytes.(*Buffer).ReadFrom(0xc0009a82a8, {0x92dd8a0, 0xc0010f29d8})
	/usr/lib/golang/src/bytes/buffer.go:217 +0x98 fp=0xc0000c39b0 sp=0xc0000c3958 pc=0x3007578
crypto/tls.(*Conn).readFromUntil(0xc0009a8008, {0x92df380, 0xc0000b4318}, 0xc0000c3a18?)
	/usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0000c39e8 sp=0xc0000c39b0 pc=0x32071de
crypto/tls.(*Conn).readRecordOrCCS(0xc0009a8008, 0x0)
	/usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc0000c3c60 sp=0xc0000c39e8 pc=0x320425b
crypto/tls.(*Conn).readRecord(...)
	/usr/lib/golang/src/crypto/tls/conn.go:592
crypto/tls.(*Conn).Read(0xc0009a8008, {0xc000b0e000, 0x1000, 0xc000a4f650?})
	/usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc0000c3cc8 sp=0xc0000c3c60 pc=0x320ab65
net/http.(*persistConn).Read(0xc000adefc0, {0xc000b0e000?, 0x32f4be5?, 0x92d8260?})
	/usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc0000c3d28 sp=0xc0000c3cc8 pc=0x32fc4e7
bufio.(*Reader).fill(0xc000c2daa0)
	/usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc0000c3d60 sp=0xc0000c3d28 pc=0x309ca23
bufio.(*Reader).Peek(0xc000c2daa0, 0x1)
	/usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc0000c3d80 sp=0xc0000c3d60 pc=0x309cbb3
net/http.(*persistConn).readLoop(0xc000adefc0)
	/usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc0000c3fc8 sp=0xc0000c3d80 pc=0x32fcff2
net/http.(*Transport).dialConn.gowrap2()
	/usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc0000c3fe0 sp=0xc0000c3fc8 pc=0x32fb985
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0000c3fe8 sp=0xc0000c3fe0 pc=0x2f3ecc1
created by net/http.(*Transport).dialConn in goroutine 283
	/usr/lib/golang/src/net/http/transport.go:1947 +0x174f

rax    0xca
rbx    0x0
rcx    0x2f40ae3
rdx    0x0
rdi    0xc9bba10
rsi    0x80
rbp    0x7fff7dbe62d0
rsp    0x7fff7dbe6288
r8     0x0
r9     0x0
r10    0x0
r11    0x286
r12    0x0
r13    0x0
r14    0xc9b9480
r15    0x7
rip    0x2f40ae1
rflags 0x286
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command

ync/waitgroup.go:206 +0x85 fp=0xc000e5fac8 sp=0xc000e5faa0 pc=0x2f5b405
golang.org/x/sync/errgroup.(*Group).Wait(0xc000e97840)
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc000e5fae8 sp=0xc000e5fac8 pc=0x4a8aabe
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7fc97c1bf660, 0xc000b97f50}, 0xc001082750, {0xc0009bb5c0, 0x11}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc000e5fd90 sp=0xc000e5fae8 pc=0x6c8efde
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).cleanupResourceGroup(0xc000c154a0, {0x7fc97c1bf660, 0xc000b97f50}, {0xc0009bb5c0, 0x11}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc000e5ff08 sp=0xc000e5fd90 pc=0x6cb215d
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7fc97c1bf660?, 0xc000b97f50?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc000e5ffc0 sp=0xc000e5ff08 pc=0x6cb01f1
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.gowrap1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000e5ffe0 sp=0xc000e5ffc0 pc=0x6cb0068
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e5ffe8 sp=0xc000e5ffe0 pc=0x2f3ecc1
created by github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups in goroutine 470
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98

goroutine 491 gp=0xc0011ae380 m=nil [select]:
runtime.gopark(0xc00165b768?, 0x2?, 0x0?, 0x5a?, 0xc00165b75c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00165b5e8 sp=0xc00165b5c8 pc=0x2f3650e
runtime.selectgo(0xc00165b768, 0xc00165b758, 0xc0006feca0?, 0x0, 0x370521c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00165b728 sp=0xc00165b5e8 pc=0x2f112f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc001566070}, 0x8779154?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00165b798 sp=0xc00165b728 pc=0x3704976
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc001566070}, 0x2f33af3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00165ba98 sp=0xc00165b798 pc=0x3e10172
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc001566070}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00165bc20 sp=0xc00165ba98 pc=0x6c8bf85
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc001566070?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00165bcc8 sp=0xc00165bc20 pc=0x6c8b9b2
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc001566070?}, 0xc001566080?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00165bd20 sp=0xc00165bcc8 pc=0x36b7f42
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc001566070}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00165be68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00165bd98 sp=0xc00165bd20 pc=0x36b5fee
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc0007baff0}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00165bef0 sp=0xc00165bd98 pc=0x6c8b725
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00165bf78 sp=0xc00165bef0 pc=0x6c8f61e
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00165bfe0 sp=0xc00165bf78 pc=0x4a8ac10
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00165bfe8 sp=0xc00165bfe0 pc=0x2f3ecc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 502
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xfffffffffffffffc
rbx    0x5
rcx    0x2eb5e2e
rdx    0x80
rdi    0x5
rsi    0x7ffcb9d27d24
rbp    0x7ffcb9d27cd8
rsp    0x7ffcb9d27c90
r8     0x0
r9     0x0
r10    0x393
r11    0x246
r12    0x7ffcb9d27d68
r13    0x1
r14    0xc9b9480
r15    0x3
rip    0x2eb5e2e
rflags 0x246
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command
ync/waitgroup.go:206 +0x85 fp=0xc000e5fac8 sp=0xc000e5faa0 pc=0x2f5b405
golang.org/x/sync/errgroup.(*Group).Wait(0xc000e97840)
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc000e5fae8 sp=0xc000e5fac8 pc=0x4a8aabe
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7fc97c1bf660, 0xc000b97f50}, 0xc001082750, {0xc0009bb5c0, 0x11}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc000e5fd90 sp=0xc000e5fae8 pc=0x6c8efde
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).cleanupResourceGroup(0xc000c154a0, {0x7fc97c1bf660, 0xc000b97f50}, {0xc0009bb5c0, 0x11}, 0x34630b8a000)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc000e5ff08 sp=0xc000e5fd90 pc=0x6cb215d
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7fc97c1bf660?, 0xc000b97f50?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc000e5ffc0 sp=0xc000e5ff08 pc=0x6cb01f1
github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups.gowrap1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000e5ffe0 sp=0xc000e5ffc0 pc=0x6cb0068
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e5ffe8 sp=0xc000e5ffe0 pc=0x2f3ecc1
created by github.com/Azure/ARO-HCP/test/util/framework.(*perItOrDescribeTestContext).CleanupResourceGroups in goroutine 470
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98

goroutine 491 gp=0xc0011ae380 m=nil [select]:
runtime.gopark(0xc00165b768?, 0x2?, 0x0?, 0x5a?, 0xc00165b75c?)
	/usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00165b5e8 sp=0xc00165b5c8 pc=0x2f3650e
runtime.selectgo(0xc00165b768, 0xc00165b758, 0xc0006feca0?, 0x0, 0x370521c?, 0x1)
	/usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00165b728 sp=0xc00165b5e8 pc=0x2f112f7
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc001566070}, 0x8779154?)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00165b798 sp=0xc00165b728 pc=0x3704976
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc001566070}, 0x2f33af3)
	/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00165ba98 sp=0xc00165b798 pc=0x3e10172
github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc001566070}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00165bc20 sp=0xc00165ba98 pc=0x6c8bf85
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc001566070?})
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00165bcc8 sp=0xc00165bc20 pc=0x6c8b9b2
k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc001566070?}, 0xc001566080?)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00165bd20 sp=0xc00165bcc8 pc=0x36b7f42
k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc001566070}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00165be68)
	/go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00165bd98 sp=0xc00165bd20 pc=0x36b5fee
github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc0007baff0}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12}, 0x274a48a7800)
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00165bef0 sp=0xc00165bd98 pc=0x6c8b725
github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1()
	/opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00165bf78 sp=0xc00165bef0 pc=0x6c8f61e
golang.org/x/sync/errgroup.(*Group).Go.func1()
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00165bfe0 sp=0xc00165bf78 pc=0x4a8ac10
runtime.goexit({})
	/usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00165bfe8 sp=0xc00165bfe0 pc=0x2f3ecc1
created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 502
	/go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95

rax    0xfffffffffffffffc
rbx    0x5
rcx    0x2eb5e2e
rdx    0x80
rdi    0x5
rsi    0x7ffcb9d27d24
rbp    0x7ffcb9d27cd8
rsp    0x7ffcb9d27c90
r8     0x0
r9     0x0
r10    0x393
r11    0x246
r12    0x7ffcb9d27d68
r13    0x1
r14    0xc9b9480
r15    0x3
rip    0x2eb5e2e
rflags 0x246
cs     0x33
fs     0x0
gs     0x0
Command Error: exit status 2
Deserialization Error: no output from command

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0008eab80>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-c67zkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-c67zkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0008eab80>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-c67zkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-c67zkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0018a7a40>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-r42t7t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-r42t7t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0018a7a40>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-r42t7t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-r42t7t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0008bf9e0>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-brwgxc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-brwgxc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled
Unexpected error:
    <*fmt.wrapError | 0xc0008bf9e0>: 
    failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-brwgxc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-brwgxc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag",
        "target": "tags[aro-hcp.experimental.cluster.fips-enabled]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false
Expected
    <string>: ...
to contain substring
    <string>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false
Expected
    <string>: ...
to contain substring
    <string>: ...

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-nightly-4-21-pgpqxt"
Unexpected error:
    <*fmt.wrapError | 0xc00102e060>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-njf6z.apps.aro.d8f0y3s7c3c7p2d.ek0b.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-nightly-4-21-pgpqxt"
Unexpected error:
    <*fmt.wrapError | 0xc00102e060>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-njf6z.apps.aro.d8f0y3s7c3c7p2d.ek0b.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-20-grqfrx"
Unexpected error:
    <*fmt.wrapError | 0xc000498440>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-rvc2j.apps.aro.b6f7d0t5b9c7m1v.opfq.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:172]: failed to verify simple web app runs on cluster "cluster-candidate-4-20-grqfrx"
Unexpected error:
    <*fmt.wrapError | 0xc000498440>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-rvc2j.apps.aro.b6f7d0t5b9c7m1v.opfq.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:197]: failed to verify simple web app on back-level cluster version 4.19
Unexpected error:
    <*fmt.wrapError | 0xc000f18c00>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-wtf7m.apps.aro.e8g5g8f5f1b8d7k.ykxw.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:197]: failed to verify simple web app on back-level cluster version 4.19
Unexpected error:
    <*fmt.wrapError | 0xc000f18c00>: 
    route was never reachable: Get "https://agnhost-e2e-serving-app-wtf7m.apps.aro.e8g5g8f5f1b8d7k.ykxw.uksouth.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:119]: failed to get admin REST config for HCP cluster fips-enabled-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001cfeba0>: 
    failed waiting for hcpCluster="fips-enabled-cluster" in resourcegroup="fips-enabled-pqvwsl" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster fips-enabled-cluster in resource group fips-enabled-pqvwsl, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:119]: failed to get admin REST config for HCP cluster fips-enabled-cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc001cfeba0>: 
    failed waiting for hcpCluster="fips-enabled-cluster" in resourcegroup="fips-enabled-pqvwsl" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster fips-enabled-cluster in resource group fips-enabled-pqvwsl, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:119]: failed to get admin REST config for cluster "cluster-zstream-4-22-9mnhf7"
Unexpected error:
    <*fmt.wrapErrors | 0xc0005f6cf0>: 
    failed waiting for hcpCluster="cluster-zstream-4-22-9mnhf7" in resourcegroup="rg-zstream-upgrade-4-22-6vc2xq" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-zstream-4-22-9mnhf7 in resource group rg-zstream-upgrade-4-22-6vc2xq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:119]: failed to get admin REST config for cluster "cluster-zstream-4-22-9mnhf7"
Unexpected error:
    <*fmt.wrapErrors | 0xc0005f6cf0>: 
    failed waiting for hcpCluster="cluster-zstream-4-22-9mnhf7" in resourcegroup="rg-zstream-upgrade-4-22-6vc2xq" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster cluster-zstream-4-22-9mnhf7 in resource group rg-zstream-upgrade-4-22-6vc2xq, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:161]: failed to get admin REST config for cluster np-version-upgrade-cluster-gv255d
Unexpected error:
    <*fmt.wrapErrors | 0xc002418720>: 
    failed waiting for hcpCluster="np-version-upgrade-cluster-gv255d" in resourcegroup="rg-np-version-upgrade-gv255d-bzslj8" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster np-version-upgrade-cluster-gv255d in resource group rg-np-version-upgrade-gv255d-bzslj8, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:161]: failed to get admin REST config for cluster np-version-upgrade-cluster-gv255d
Unexpected error:
    <*fmt.wrapErrors | 0xc002418720>: 
    failed waiting for hcpCluster="np-version-upgrade-cluster-gv255d" in resourcegroup="rg-np-version-upgrade-gv255d-bzslj8" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster np-version-upgrade-cluster-gv255d in resource group rg-np-version-upgrade-gv255d-bzslj8, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-s2txmj" for cluster "cluster-candidate-4-21-s2txmj"
Unexpected error:
    <*fmt.wrapErrors | 0xc001b15ec0>: 
    failed to create NodePool np-s2txmj, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-s2txmj in resource group rg-candidate-4-21-hlz6pz, error: failed waiting for nodepool="np-s2txmj" for cluster "cluster-candidate-4-21-s2txmj" in resourcegroup="rg-candidate-4-21-hlz6pz" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-s2txmj" for cluster "cluster-candidate-4-21-s2txmj"
Unexpected error:
    <*fmt.wrapErrors | 0xc001b15ec0>: 
    failed to create NodePool np-s2txmj, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-s2txmj in resource group rg-candidate-4-21-hlz6pz, error: failed waiting for nodepool="np-s2txmj" for cluster "cluster-candidate-4-21-s2txmj" in resourcegroup="rg-candidate-4-21-hlz6pz" to finish creating: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-sfgvlw" for cluster "cluster-candidate-5-0-sfgvlw"
Unexpected error:
    <*fmt.wrapErrors | 0xc00030d050>: 
    failed to create NodePool np-sfgvlw, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-sfgvlw in resource group rg-candidate-5-0-dl7nwv, error: failed waiting for nodepool="np-sfgvlw" for cluster "cluster-candidate-5-0-sfgvlw" in resourcegroup="rg-candidate-5-0-dl7nwv" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:159]: failed to create node pool "np-sfgvlw" for cluster "cluster-candidate-5-0-sfgvlw"
Unexpected error:
    <*fmt.wrapErrors | 0xc00030d050>: 
    failed to create NodePool np-sfgvlw, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-sfgvlw in resource group rg-candidate-5-0-dl7nwv, error: failed waiting for nodepool="np-sfgvlw" for cluster "cluster-candidate-5-0-sfgvlw" in resourcegroup="rg-candidate-5-0-dl7nwv" to finish creating: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:259]: failed to create nodepool "np-1" for authorized CIDRs cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc002488cc0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-8k9j5p, error: failed waiting for nodepool="np-1" for cluster "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-8k9j5p" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:259]: failed to create nodepool "np-1" for authorized CIDRs cluster
Unexpected error:
    <*fmt.wrapErrors | 0xc002488cc0>: 
    failed to create NodePool np-1, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool np-1 in resource group e2e-cidr-connectivity-8k9j5p, error: failed waiting for nodepool="np-1" for cluster "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-8k9j5p" to finish creating: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00169e090>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster2" in resourcegroup="customer-rg-hbdz7m" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc00169e090>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-hcp-cluster2" in resourcegroup="customer-rg-hbdz7m" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000a20330>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-zstream-4-20-8s4rn7" in resourcegroup="rg-zstream-upgrade-4-20-tp4pvb" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000a20330>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-zstream-4-20-8s4rn7" in resourcegroup="rg-zstream-upgrade-4-20-tp4pvb" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000d4b050>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-rvc9mn" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000d4b050>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="patch-tags-cluster" in resourcegroup="patch-tags-rvc9mn" to finish deleting: context canceled
    ...
occurred  
fail [:0]: A node timeout occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up
Unexpected error:
    <*fmt.wrapErrors | 0xc0027caba0>: 
    failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-9qjlw2" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-9qjlw2, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up
Unexpected error:
    <*fmt.wrapErrors | 0xc0027caba0>: 
    failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-9qjlw2" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-9qjlw2, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.21.22
Unexpected error:
    <*fmt.wrapErrors | 0xc000890ea0>: 
    failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-fr5x47" resourcegroup="rg-np-version-upgrade-fr5x47-tjnxv8" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-fr5x47 in resource group rg-np-version-upgrade-fr5x47-tjnxv8, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.21.22
Unexpected error:
    <*fmt.wrapErrors | 0xc000890ea0>: 
    failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-fr5x47" resourcegroup="rg-np-version-upgrade-fr5x47-tjnxv8" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-fr5x47 in resource group rg-np-version-upgrade-fr5x47-tjnxv8, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up
Unexpected error:
    <*fmt.wrapErrors | 0xc0025850e0>: 
    failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-cqzk85" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-cqzk85, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up
Unexpected error:
    <*fmt.wrapErrors | 0xc0025850e0>: 
    failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-cqzk85" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-cqzk85, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.002s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.002s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.000s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.000s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with:
cluster has not yet reached Succeeded state
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
to equal
    <armredhatopenshifthcp.ProvisioningState>: ...

fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation (timeout '20.000000' minutes)
Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation (timeout '20.000000' minutes)
Unexpected error:
    <context.deadlineExceededError>: 
    context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.001s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <x509.UnknownAuthorityError>: 
    x509: certificate signed by unknown authority
    ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.001s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <x509.UnknownAuthorityError>: 
    x509: certificate signed by unknown authority
    ...

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.003s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <x509.UnknownAuthorityError>: 
    x509: certificate signed by unknown authority
    ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:167]: Timed out after 600.003s.
expect ingress certificate to be signed by a trusted Azure CA
Expected success, but got an error:
    <x509.UnknownAuthorityError>: 
    x509: certificate signed by unknown authority
    ...

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc002730108>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-np-skip-minor-j5x5g5-c9l8qq", caused by: failed waiting for hcpCluster="np-skip-minor-j5x5g5" in resourcegroup="rg-np-skip-minor-j5x5g5-c9l8qq" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster np-skip-minor-j5x5g5 in resource group rg-np-skip-minor-j5x5g5-c9l8qq, error: context deadline exceeded, error: failed waiting for hcpCluster="np-skip-minor-j5x5g5" in resourcegroup="rg-np-skip-minor-j5x5g5-c9l8qq" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster np-skip-minor-j5x5g5 in resource group rg-np-skip-minor-j5x5g5-c9l8qq, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc002730108>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-np-skip-minor-j5x5g5-c9l8qq", caused by: failed waiting for hcpCluster="np-skip-minor-j5x5g5" in resourcegroup="rg-np-skip-minor-j5x5g5-c9l8qq" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster np-skip-minor-j5x5g5 in resource group rg-np-skip-minor-j5x5g5-c9l8qq, error: context deadline exceeded, error: failed waiting for hcpCluster="np-skip-minor-j5x5g5" in resourcegroup="rg-np-skip-minor-j5x5g5-c9l8qq" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster np-skip-minor-j5x5g5 in resource group rg-np-skip-minor-j5x5g5-c9l8qq, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc0010aa120>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="admin-credential-lifecycle-test-glprsp", caused by: failed waiting for hcpCluster="admin-cred-lifecycle-n7dbhc" in resourcegroup="admin-credential-lifecycle-test-glprsp" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-n7dbhc in resource group admin-credential-lifecycle-test-glprsp, error: context deadline exceeded, error: failed waiting for hcpCluster="admin-cred-lifecycle-n7dbhc" in resourcegroup="admin-credential-lifecycle-test-glprsp" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-n7dbhc in resource group admin-credential-lifecycle-test-glprsp, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc0010aa120>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="admin-credential-lifecycle-test-glprsp", caused by: failed waiting for hcpCluster="admin-cred-lifecycle-n7dbhc" in resourcegroup="admin-credential-lifecycle-test-glprsp" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-n7dbhc in resource group admin-credential-lifecycle-test-glprsp, error: context deadline exceeded, error: failed waiting for hcpCluster="admin-cred-lifecycle-n7dbhc" in resourcegroup="admin-credential-lifecycle-test-glprsp" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-n7dbhc in resource group admin-credential-lifecycle-test-glprsp, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc001f842d0>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-cluster-back-version-wkj8vb", caused by: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-wkj8vb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-wkj8vb, error: context deadline exceeded, error: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-wkj8vb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-wkj8vb, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283]: Unexpected error:
    <*errors.joinError | 0xc001f842d0>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-cluster-back-version-wkj8vb", caused by: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-wkj8vb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-wkj8vb, error: context deadline exceeded, error: failed waiting for hcpCluster="cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-wkj8vb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cluster-ver-4-19 in resource group rg-cluster-back-version-wkj8vb, error: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc001a6a3a8>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-rbkvwl, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-rbkvwl" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:190]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc001a6a3a8>: 
    VerifyNodesReady failed: no nodes found in the cluster
    VerifyCiliumOperational failed: not all pods in kube-system namespace are running: failed to list pods in kube-system namespace: client rate limiter Wait returned an error: context deadline exceeded
    failed to create NodePool cilium-np, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool cilium-np in resource group complex-cilium-kv-rbkvwl, error: failed waiting for nodepool="cilium-np" for cluster "cilium-cluster" in resourcegroup="complex-cilium-kv-rbkvwl" to finish creating: context deadline exceeded
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapError | 0xc00075fe00>: 
    failed to create HCP cluster np-dg-minor-n6g6vl: failed starting cluster creation "np-dg-minor-n6g6vl" in resourcegroup="rg-np-dg-minor-n6g6vl-nfnpp4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-n6g6vl-nfnpp4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-n6g6vl
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Version 'openshift-v4.21.0-0.nightly-multi-2026-07-12-202543-nightly' doesn't exist"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster
Unexpected error:
    <*fmt.wrapError | 0xc00075fe00>: 
    failed to create HCP cluster np-dg-minor-n6g6vl: failed starting cluster creation "np-dg-minor-n6g6vl" in resourcegroup="rg-np-dg-minor-n6g6vl-nfnpp4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-n6g6vl-nfnpp4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-n6g6vl
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Version 'openshift-v4.21.0-0.nightly-multi-2026-07-12-202543-nightly' doesn't exist"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:123]: failed to verify FIPS is enabled on cluster fips-enabled-cluster
Unexpected error:
    <*errors.joinError | 0xc000b267e0>: 
    VerifyFIPSEnabled failed: failed to check FIPS mode on node e9n0y8t3z6s7y7t-np-1-6l2x9-pkqwh: failed to create FIPS check pod: pods "fips-check-" is forbidden: error looking up service account e2e-fips-test-h4zck/default: serviceaccount "default" not found
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:123]: failed to verify FIPS is enabled on cluster fips-enabled-cluster
Unexpected error:
    <*errors.joinError | 0xc000b267e0>: 
    VerifyFIPSEnabled failed: failed to check FIPS mode on node e9n0y8t3z6s7y7t-np-1-6l2x9-pkqwh: failed to create FIPS check pod: pods "fips-check-" is forbidden: error looking up service account e2e-fips-test-h4zck/default: serviceaccount "default" not found
    ...
occurred

fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to create node pool version 4.19.7 for back-level cluster
Unexpected error:
    <*fmt.wrapError | 0xc000f19d40>: 
    failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-jbrspk" to finish creating: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to create node pool version 4.19.7 for back-level cluster
Unexpected error:
    <*fmt.wrapError | 0xc000f19d40>: 
    failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-jbrspk" to finish creating: context deadline exceeded
    ...
occurred