CIHealth Run Log

Environment: PROD

Time (UTC)	Job	Failed at	Result	PR	Failed tests	Details
23:00:22	periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel-ocp-nightly post-goodmerged PR No additional run metadata captured	n/a	passed	n/a	0	n/a
14:15:53	branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	44	e2e (44) timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:459]: failed to create HCP cluster np-skip-minor-d4skmk at version 4.22.3 Unexpected error: <fmt.wrapErrors \| 0xc00184a4b0>: failed to create HCP cluster np-skip-minor-d4skmk, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-d4skmk in resource group rg-np-skip-minor-d4skmk-bms7sf, error: failed waiting for cluster="np-skip-minor-d4skmk" in resourcegroup="rg-np-skip-minor-d4skmk-bms7sf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-d4skmk in resource group rg-np-skip-minor-d4skmk-bms7sf, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:459]: failed to create HCP cluster np-skip-minor-d4skmk at version 4.22.3 Unexpected error: <fmt.wrapErrors \| 0xc00184a4b0>: failed to create HCP cluster np-skip-minor-d4skmk, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-d4skmk in resource group rg-np-skip-minor-d4skmk-bms7sf, error: failed waiting for cluster="np-skip-minor-d4skmk" in resourcegroup="rg-np-skip-minor-d4skmk-bms7sf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-skip-minor-d4skmk in resource group rg-np-skip-minor-d4skmk-bms7sf, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapErrors \| 0xc0011863f0>: failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-b5lpzp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-b5lpzp, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:97]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapErrors \| 0xc0011863f0>: failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-b5lpzp" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-b5lpzp, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-21-m25z2g/cluster-candidate-4-21-vz9lnx should provision Unexpected error: <fmt.wrapErrors \| 0xc000a18360>: failed to create HCP cluster cluster-candidate-4-21-vz9lnx, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-vz9lnx in resource group rg-candidate-4-21-m25z2g, error: failed waiting for cluster="cluster-candidate-4-21-vz9lnx" in resourcegroup="rg-candidate-4-21-m25z2g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-vz9lnx in resource group rg-candidate-4-21-m25z2g, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-21-m25z2g/cluster-candidate-4-21-vz9lnx should provision Unexpected error: <fmt.wrapErrors \| 0xc000a18360>: failed to create HCP cluster cluster-candidate-4-21-vz9lnx, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-vz9lnx in resource group rg-candidate-4-21-m25z2g, error: failed waiting for cluster="cluster-candidate-4-21-vz9lnx" in resourcegroup="rg-candidate-4-21-m25z2g" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-21-vz9lnx in resource group rg-candidate-4-21-m25z2g, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapErrors \| 0xc000be54a0>: failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-fw6j67, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-fw6j67" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-fw6j67, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapErrors \| 0xc000be54a0>: failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-fw6j67, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-fw6j67" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-fw6j67, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-gsgnc4 Unexpected error: <fmt.wrapErrors \| 0xc001540870>: failed to create HCP cluster np-noedge-gsgnc4, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-gsgnc4 in resource group rg-np-noedge-gsgnc4-8q29l4, error: failed waiting for cluster="np-noedge-gsgnc4" in resourcegroup="rg-np-noedge-gsgnc4-8q29l4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-gsgnc4 in resource group rg-np-noedge-gsgnc4-8q29l4, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:312]: failed to create HCP cluster np-noedge-gsgnc4 Unexpected error: <fmt.wrapErrors \| 0xc001540870>: failed to create HCP cluster np-noedge-gsgnc4, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-gsgnc4 in resource group rg-np-noedge-gsgnc4-8q29l4, error: failed waiting for cluster="np-noedge-gsgnc4" in resourcegroup="rg-np-noedge-gsgnc4-8q29l4" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-noedge-gsgnc4 in resource group rg-np-noedge-gsgnc4-8q29l4, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:86]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapErrors \| 0xc0010e6930>: failed to create HCP cluster ea-listbk9qsn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listbk9qsn in resource group ea-list-8krq8c, error: failed waiting for cluster="ea-listbk9qsn" in resourcegroup="ea-list-8krq8c" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listbk9qsn in resource group ea-list-8krq8c, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:86]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapErrors \| 0xc0010e6930>: failed to create HCP cluster ea-listbk9qsn, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listbk9qsn in resource group ea-list-8krq8c, error: failed waiting for cluster="ea-listbk9qsn" in resourcegroup="ea-list-8krq8c" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listbk9qsn in resource group ea-list-8krq8c, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:87]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc0017a6840>: failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-kx68zb, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-kx68zb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-kx68zb, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:87]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc0017a6840>: failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-kx68zb, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-kx68zb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-kx68zb, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapErrors \| 0xc001546b40>: failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-9jqgqm, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-9jqgqm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-9jqgqm, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapErrors \| 0xc001546b40>: failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-9jqgqm, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-9jqgqm" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-9jqgqm, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-hc2cbq with version 4.21.22 Unexpected error: <fmt.wrapErrors \| 0xc00178c090>: failed to create HCP cluster np-version-upgrade-cluster-hc2cbq, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-hc2cbq in resource group rg-np-version-upgrade-hc2cbq-9ltbgw, error: failed waiting for cluster="np-version-upgrade-cluster-hc2cbq" in resourcegroup="rg-np-version-upgrade-hc2cbq-9ltbgw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-hc2cbq in resource group rg-np-version-upgrade-hc2cbq-9ltbgw, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-hc2cbq with version 4.21.22 Unexpected error: <fmt.wrapErrors \| 0xc00178c090>: failed to create HCP cluster np-version-upgrade-cluster-hc2cbq, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-hc2cbq in resource group rg-np-version-upgrade-hc2cbq-9ltbgw, error: failed waiting for cluster="np-version-upgrade-cluster-hc2cbq" in resourcegroup="rg-np-version-upgrade-hc2cbq-9ltbgw" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-hc2cbq in resource group rg-np-version-upgrade-hc2cbq-9ltbgw, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc000a794d0>: failed to create HCP cluster np-downgrade-mtztsg, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-mtztsg in resource group rg-np-downgrade-mtztsg-7wplqk, error: failed waiting for cluster="np-downgrade-mtztsg" in resourcegroup="rg-np-downgrade-mtztsg-7wplqk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-mtztsg in resource group rg-np-downgrade-mtztsg-7wplqk, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc000a794d0>: failed to create HCP cluster np-downgrade-mtztsg, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-mtztsg in resource group rg-np-downgrade-mtztsg-7wplqk, error: failed waiting for cluster="np-downgrade-mtztsg" in resourcegroup="rg-np-downgrade-mtztsg-7wplqk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-downgrade-mtztsg in resource group rg-np-downgrade-mtztsg-7wplqk, error: context deadline exceeded ... occurred Deserialization Error: no output from command 14:15:53 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite prod/parallel Show raw failure 6cb01f1 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.gowrap1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000ecdfe0 sp=0xc000ecdfc0 pc=0x6cb0068 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000ecdfe8 sp=0xc000ecdfe0 pc=0x2f3ecc1 created by github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups in goroutine 282 /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98 goroutine 315 gp=0xc0016b9340 m=nil [select]: runtime.gopark(0xc000b05f48?, 0x2?, 0xc0?, 0x5d?, 0xc000b05ef4?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000b05d78 sp=0xc000b05d58 pc=0x2f3650e runtime.selectgo(0xc000b05f48, 0xc000b05ef0, 0xc000e26c40?, 0x0, 0x0?, 0x1) /usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000b05eb8 sp=0xc000b05d78 pc=0x2f112f7 net/http.(persistConn).writeLoop(0xc000adefc0) /usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc000b05fc8 sp=0xc000b05eb8 pc=0x32fec87 net/http.(Transport).dialConn.gowrap3() /usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc000b05fe0 sp=0xc000b05fc8 pc=0x32fb925 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b05fe8 sp=0xc000b05fe0 pc=0x2f3ecc1 created by net/http.(Transport).dialConn in goroutine 283 /usr/lib/golang/src/net/http/transport.go:1948 +0x17a5 goroutine 314 gp=0xc0016b96c0 m=nil [IO wait]: runtime.gopark(0xc0009cc3a0?, 0xc0000c3788?, 0xc5?, 0x3e?, 0xb?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0000c3768 sp=0xc0000c3748 pc=0x2f3650e runtime.netpollblock(0x2fa0ad8?, 0x2ec2066?, 0x0?) /usr/lib/golang/src/runtime/netpoll.go:575 +0xf7 fp=0xc0000c37a0 sp=0xc0000c3768 pc=0x2ef5fb7 internal/poll.runtime_pollWait(0x7f0ad6814a00, 0x72) /usr/lib/golang/src/runtime/netpoll.go:351 +0x85 fp=0xc0000c37c0 sp=0xc0000c37a0 pc=0x2f34da5 internal/poll.(pollDesc).wait(0xc001816c80?, 0xc000dec000?, 0x0) /usr/lib/golang/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0000c37e8 sp=0xc0000c37c0 pc=0x2fc3907 internal/poll.(pollDesc).waitRead(...) /usr/lib/golang/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(FD).Read(0xc001816c80, {0xc000dec000, 0x1300, 0x1300}) /usr/lib/golang/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc0000c3880 sp=0xc0000c37e8 pc=0x2fc4d39 net.(netFD).Read(0xc001816c80, {0xc000dec000?, 0xc000dec000?, 0x5?}) /usr/lib/golang/src/net/fd_posix.go:68 +0x25 fp=0xc0000c38c8 sp=0xc0000c3880 pc=0x31893c5 net.(conn).Read(0xc0000b4318, {0xc000dec000?, 0x7f0ad57c8a48?, 0x7f0b1d3fb5c0?}) /usr/lib/golang/src/net/net.go:196 +0x45 fp=0xc0000c3910 sp=0xc0000c38c8 pc=0x319b465 crypto/tls.(atLeastReader).Read(0xc0010f29d8, {0xc000dec000?, 0x120a?, 0x2ed79d6?}) /usr/lib/golang/src/crypto/tls/conn.go:819 +0x3b fp=0xc0000c3958 sp=0xc0000c3910 pc=0x3206ffb bytes.(Buffer).ReadFrom(0xc0009a82a8, {0x92dd8a0, 0xc0010f29d8}) /usr/lib/golang/src/bytes/buffer.go:217 +0x98 fp=0xc0000c39b0 sp=0xc0000c3958 pc=0x3007578 crypto/tls.(Conn).readFromUntil(0xc0009a8008, {0x92df380, 0xc0000b4318}, 0xc0000c3a18?) /usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0000c39e8 sp=0xc0000c39b0 pc=0x32071de crypto/tls.(Conn).readRecordOrCCS(0xc0009a8008, 0x0) /usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc0000c3c60 sp=0xc0000c39e8 pc=0x320425b crypto/tls.(Conn).readRecord(...) /usr/lib/golang/src/crypto/tls/conn.go:592 crypto/tls.(Conn).Read(0xc0009a8008, {0xc000b0e000, 0x1000, 0xc000a4f650?}) /usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc0000c3cc8 sp=0xc0000c3c60 pc=0x320ab65 net/http.(persistConn).Read(0xc000adefc0, {0xc000b0e000?, 0x32f4be5?, 0x92d8260?}) /usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc0000c3d28 sp=0xc0000c3cc8 pc=0x32fc4e7 bufio.(Reader).fill(0xc000c2daa0) /usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc0000c3d60 sp=0xc0000c3d28 pc=0x309ca23 bufio.(Reader).Peek(0xc000c2daa0, 0x1) /usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc0000c3d80 sp=0xc0000c3d60 pc=0x309cbb3 net/http.(persistConn).readLoop(0xc000adefc0) /usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc0000c3fc8 sp=0xc0000c3d80 pc=0x32fcff2 net/http.(Transport).dialConn.gowrap2() /usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc0000c3fe0 sp=0xc0000c3fc8 pc=0x32fb985 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0000c3fe8 sp=0xc0000c3fe0 pc=0x2f3ecc1 created by net/http.(Transport).dialConn in goroutine 283 /usr/lib/golang/src/net/http/transport.go:1947 +0x174f rax 0xca rbx 0x0 rcx 0x2f40ae3 rdx 0x0 rdi 0xc9bba10 rsi 0x80 rbp 0x7fff7dbe62d0 rsp 0x7fff7dbe6288 r8 0x0 r9 0x0 r10 0x0 r11 0x286 r12 0x0 r13 0x0 r14 0xc9b9480 r15 0x7 rip 0x2f40ae1 rflags 0x286 cs 0x33 fs 0x0 gs 0x0 Command Error: exit status 2 Deserialization Error: no output from command 6cb01f1 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.gowrap1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000ecdfe0 sp=0xc000ecdfc0 pc=0x6cb0068 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000ecdfe8 sp=0xc000ecdfe0 pc=0x2f3ecc1 created by github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups in goroutine 282 /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98 goroutine 315 gp=0xc0016b9340 m=nil [select]: runtime.gopark(0xc000b05f48?, 0x2?, 0xc0?, 0x5d?, 0xc000b05ef4?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc000b05d78 sp=0xc000b05d58 pc=0x2f3650e runtime.selectgo(0xc000b05f48, 0xc000b05ef0, 0xc000e26c40?, 0x0, 0x0?, 0x1) /usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc000b05eb8 sp=0xc000b05d78 pc=0x2f112f7 net/http.(persistConn).writeLoop(0xc000adefc0) /usr/lib/golang/src/net/http/transport.go:2600 +0xe7 fp=0xc000b05fc8 sp=0xc000b05eb8 pc=0x32fec87 net/http.(Transport).dialConn.gowrap3() /usr/lib/golang/src/net/http/transport.go:1948 +0x25 fp=0xc000b05fe0 sp=0xc000b05fc8 pc=0x32fb925 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000b05fe8 sp=0xc000b05fe0 pc=0x2f3ecc1 created by net/http.(Transport).dialConn in goroutine 283 /usr/lib/golang/src/net/http/transport.go:1948 +0x17a5 goroutine 314 gp=0xc0016b96c0 m=nil [IO wait]: runtime.gopark(0xc0009cc3a0?, 0xc0000c3788?, 0xc5?, 0x3e?, 0xb?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc0000c3768 sp=0xc0000c3748 pc=0x2f3650e runtime.netpollblock(0x2fa0ad8?, 0x2ec2066?, 0x0?) /usr/lib/golang/src/runtime/netpoll.go:575 +0xf7 fp=0xc0000c37a0 sp=0xc0000c3768 pc=0x2ef5fb7 internal/poll.runtime_pollWait(0x7f0ad6814a00, 0x72) /usr/lib/golang/src/runtime/netpoll.go:351 +0x85 fp=0xc0000c37c0 sp=0xc0000c37a0 pc=0x2f34da5 internal/poll.(pollDesc).wait(0xc001816c80?, 0xc000dec000?, 0x0) /usr/lib/golang/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0000c37e8 sp=0xc0000c37c0 pc=0x2fc3907 internal/poll.(pollDesc).waitRead(...) /usr/lib/golang/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(FD).Read(0xc001816c80, {0xc000dec000, 0x1300, 0x1300}) /usr/lib/golang/src/internal/poll/fd_unix.go:165 +0x279 fp=0xc0000c3880 sp=0xc0000c37e8 pc=0x2fc4d39 net.(netFD).Read(0xc001816c80, {0xc000dec000?, 0xc000dec000?, 0x5?}) /usr/lib/golang/src/net/fd_posix.go:68 +0x25 fp=0xc0000c38c8 sp=0xc0000c3880 pc=0x31893c5 net.(conn).Read(0xc0000b4318, {0xc000dec000?, 0x7f0ad57c8a48?, 0x7f0b1d3fb5c0?}) /usr/lib/golang/src/net/net.go:196 +0x45 fp=0xc0000c3910 sp=0xc0000c38c8 pc=0x319b465 crypto/tls.(atLeastReader).Read(0xc0010f29d8, {0xc000dec000?, 0x120a?, 0x2ed79d6?}) /usr/lib/golang/src/crypto/tls/conn.go:819 +0x3b fp=0xc0000c3958 sp=0xc0000c3910 pc=0x3206ffb bytes.(Buffer).ReadFrom(0xc0009a82a8, {0x92dd8a0, 0xc0010f29d8}) /usr/lib/golang/src/bytes/buffer.go:217 +0x98 fp=0xc0000c39b0 sp=0xc0000c3958 pc=0x3007578 crypto/tls.(Conn).readFromUntil(0xc0009a8008, {0x92df380, 0xc0000b4318}, 0xc0000c3a18?) /usr/lib/golang/src/crypto/tls/conn.go:841 +0xde fp=0xc0000c39e8 sp=0xc0000c39b0 pc=0x32071de crypto/tls.(Conn).readRecordOrCCS(0xc0009a8008, 0x0) /usr/lib/golang/src/crypto/tls/conn.go:630 +0x3db fp=0xc0000c3c60 sp=0xc0000c39e8 pc=0x320425b crypto/tls.(Conn).readRecord(...) /usr/lib/golang/src/crypto/tls/conn.go:592 crypto/tls.(Conn).Read(0xc0009a8008, {0xc000b0e000, 0x1000, 0xc000a4f650?}) /usr/lib/golang/src/crypto/tls/conn.go:1397 +0x145 fp=0xc0000c3cc8 sp=0xc0000c3c60 pc=0x320ab65 net/http.(persistConn).Read(0xc000adefc0, {0xc000b0e000?, 0x32f4be5?, 0x92d8260?}) /usr/lib/golang/src/net/http/transport.go:2125 +0x47 fp=0xc0000c3d28 sp=0xc0000c3cc8 pc=0x32fc4e7 bufio.(Reader).fill(0xc000c2daa0) /usr/lib/golang/src/bufio/bufio.go:113 +0x103 fp=0xc0000c3d60 sp=0xc0000c3d28 pc=0x309ca23 bufio.(Reader).Peek(0xc000c2daa0, 0x1) /usr/lib/golang/src/bufio/bufio.go:152 +0x53 fp=0xc0000c3d80 sp=0xc0000c3d60 pc=0x309cbb3 net/http.(persistConn).readLoop(0xc000adefc0) /usr/lib/golang/src/net/http/transport.go:2278 +0x172 fp=0xc0000c3fc8 sp=0xc0000c3d80 pc=0x32fcff2 net/http.(Transport).dialConn.gowrap2() /usr/lib/golang/src/net/http/transport.go:1947 +0x25 fp=0xc0000c3fe0 sp=0xc0000c3fc8 pc=0x32fb985 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc0000c3fe8 sp=0xc0000c3fe0 pc=0x2f3ecc1 created by net/http.(Transport).dialConn in goroutine 283 /usr/lib/golang/src/net/http/transport.go:1947 +0x174f rax 0xca rbx 0x0 rcx 0x2f40ae3 rdx 0x0 rdi 0xc9bba10 rsi 0x80 rbp 0x7fff7dbe62d0 rsp 0x7fff7dbe6288 r8 0x0 r9 0x0 r10 0x0 r11 0x286 r12 0x0 r13 0x0 r14 0xc9b9480 r15 0x7 rip 0x2f40ae1 rflags 0x286 cs 0x33 fs 0x0 gs 0x0 Command Error: exit status 2 Deserialization Error: no output from command cluster has not yet reached Succeeded state 14:15:53 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.000s. cluster should eventually succeed after role assignments are created The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with: cluster has not yet reached Succeeded state Expected <armredhatopenshifthcp.ProvisioningState>: ... to equal <armredhatopenshifthcp.ProvisioningState>: ... fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:199]: Timed out after 2520.000s. cluster should eventually succeed after role assignments are created The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:197 with: cluster has not yet reached Succeeded state Expected <armredhatopenshifthcp.ProvisioningState>: ... to equal <armredhatopenshifthcp.ProvisioningState>: ... timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:111]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapErrors \| 0xc0013d0a50>: failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7bs4rv, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-7bs4rv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7bs4rv, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:111]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapErrors \| 0xc0013d0a50>: failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7bs4rv, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-7bs4rv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7bs4rv, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc000dfd0e0>: failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-wf5j2r, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-wf5j2r" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-wf5j2r, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc000dfd0e0>: failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-wf5j2r, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-wf5j2r" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-wf5j2r, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapErrors \| 0xc001730060>: failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-fpqwh2, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-fpqwh2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-fpqwh2, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapErrors \| 0xc001730060>: failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-fpqwh2, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-fpqwh2" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-fpqwh2, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-xzshn6 with version 4.21.22 Unexpected error: <fmt.wrapErrors \| 0xc000a81f20>: failed to create HCP cluster np-version-upgrade-cluster-xzshn6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-xzshn6 in resource group rg-np-version-upgrade-xzshn6-nkwngk, error: failed waiting for cluster="np-version-upgrade-cluster-xzshn6" in resourcegroup="rg-np-version-upgrade-xzshn6-nkwngk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-xzshn6 in resource group rg-np-version-upgrade-xzshn6-nkwngk, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-xzshn6 with version 4.21.22 Unexpected error: <fmt.wrapErrors \| 0xc000a81f20>: failed to create HCP cluster np-version-upgrade-cluster-xzshn6, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-xzshn6 in resource group rg-np-version-upgrade-xzshn6-nkwngk, error: failed waiting for cluster="np-version-upgrade-cluster-xzshn6" in resourcegroup="rg-np-version-upgrade-xzshn6-nkwngk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-xzshn6 in resource group rg-np-version-upgrade-xzshn6-nkwngk, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:101]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapErrors \| 0xc0024cf320>: failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c52gps, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-c52gps" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c52gps, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:101]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapErrors \| 0xc0024cf320>: failed to create HCP cluster np-autoscale-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c52gps, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-c52gps" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-c52gps, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapErrors \| 0xc0007000f0>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-tqqwkj, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-tqqwkj" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-tqqwkj, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapErrors \| 0xc0007000f0>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-tqqwkj, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-tqqwkj" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-tqqwkj, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-22-sgttzb" with version 4.22.1 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc000a20cc0>: failed to create HCP cluster cluster-zstream-4-22-sgttzb, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-sgttzb in resource group rg-zstream-upgrade-4-22-wxptvz, error: failed waiting for cluster="cluster-zstream-4-22-sgttzb" in resourcegroup="rg-zstream-upgrade-4-22-wxptvz" to finish creating, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-sgttzb in resource group rg-zstream-upgrade-4-22-wxptvz, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-22-sgttzb" with version 4.22.1 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc000a20cc0>: failed to create HCP cluster cluster-zstream-4-22-sgttzb, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-sgttzb in resource group rg-zstream-upgrade-4-22-wxptvz, error: failed waiting for cluster="cluster-zstream-4-22-sgttzb" in resourcegroup="rg-zstream-upgrade-4-22-wxptvz" to finish creating, caused by: timeout '35.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-22-sgttzb in resource group rg-zstream-upgrade-4-22-wxptvz, error: context deadline exceeded ... occurred failed to wait for first cluster "<cluster>" to complete creation (timeout '20.000000' minutes) 14:15:53 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation (timeout '20.000000' minutes) Unexpected error: <context.deadlineExceededError>: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:131]: failed to wait for first cluster "basic-hcp-cluster" to complete creation (timeout '20.000000' minutes) Unexpected error: <context.deadlineExceededError>: context deadline exceeded ... occurred Deserialization Error: no output from command 14:15:53 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite prod/parallel Show raw failure c000ea0748) /usr/lib/golang/src/sync/waitgroup.go:206 +0x85 fp=0xc00158dac8 sp=0xc00158daa0 pc=0x2f5b405 golang.org/x/sync/errgroup.(Group).Wait(0xc000ea0740) /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc00158dae8 sp=0xc00158dac8 pc=0x4a8aabe github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7f130446f260, 0xc00157e930}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc00158dd90 sp=0xc00158dae8 pc=0x6c8efde github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).cleanupResourceGroup(0xc000e4c840, {0x7f130446f260, 0xc00157e930}, {0xc000dc6ea0, 0x22}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc00158df08 sp=0xc00158dd90 pc=0x6cb215d github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7f130446f260?, 0xc00157e930?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc00158dfc0 sp=0xc00158df08 pc=0x6cb01f1 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.gowrap1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc00158dfe0 sp=0xc00158dfc0 pc=0x6cb0068 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00158dfe8 sp=0xc00158dfe0 pc=0x2f3ecc1 created by github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups in goroutine 517 /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98 goroutine 533 gp=0xc001103340 m=nil [select]: runtime.gopark(0xc00189d768?, 0x2?, 0x0?, 0x40?, 0xc00189d75c?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00189d5e8 sp=0xc00189d5c8 pc=0x2f3650e runtime.selectgo(0xc00189d768, 0xc00189d758, 0xc000a80180?, 0x0, 0x370521c?, 0x1) /usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00189d728 sp=0xc00189d5e8 pc=0x2f112f7 github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc000033490}, 0x8779154?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00189d798 sp=0xc00189d728 pc=0x3704976 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc000033490}, 0x2f33af3) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00189da98 sp=0xc00189d798 pc=0x3e10172 github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc000033490}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00189dc20 sp=0xc00189da98 pc=0x6c8bf85 github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc000033490?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00189dcc8 sp=0xc00189dc20 pc=0x6c8b9b2 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc000033490?}, 0xc0000334a0?) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00189dd20 sp=0xc00189dcc8 pc=0x36b7f42 k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc000033490}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00189de68) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00189dd98 sp=0xc00189dd20 pc=0x36b5fee github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc000e91b80}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd}, 0x274a48a7800) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00189def0 sp=0xc00189dd98 pc=0x6c8b725 github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00189df78 sp=0xc00189def0 pc=0x6c8f61e golang.org/x/sync/errgroup.(Group).Go.func1() /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00189dfe0 sp=0xc00189df78 pc=0x4a8ac10 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00189dfe8 sp=0xc00189dfe0 pc=0x2f3ecc1 created by golang.org/x/sync/errgroup.(Group).Go in goroutine 526 /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95 rax 0xca rbx 0x0 rcx 0x2f40ae3 rdx 0x0 rdi 0xc9bba10 rsi 0x80 rbp 0x7ffc382442f0 rsp 0x7ffc382442a8 r8 0x0 r9 0x0 r10 0x0 r11 0x286 r12 0x3 r13 0x1 r14 0xc9b9480 r15 0x7 rip 0x2f40ae1 rflags 0x286 cs 0x33 fs 0x0 gs 0x0 Command Error: exit status 2 Deserialization Error: no output from command c000ea0748) /usr/lib/golang/src/sync/waitgroup.go:206 +0x85 fp=0xc00158dac8 sp=0xc00158daa0 pc=0x2f5b405 golang.org/x/sync/errgroup.(Group).Wait(0xc000ea0740) /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc00158dae8 sp=0xc00158dac8 pc=0x4a8aabe github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7f130446f260, 0xc00157e930}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc00158dd90 sp=0xc00158dae8 pc=0x6c8efde github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).cleanupResourceGroup(0xc000e4c840, {0x7f130446f260, 0xc00157e930}, {0xc000dc6ea0, 0x22}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc00158df08 sp=0xc00158dd90 pc=0x6cb215d github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7f130446f260?, 0xc00157e930?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc00158dfc0 sp=0xc00158df08 pc=0x6cb01f1 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.gowrap1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc00158dfe0 sp=0xc00158dfc0 pc=0x6cb0068 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00158dfe8 sp=0xc00158dfe0 pc=0x2f3ecc1 created by github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups in goroutine 517 /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98 goroutine 533 gp=0xc001103340 m=nil [select]: runtime.gopark(0xc00189d768?, 0x2?, 0x0?, 0x40?, 0xc00189d75c?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00189d5e8 sp=0xc00189d5c8 pc=0x2f3650e runtime.selectgo(0xc00189d768, 0xc00189d758, 0xc000a80180?, 0x0, 0x370521c?, 0x1) /usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00189d728 sp=0xc00189d5e8 pc=0x2f112f7 github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc000033490}, 0x8779154?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00189d798 sp=0xc00189d728 pc=0x3704976 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc000033490}, 0x2f33af3) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00189da98 sp=0xc00189d798 pc=0x3e10172 github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc000033490}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00189dc20 sp=0xc00189da98 pc=0x6c8bf85 github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc000033490?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00189dcc8 sp=0xc00189dc20 pc=0x6c8b9b2 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc000033490?}, 0xc0000334a0?) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00189dd20 sp=0xc00189dcc8 pc=0x36b7f42 k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc000033490}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00189de68) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00189dd98 sp=0xc00189dd20 pc=0x36b5fee github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc000e91b80}, 0xc000a2af30, {0xc000dc6ea0, 0x22}, {0xc0008e1ca0, 0xd}, 0x274a48a7800) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00189def0 sp=0xc00189dd98 pc=0x6c8b725 github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00189df78 sp=0xc00189def0 pc=0x6c8f61e golang.org/x/sync/errgroup.(Group).Go.func1() /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00189dfe0 sp=0xc00189df78 pc=0x4a8ac10 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00189dfe8 sp=0xc00189dfe0 pc=0x2f3ecc1 created by golang.org/x/sync/errgroup.(Group).Go in goroutine 526 /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95 rax 0xca rbx 0x0 rcx 0x2f40ae3 rdx 0x0 rdi 0xc9bba10 rsi 0x80 rbp 0x7ffc382442f0 rsp 0x7ffc382442a8 r8 0x0 r9 0x0 r10 0x0 r11 0x286 r12 0x3 r13 0x1 r14 0xc9b9480 r15 0x7 rip 0x2f40ae1 rflags 0x286 cs 0x33 fs 0x0 gs 0x0 Command Error: exit status 2 Deserialization Error: no output from command timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapErrors \| 0xc0016868d0>: failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-66x82b, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-66x82b" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-66x82b, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapErrors \| 0xc0016868d0>: failed to create HCP cluster ea-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-66x82b, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-66x82b" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-66x82b, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:289]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapErrors \| 0xc000a6a390>: failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-gmp2c9, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-gmp2c9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-gmp2c9, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:289]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapErrors \| 0xc000a6a390>: failed to create HCP cluster node-limit-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-gmp2c9, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-gmp2c9" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-gmp2c9, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapErrors \| 0xc00128a780>: failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-2gfj2m, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-2gfj2m" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-2gfj2m, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:83]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapErrors \| 0xc00128a780>: failed to create HCP cluster cilium-cl, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-2gfj2m, error: failed waiting for cluster="cilium-cl" in resourcegroup="cni-cilium-2gfj2m" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cilium-cl in resource group cni-cilium-2gfj2m, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should create an HCP cluster with FIPS mode enabled via experimental tag · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapErrors \| 0xc0008763c0>: failed waiting for cluster="fips-enabled-cluster" in resourcegroup="fips-enabled-9pggn8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster fips-enabled-cluster in resource group fips-enabled-9pggn8, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapErrors \| 0xc0008763c0>: failed waiting for cluster="fips-enabled-cluster" in resourcegroup="fips-enabled-9pggn8" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster fips-enabled-cluster in resource group fips-enabled-9pggn8, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-20-gb7zft" with version 4.20.26 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc001368ae0>: failed to create HCP cluster cluster-zstream-4-20-gb7zft, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gb7zft in resource group rg-zstream-upgrade-4-20-ld7ldx, error: failed waiting for cluster="cluster-zstream-4-20-gb7zft" in resourcegroup="rg-zstream-upgrade-4-20-ld7ldx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gb7zft in resource group rg-zstream-upgrade-4-20-ld7ldx, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-20-gb7zft" with version 4.20.26 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc001368ae0>: failed to create HCP cluster cluster-zstream-4-20-gb7zft, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gb7zft in resource group rg-zstream-upgrade-4-20-ld7ldx, error: failed waiting for cluster="cluster-zstream-4-20-gb7zft" in resourcegroup="rg-zstream-upgrade-4-20-ld7ldx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-20-gb7zft in resource group rg-zstream-upgrade-4-20-ld7ldx, error: context deadline exceeded ... occurred Deserialization Error: no output from command 14:15:53 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite prod/parallel Show raw failure ync/waitgroup.go:206 +0x85 fp=0xc000e5fac8 sp=0xc000e5faa0 pc=0x2f5b405 golang.org/x/sync/errgroup.(Group).Wait(0xc000e97840) /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc000e5fae8 sp=0xc000e5fac8 pc=0x4a8aabe github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7fc97c1bf660, 0xc000b97f50}, 0xc001082750, {0xc0009bb5c0, 0x11}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc000e5fd90 sp=0xc000e5fae8 pc=0x6c8efde github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).cleanupResourceGroup(0xc000c154a0, {0x7fc97c1bf660, 0xc000b97f50}, {0xc0009bb5c0, 0x11}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc000e5ff08 sp=0xc000e5fd90 pc=0x6cb215d github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7fc97c1bf660?, 0xc000b97f50?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc000e5ffc0 sp=0xc000e5ff08 pc=0x6cb01f1 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.gowrap1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000e5ffe0 sp=0xc000e5ffc0 pc=0x6cb0068 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e5ffe8 sp=0xc000e5ffe0 pc=0x2f3ecc1 created by github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups in goroutine 470 /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98 goroutine 491 gp=0xc0011ae380 m=nil [select]: runtime.gopark(0xc00165b768?, 0x2?, 0x0?, 0x5a?, 0xc00165b75c?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00165b5e8 sp=0xc00165b5c8 pc=0x2f3650e runtime.selectgo(0xc00165b768, 0xc00165b758, 0xc0006feca0?, 0x0, 0x370521c?, 0x1) /usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00165b728 sp=0xc00165b5e8 pc=0x2f112f7 github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc001566070}, 0x8779154?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00165b798 sp=0xc00165b728 pc=0x3704976 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc001566070}, 0x2f33af3) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00165ba98 sp=0xc00165b798 pc=0x3e10172 github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc001566070}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00165bc20 sp=0xc00165ba98 pc=0x6c8bf85 github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc001566070?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00165bcc8 sp=0xc00165bc20 pc=0x6c8b9b2 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc001566070?}, 0xc001566080?) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00165bd20 sp=0xc00165bcc8 pc=0x36b7f42 k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc001566070}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00165be68) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00165bd98 sp=0xc00165bd20 pc=0x36b5fee github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc0007baff0}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12}, 0x274a48a7800) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00165bef0 sp=0xc00165bd98 pc=0x6c8b725 github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00165bf78 sp=0xc00165bef0 pc=0x6c8f61e golang.org/x/sync/errgroup.(Group).Go.func1() /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00165bfe0 sp=0xc00165bf78 pc=0x4a8ac10 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00165bfe8 sp=0xc00165bfe0 pc=0x2f3ecc1 created by golang.org/x/sync/errgroup.(Group).Go in goroutine 502 /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95 rax 0xfffffffffffffffc rbx 0x5 rcx 0x2eb5e2e rdx 0x80 rdi 0x5 rsi 0x7ffcb9d27d24 rbp 0x7ffcb9d27cd8 rsp 0x7ffcb9d27c90 r8 0x0 r9 0x0 r10 0x393 r11 0x246 r12 0x7ffcb9d27d68 r13 0x1 r14 0xc9b9480 r15 0x3 rip 0x2eb5e2e rflags 0x246 cs 0x33 fs 0x0 gs 0x0 Command Error: exit status 2 Deserialization Error: no output from command ync/waitgroup.go:206 +0x85 fp=0xc000e5fac8 sp=0xc000e5faa0 pc=0x2f5b405 golang.org/x/sync/errgroup.(Group).Wait(0xc000e97840) /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:56 +0x1e fp=0xc000e5fae8 sp=0xc000e5fac8 pc=0x4a8aabe github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610({0x7fc97c1bf660, 0xc000b97f50}, 0xc001082750, {0xc0009bb5c0, 0x11}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:525 +0x8de fp=0xc000e5fd90 sp=0xc000e5fae8 pc=0x6c8efde github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).cleanupResourceGroup(0xc000c154a0, {0x7fc97c1bf660, 0xc000b97f50}, {0xc0009bb5c0, 0x11}, 0x34630b8a000) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:537 +0x29d fp=0xc000e5ff08 sp=0xc000e5fd90 pc=0x6cb215d github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.func1({0x7fc97c1bf660?, 0xc000b97f50?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:360 +0x151 fp=0xc000e5ffc0 sp=0xc000e5ff08 pc=0x6cb01f1 github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups.gowrap1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:369 +0x28 fp=0xc000e5ffe0 sp=0xc000e5ffc0 pc=0x6cb0068 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc000e5ffe8 sp=0xc000e5ffe0 pc=0x2f3ecc1 created by github.com/Azure/ARO-HCP/test/util/framework.(perItOrDescribeTestContext).CleanupResourceGroups in goroutine 470 /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:353 +0x98 goroutine 491 gp=0xc0011ae380 m=nil [select]: runtime.gopark(0xc00165b768?, 0x2?, 0x0?, 0x5a?, 0xc00165b75c?) /usr/lib/golang/src/runtime/proc.go:460 +0xce fp=0xc00165b5e8 sp=0xc00165b5c8 pc=0x2f3650e runtime.selectgo(0xc00165b768, 0xc00165b758, 0xc0006feca0?, 0x0, 0x370521c?, 0x1) /usr/lib/golang/src/runtime/select.go:351 +0x8b7 fp=0xc00165b728 sp=0xc00165b5e8 pc=0x2f112f7 github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/shared.Delay({0x9376198, 0xc001566070}, 0x8779154?) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/internal/shared/shared.go:36 +0x76 fp=0xc00165b798 sp=0xc00165b728 pc=0x3704976 github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(Poller[...]).PollUntilDone(0x93c8b00, {0x9376198, 0xc001566070}, 0x2f33af3) /go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.21.1/runtime/poller.go:284 +0x732 fp=0xc00165ba98 sp=0xc00165b798 pc=0x3e10172 github.com/Azure/ARO-HCP/test/util/framework.deleteHCPClusterAttempt({0x9376198, 0xc001566070}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:240 +0x365 fp=0xc00165bc20 sp=0xc00165ba98 pc=0x6c8bf85 github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610.func1({0x9376198?, 0xc001566070?}) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:198 +0x72 fp=0xc00165bcc8 sp=0xc00165bc20 pc=0x6c8b9b2 k8s.io/apimachinery/pkg/util/wait.runConditionWithCrashProtectionWithContext({0x9376198?, 0xc001566070?}, 0xc001566080?) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/wait.go:159 +0x62 fp=0xc00165bd20 sp=0xc00165bcc8 pc=0x36b7f42 k8s.io/apimachinery/pkg/util/wait.ExponentialBackoffWithContext({0x9376198, 0xc001566070}, {0xdf8475800, 0x4000000000000000, 0x3fb999999999999a, 0x5, 0x0}, 0xc00165be68) /go/pkg/mod/k8s.io/apimachinery@v0.35.3/pkg/util/wait/backoff.go:501 +0xae fp=0xc00165bd98 sp=0xc00165bd20 pc=0x36b5fee github.com/Azure/ARO-HCP/test/util/framework.DeleteHCPCluster20240610({0x9376128, 0xc0007baff0}, 0xc001082750, {0xc0009bb5c0, 0x11}, {0xc00154a300, 0x12}, 0x274a48a7800) /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:196 +0x285 fp=0xc00165bef0 sp=0xc00165bd98 pc=0x6c8b725 github.com/Azure/ARO-HCP/test/util/framework.DeleteAllHCPClusters20240610.func1() /opt/app-root/src/github.com/Azure/ARO-HCP/test/util/framework/hcp_helper.go:522 +0x7e fp=0xc00165bf78 sp=0xc00165bef0 pc=0x6c8f61e golang.org/x/sync/errgroup.(Group).Go.func1() /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:93 +0x50 fp=0xc00165bfe0 sp=0xc00165bf78 pc=0x4a8ac10 runtime.goexit({}) /usr/lib/golang/src/runtime/asm_amd64.s:1693 +0x1 fp=0xc00165bfe8 sp=0xc00165bfe0 pc=0x2f3ecc1 created by golang.org/x/sync/errgroup.(Group).Go in goroutine 502 /go/pkg/mod/golang.org/x/sync@v0.20.0/errgroup/errgroup.go:78 +0x95 rax 0xfffffffffffffffc rbx 0x5 rcx 0x2eb5e2e rdx 0x80 rdi 0x5 rsi 0x7ffcb9d27d24 rbp 0x7ffcb9d27cd8 rsp 0x7ffcb9d27c90 r8 0x0 r9 0x0 r10 0x393 r11 0x246 r12 0x7ffcb9d27d68 r13 0x1 r14 0xc9b9480 r15 0x3 rip 0x2eb5e2e rflags 0x246 cs 0x33 fs 0x0 gs 0x0 Command Error: exit status 2 Deserialization Error: no output from command timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapErrors \| 0xc000bf5a40>: failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-4n5wv7, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-4n5wv7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-4n5wv7, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:91]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapErrors \| 0xc000bf5a40>: failed to create HCP cluster cluster-np-labels-taints, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-4n5wv7, error: failed waiting for cluster="cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-4n5wv7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-np-labels-taints in resource group rg-np-labels-taints-4n5wv7, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapErrors \| 0xc0011a26c0>: failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-z9kl8k, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-z9kl8k" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-z9kl8k, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:88]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapErrors \| 0xc0011a26c0>: failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-z9kl8k, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-z9kl8k" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-z9kl8k, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapErrors \| 0xc0009e00c0>: failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-qx9jfx, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-qx9jfx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-qx9jfx, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapErrors \| 0xc0009e00c0>: failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-qx9jfx, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-qx9jfx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-qx9jfx, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-sh5qkl/cluster-candidate-5-0-4glj7t should provision Unexpected error: <fmt.wrapErrors \| 0xc0012f0090>: failed to create HCP cluster cluster-candidate-5-0-4glj7t, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-4glj7t in resource group rg-candidate-5-0-sh5qkl, error: failed waiting for cluster="cluster-candidate-5-0-4glj7t" in resourcegroup="rg-candidate-5-0-sh5qkl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-4glj7t in resource group rg-candidate-5-0-sh5qkl, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-5-0-sh5qkl/cluster-candidate-5-0-4glj7t should provision Unexpected error: <fmt.wrapErrors \| 0xc0012f0090>: failed to create HCP cluster cluster-candidate-5-0-4glj7t, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-4glj7t in resource group rg-candidate-5-0-sh5qkl, error: failed waiting for cluster="cluster-candidate-5-0-4glj7t" in resourcegroup="rg-candidate-5-0-sh5qkl" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-5-0-4glj7t in resource group rg-candidate-5-0-sh5qkl, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc001012d20>: failed to create HCP cluster np-dg-minor-hzlq6d, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-hzlq6d in resource group rg-np-dg-minor-hzlq6d-cq92gl, error: failed waiting for cluster="np-dg-minor-hzlq6d" in resourcegroup="rg-np-dg-minor-hzlq6d-cq92gl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-hzlq6d in resource group rg-np-dg-minor-hzlq6d-cq92gl, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster Unexpected error: <fmt.wrapErrors \| 0xc001012d20>: failed to create HCP cluster np-dg-minor-hzlq6d, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-hzlq6d in resource group rg-np-dg-minor-hzlq6d-cq92gl, error: failed waiting for cluster="np-dg-minor-hzlq6d" in resourcegroup="rg-np-dg-minor-hzlq6d-cq92gl" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-dg-minor-hzlq6d in resource group rg-np-dg-minor-hzlq6d-cq92gl, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapErrors \| 0xc001284060>: failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-xj2l8r" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-xj2l8r, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:104]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapErrors \| 0xc001284060>: failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-xj2l8r" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group complex-cilium-kv-xj2l8r, error: context deadline exceeded ... occurred Cluster should become ready within '20.000000' minutes 14:15:53 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s. Cluster should become ready within '20.000000' minutes Expected <bool>: ... to be true fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:162]: Timed out after 1200.004s. Cluster should become ready within '20.000000' minutes Expected <bool>: ... to be true timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-21-746ctc" with version 4.21.0-rc.0 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc00099f380>: failed to create HCP cluster cluster-zstream-4-21-746ctc, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-746ctc in resource group rg-zstream-upgrade-4-21-lrhcfn, error: failed waiting for cluster="cluster-zstream-4-21-746ctc" in resourcegroup="rg-zstream-upgrade-4-21-lrhcfn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-746ctc in resource group rg-zstream-upgrade-4-21-lrhcfn, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-21-746ctc" with version 4.21.0-rc.0 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc00099f380>: failed to create HCP cluster cluster-zstream-4-21-746ctc, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-746ctc in resource group rg-zstream-upgrade-4-21-lrhcfn, error: failed waiting for cluster="cluster-zstream-4-21-746ctc" in resourcegroup="rg-zstream-upgrade-4-21-lrhcfn" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-21-746ctc in resource group rg-zstream-upgrade-4-21-lrhcfn, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-20-nzrzjc/cluster-candidate-4-20-m67tzn should provision Unexpected error: <fmt.wrapErrors \| 0xc0009af3b0>: failed to create HCP cluster cluster-candidate-4-20-m67tzn, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-20-m67tzn in resource group rg-candidate-4-20-nzrzjc, error: failed waiting for cluster="cluster-candidate-4-20-m67tzn" in resourcegroup="rg-candidate-4-20-nzrzjc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-20-m67tzn in resource group rg-candidate-4-20-nzrzjc, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-20-nzrzjc/cluster-candidate-4-20-m67tzn should provision Unexpected error: <fmt.wrapErrors \| 0xc0009af3b0>: failed to create HCP cluster cluster-candidate-4-20-m67tzn, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-20-m67tzn in resource group rg-candidate-4-20-nzrzjc, error: failed waiting for cluster="cluster-candidate-4-20-m67tzn" in resourcegroup="rg-candidate-4-20-nzrzjc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-20-m67tzn in resource group rg-candidate-4-20-nzrzjc, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:150]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapErrors \| 0xc001c2d2c0>: failed to create HCP cluster cidr-connectivity-test, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-n6wr5x, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-n6wr5x" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-n6wr5x, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:150]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapErrors \| 0xc001c2d2c0>: failed to create HCP cluster cidr-connectivity-test, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-n6wr5x, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-n6wr5x" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-n6wr5x, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapErrors \| 0xc0010108a0>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-l45rx5, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-l45rx5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-l45rx5, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:94]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapErrors \| 0xc0010108a0>: failed to create HCP cluster tls-endpoint-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-l45rx5, error: failed waiting for cluster="tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-l45rx5" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster tls-endpoint-hcp-cluster in resource group tls-endpoint-cluster-l45rx5, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapErrors \| 0xc000c105a0>: failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-hrn49q, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-hrn49q" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-hrn49q, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:79]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapErrors \| 0xc000c105a0>: failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-hrn49q, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-hrn49q" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-hrn49q, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-zlg882/cluster-candidate-4-22-grxs7p should provision Unexpected error: <fmt.wrapErrors \| 0xc000a39a40>: failed to create HCP cluster cluster-candidate-4-22-grxs7p, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-grxs7p in resource group rg-candidate-4-22-zlg882, error: failed waiting for cluster="cluster-candidate-4-22-grxs7p" in resourcegroup="rg-candidate-4-22-zlg882" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-grxs7p in resource group rg-candidate-4-22-zlg882, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:106]: HCP cluster rg-candidate-4-22-zlg882/cluster-candidate-4-22-grxs7p should provision Unexpected error: <fmt.wrapErrors \| 0xc000a39a40>: failed to create HCP cluster cluster-candidate-4-22-grxs7p, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-grxs7p in resource group rg-candidate-4-22-zlg882, error: failed waiting for cluster="cluster-candidate-4-22-grxs7p" in resourcegroup="rg-candidate-4-22-zlg882" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-candidate-4-22-grxs7p in resource group rg-candidate-4-22-zlg882, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-9tgpd2 with version 4.20.28 Unexpected error: <fmt.wrapErrors \| 0xc000d14bd0>: failed to create HCP cluster np-version-upgrade-cluster-9tgpd2, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-9tgpd2 in resource group rg-np-version-upgrade-9tgpd2-dk4zzz, error: failed waiting for cluster="np-version-upgrade-cluster-9tgpd2" in resourcegroup="rg-np-version-upgrade-9tgpd2-dk4zzz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-9tgpd2 in resource group rg-np-version-upgrade-9tgpd2-dk4zzz, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-9tgpd2 with version 4.20.28 Unexpected error: <fmt.wrapErrors \| 0xc000d14bd0>: failed to create HCP cluster np-version-upgrade-cluster-9tgpd2, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-9tgpd2 in resource group rg-np-version-upgrade-9tgpd2-dk4zzz, error: failed waiting for cluster="np-version-upgrade-cluster-9tgpd2" in resourcegroup="rg-np-version-upgrade-9tgpd2-dk4zzz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-9tgpd2 in resource group rg-np-version-upgrade-9tgpd2-dk4zzz, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapErrors \| 0xc0017815f0>: failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-h4fr85, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-h4fr85" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-h4fr85, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:83]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapErrors \| 0xc0017815f0>: failed to create HCP cluster patch-name-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-h4fr85, error: failed waiting for cluster="patch-name-cluster" in resourcegroup="patch-name-h4fr85" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-name-cluster in resource group patch-name-h4fr85, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapErrors \| 0xc0009a5b60>: failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-5q8rr7, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-5q8rr7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-5q8rr7, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapErrors \| 0xc0009a5b60>: failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-5q8rr7, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-5q8rr7" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-5q8rr7, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 14:15:53 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.19 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-19-6ggdq8" with version 4.19.35 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc00152a840>: failed to create HCP cluster cluster-zstream-4-19-6ggdq8, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6ggdq8 in resource group rg-zstream-upgrade-4-19-hp6xzz, error: failed waiting for cluster="cluster-zstream-4-19-6ggdq8" in resourcegroup="rg-zstream-upgrade-4-19-hp6xzz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6ggdq8 in resource group rg-zstream-upgrade-4-19-hp6xzz, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:109]: failed to create HCP cluster "cluster-zstream-4-19-6ggdq8" with version 4.19.35 on candidate channel Unexpected error: <fmt.wrapErrors \| 0xc00152a840>: failed to create HCP cluster cluster-zstream-4-19-6ggdq8, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6ggdq8 in resource group rg-zstream-upgrade-4-19-hp6xzz, error: failed waiting for cluster="cluster-zstream-4-19-6ggdq8" in resourcegroup="rg-zstream-upgrade-4-19-hp6xzz" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cluster-zstream-4-19-6ggdq8 in resource group rg-zstream-upgrade-4-19-hp6xzz, error: context deadline exceeded ... occurred
09:41:32	branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	18	e2e (18) timeout during CreateHCPClusterAndWait; context deadline exceeded 09:41:32 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapErrors \| 0xc000ce2540>: failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-nlbvcv, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-nlbvcv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-nlbvcv, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:111]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapErrors \| 0xc000ce2540>: failed to create HCP cluster ephemeral-disk, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-nlbvcv, error: failed waiting for cluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-nlbvcv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ephemeral-disk in resource group ephemeral-osdisk-nlbvcv, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc001292d50>: failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-g9rbzv, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-g9rbzv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-g9rbzv, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:89]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapErrors \| 0xc001292d50>: failed to create HCP cluster cx-rg-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-g9rbzv, error: failed waiting for cluster="cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-g9rbzv" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cx-rg-hcp-cluster in resource group cx-rg-cluster-g9rbzv, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapErrors \| 0xc0013bb500>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-9l5sfk, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-9l5sfk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-9l5sfk, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapErrors \| 0xc0013bb500>: failed to create HCP cluster negative-tests-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-9l5sfk, error: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-9l5sfk" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster negative-tests-cluster in resource group rg-negative-tests-9l5sfk, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapErrors \| 0xc001334510>: failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-bdxbbx, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-bdxbbx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-bdxbbx, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapErrors \| 0xc001334510>: failed to create HCP cluster shoebox-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-bdxbbx, error: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-bdxbbx" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster shoebox-hcp-cluster in resource group shoebox-cluster-bdxbbx, error: context deadline exceeded ... occurred UpdateNodePoolAndWait timed out after <minutes> minutes; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up Unexpected error: <fmt.wrapErrors \| 0xc0025850e0>: failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-cqzk85" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-cqzk85, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up Unexpected error: <fmt.wrapErrors \| 0xc0025850e0>: failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-cqzk85" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-cqzk85, error: context deadline exceeded ... occurred CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:607]: failed to create nodepool npdg-4-21 Unexpected error: <fmt.wrapErrors \| 0xc00239f020>: failed to create NodePool npdg-4-21, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npdg-4-21 in resource group rg-np-downgrade-845955-mgp9lz, error: failed waiting for nodepool="npdg-4-21" for cluster "np-downgrade-845955" in resourcegroup="rg-np-downgrade-845955-mgp9lz" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:607]: failed to create nodepool npdg-4-21 Unexpected error: <fmt.wrapErrors \| 0xc00239f020>: failed to create NodePool npdg-4-21, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npdg-4-21 in resource group rg-np-downgrade-845955-mgp9lz, error: failed waiting for nodepool="npdg-4-21" for cluster "np-downgrade-845955" in resourcegroup="rg-np-downgrade-845955-mgp9lz" to finish creating: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapErrors \| 0xc000c6f560>: failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-xqz7hq, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-xqz7hq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-xqz7hq, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapErrors \| 0xc000c6f560>: failed to create HCP cluster oidc-wi-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-xqz7hq, error: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-xqz7hq" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster oidc-wi-cluster in resource group oidc-wi-xqz7hq, error: context deadline exceeded ... occurred VerifyFIPSEnabled failed: failed to check FIPS mode on node <node>: failed to create FIPS check pod: pod "<pod>" is forbidden: error looking up service account <namespace>/default: serviceaccount "default" not found 09:41:32 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should create an HCP cluster with FIPS mode enabled via experimental tag · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:123]: failed to verify FIPS is enabled on cluster fips-enabled-cluster Unexpected error: <errors.joinError \| 0xc000b267e0>: VerifyFIPSEnabled failed: failed to check FIPS mode on node e9n0y8t3z6s7y7t-np-1-6l2x9-pkqwh: failed to create FIPS check pod: pods "fips-check-" is forbidden: error looking up service account e2e-fips-test-h4zck/default: serviceaccount "default" not found ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:123]: failed to verify FIPS is enabled on cluster fips-enabled-cluster Unexpected error: <errors.joinError \| 0xc000b267e0>: VerifyFIPSEnabled failed: failed to check FIPS mode on node e9n0y8t3z6s7y7t-np-1-6l2x9-pkqwh: failed to create FIPS check pod: pods "fips-check-" is forbidden: error looking up service account e2e-fips-test-h4zck/default: serviceaccount "default" not found ... occurred CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:153]: failed to create AZ nodepool autoscale-az with autoscaling Unexpected error: <fmt.wrapErrors \| 0xc00244fe30>: failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-p92jfl, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-p92jfl" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:153]: failed to create AZ nodepool autoscale-az with autoscaling Unexpected error: <fmt.wrapErrors \| 0xc00244fe30>: failed to create NodePool autoscale-az, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool autoscale-az in resource group np-autoscaling-p92jfl, error: failed waiting for nodepool="autoscale-az" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-p92jfl" to finish creating: context deadline exceeded ... occurred failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled 09:41:32 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc0016da1f8>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-21-cfqmg9" in resourcegroup="rg-candidate-4-21-5l8mwr" to finish deleting: context canceled ... occurred fail [:0]: A node timeout occurred fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:283] A node timeout occurred and then the following failure was recorded in the timedout node before it exited: Unexpected error: <errors.joinError \| 0xc0016da1f8>: failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="cluster-candidate-4-21-cfqmg9" in resourcegroup="rg-candidate-4-21-5l8mwr" to finish deleting: context canceled ... occurred fail [:0]: A node timeout occurred failed waiting for nodepool="<nodepool>" for cluster "<cluster>" in resourcegroup="<resource-group>" to finish creating: context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to create node pool version 4.19.7 for back-level cluster Unexpected error: <fmt.wrapError \| 0xc000f19d40>: failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-jbrspk" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:194]: failed to create node pool version 4.19.7 for back-level cluster Unexpected error: <fmt.wrapError \| 0xc000f19d40>: failed waiting for nodepool="np-ver-4-19-7" for cluster "cluster-ver-4-19" in resourcegroup="rg-cluster-back-version-jbrspk" to finish creating: context deadline exceeded ... occurred CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.21.zLatest to 4.19.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:754]: failed to create nodepool npdg-421-419 Unexpected error: <fmt.wrapErrors \| 0xc0015aacf0>: failed to create NodePool npdg-421-419, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npdg-421-419 in resource group rg-np-dg-minor-2k4w8q-d2pcfx, error: failed waiting for nodepool="npdg-421-419" for cluster "np-dg-minor-2k4w8q" in resourcegroup="rg-np-dg-minor-2k4w8q-d2pcfx" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:754]: failed to create nodepool npdg-421-419 Unexpected error: <fmt.wrapErrors \| 0xc0015aacf0>: failed to create NodePool npdg-421-419, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool npdg-421-419 in resource group rg-np-dg-minor-2k4w8q-d2pcfx, error: failed waiting for nodepool="npdg-421-419" for cluster "np-dg-minor-2k4w8q" in resourcegroup="rg-np-dg-minor-2k4w8q-d2pcfx" to finish creating: context deadline exceeded ... occurred timeout during GetAdminRESTConfigForHCPCluster while waiting for hcpcluster creds 09:41:32 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:161]: failed to get admin REST config for cluster np-version-upgrade-cluster-gv255d Unexpected error: <fmt.wrapErrors \| 0xc002418720>: failed waiting for hcpCluster="np-version-upgrade-cluster-gv255d" in resourcegroup="rg-np-version-upgrade-gv255d-bzslj8" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster np-version-upgrade-cluster-gv255d in resource group rg-np-version-upgrade-gv255d-bzslj8, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:161]: failed to get admin REST config for cluster np-version-upgrade-cluster-gv255d Unexpected error: <fmt.wrapErrors \| 0xc002418720>: failed waiting for hcpCluster="np-version-upgrade-cluster-gv255d" in resourcegroup="rg-np-version-upgrade-gv255d-bzslj8" to finish getting creds, caused by: timeout '10.000000' minutes exceeded during GetAdminRESTConfigForHCPCluster for cluster np-version-upgrade-cluster-gv255d in resource group rg-np-version-upgrade-gv255d-bzslj8, error: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-qxgd9w with version 4.20.28 Unexpected error: <fmt.wrapErrors \| 0xc0012a89c0>: failed to create HCP cluster np-version-upgrade-cluster-qxgd9w, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-qxgd9w in resource group rg-np-version-upgrade-qxgd9w-lqr7rr, error: failed waiting for cluster="np-version-upgrade-cluster-qxgd9w" in resourcegroup="rg-np-version-upgrade-qxgd9w-lqr7rr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-qxgd9w in resource group rg-np-version-upgrade-qxgd9w-lqr7rr, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:132]: failed to create HCP cluster np-version-upgrade-cluster-qxgd9w with version 4.20.28 Unexpected error: <fmt.wrapErrors \| 0xc0012a89c0>: failed to create HCP cluster np-version-upgrade-cluster-qxgd9w, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-qxgd9w in resource group rg-np-version-upgrade-qxgd9w-lqr7rr, error: failed waiting for cluster="np-version-upgrade-cluster-qxgd9w" in resourcegroup="rg-np-version-upgrade-qxgd9w-lqr7rr" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-version-upgrade-cluster-qxgd9w in resource group rg-np-version-upgrade-qxgd9w-lqr7rr, error: context deadline exceeded ... occurred CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:477]: failed to create nodepool nps-420-422 at version 4.20.28 Unexpected error: <fmt.wrapErrors \| 0xc0024b1110>: failed to create NodePool nps-420-422, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nps-420-422 in resource group rg-np-skip-minor-lfkkhh-5f9msh, error: failed waiting for nodepool="nps-420-422" for cluster "np-skip-minor-lfkkhh" in resourcegroup="rg-np-skip-minor-lfkkhh-5f9msh" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:477]: failed to create nodepool nps-420-422 at version 4.20.28 Unexpected error: <fmt.wrapErrors \| 0xc0024b1110>: failed to create NodePool nps-420-422, caused by: timeout '45.000000' minutes exceeded during CreateNodePoolFromParam for node pool nps-420-422 in resource group rg-np-skip-minor-lfkkhh-5f9msh, error: failed waiting for nodepool="nps-420-422" for cluster "np-skip-minor-lfkkhh" in resourcegroup="rg-np-skip-minor-lfkkhh-5f9msh" to finish creating: context deadline exceeded ... occurred timeout during CreateHCPClusterAndWait; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapErrors \| 0xc000e73890>: failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-7hwljb, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-7hwljb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-7hwljb, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:112]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapErrors \| 0xc000e73890>: failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-7hwljb, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-7hwljb" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-7hwljb, error: context deadline exceeded ... occurred CreateNodePoolFromParam timed out after <minutes> minutes; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:330]: failed to create nodepool npnoedge-4-20 at version 4.20.0 Unexpected error: <fmt.wrapErrors \| 0xc0014079e0>: failed to create NodePool npnoedge-4-20, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool npnoedge-4-20 in resource group rg-np-noedge-j7lh88-lbpxgn, error: failed waiting for nodepool="npnoedge-4-20" for cluster "np-noedge-j7lh88" in resourcegroup="rg-np-noedge-j7lh88-lbpxgn" to finish creating: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:330]: failed to create nodepool npnoedge-4-20 at version 4.20.0 Unexpected error: <fmt.wrapErrors \| 0xc0014079e0>: failed to create NodePool npnoedge-4-20, caused by: timeout '20.000000' minutes exceeded during CreateNodePoolFromParam for node pool npnoedge-4-20 in resource group rg-np-noedge-j7lh88-lbpxgn, error: failed waiting for nodepool="npnoedge-4-20" for cluster "np-noedge-j7lh88" in resourcegroup="rg-np-noedge-j7lh88-lbpxgn" to finish creating: context deadline exceeded ... occurred UpdateNodePoolAndWait timed out after <minutes> minutes; context deadline exceeded 09:41:32 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.21.22 Unexpected error: <fmt.wrapErrors \| 0xc000890ea0>: failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-fr5x47" resourcegroup="rg-np-version-upgrade-fr5x47-tjnxv8" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-fr5x47 in resource group rg-np-version-upgrade-fr5x47-tjnxv8, error: context deadline exceeded ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.21.22 Unexpected error: <fmt.wrapErrors \| 0xc000890ea0>: failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-fr5x47" resourcegroup="rg-np-version-upgrade-fr5x47-tjnxv8" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-fr5x47 in resource group rg-np-version-upgrade-fr5x47-tjnxv8, error: context deadline exceeded ... occurred
02:00:22	periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel post-goodmerged PR No additional run metadata captured	e2e	failed	n/a	2	e2e (2) ERROR CODE: InvalidRequestContent; detail message Invalid value: "aro-hcp.experimental.cluster.fips-enabled": unrecognized experimental tag; provider Microsoft.RedHatOpenShift 02:00:22 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should create an HCP cluster with FIPS mode enabled via experimental tag · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapError \| 0xc0008eab80>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-c67zkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-c67zkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag", "target": "tags[aro-hcp.experimental.cluster.fips-enabled]" } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:84]: failed to create HCP cluster "fips-enabled-cluster" with FIPS enabled Unexpected error: <fmt.wrapError \| 0xc0008eab80>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-c67zkg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-c67zkg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 400: 400 Bad Request ERROR CODE: InvalidRequestContent -------------------------------------------------------------------------------- { "error": { "code": "InvalidRequestContent", "message": "Invalid value: \"aro-hcp.experimental.cluster.fips-enabled\": unrecognized experimental tag", "target": "tags[aro-hcp.experimental.cluster.fips-enabled]" } } -------------------------------------------------------------------------------- ... occurred error should indicate FIPS value must be true or false 02:00:22 UTC · failed at e2e · test FIPS Mode Support with ExperimentalReleaseFeatures AFEC registered should reject an HCP cluster creation with invalid FIPS tag value · suite prod/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false Expected <string>: ... to contain substring <string>: ... fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:203]: error should indicate FIPS value must be true or false Expected <string>: ... to contain substring <string>: ...