CIHealth
<
Single Day: Feb 26▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: DEV

Time (UTC)RuntimeJobRegionFailed atResultPRFailed testsDetails
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head bfb8e96 · merge ac3354a
 n/a provision failed ⚠#4234 (merged) 1
provision (1)
failed to run ARM step: failed to transform Bicep to ARM: failed to preprocess file: failed to preprocess content dev-infrastructure/configurations/svc-cluster.tmpl.bicepparam: failed to execute template: template: file:171:40: executing "file" at
23:24:42 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.Service.Infra/service/cluster · suite step graph
Show raw failure
time=2026-02-27T00:08:10.494Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=cluster description="Step cluster\n  Kind: ARM\n  Template: templates/svc-cluster.bicep\n  Parameters: configurations/svc-cluster.tmpl.bicepparam"
time=2026-02-27T00:08:10.836Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=cluster err="failed to run ARM step: failed to transform Bicep to ARM: failed to preprocess file: failed to preprocess content dev-infrastructure/configurations/svc-cluster.tmpl.bicepparam: failed to execute template: template: file:171:40: executing \"file\" at <.kusto.auditLogsEventHub.name>: map has no entry for key \"auditLogsEventHub\""
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
batch
head 551e259 · merge 551e259
 n/a provision failed ★#4212 (merged) 1
provision (1)
Internal error occurred: failed calling webhook "validation.istio.io": failed to call webhook: Post "<url>": proxy error from localhost:9443 while dialing <ip>:<port>, code 500: 500 Internal Server Error
23:04:13 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.SessionGate/service/deploy · suite step graph
Show raw failure
time=2026-02-26T23:55:55.110Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy description="Step deploy\n Kind: Helm\n"
time=2026-02-26T23:55:55.616Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy values="map[affinity:map[] auth:map[audience:6dae42f8-4368-4678-94ff-3960e28e3630 authority:https://sts.windows.net/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] azure:map[clientId:58b7a6ba-3af5-4931-916d-4b3e0493a52f cloudEnvironmentName:AzurePublicCloud tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] credsKeyVault:map[name:aro-hcp-dev-svc-kv secret:sessiongate-cert-prow-j7122560] httpRoute:map[gateway:map[name:ops-ingress-gateway namespace:aks-istio-ingress sectionName:sessiongate-https] host:sessiongate.j7122560.hcpsvc.osadev.cloud] image:map[digest:sha256:515473ffe4dec882fa676972e6e07bc6b4b707b5ef971a68ebf9d555e49558ff registry:arohcpsvcdev.azurecr.io repository:ci-op-szgz7hkr/pipeline] leaderElection:map[leaseDuration:15s renewDeadline:10s retryPeriod:2s] logLevel:2 mise:map[deploy:false policyLabel:Session Gate] nodeSelector:map[] pullBinding:map[registry:arohcpsvcdev.azurecr.io scope:repository:ci-op-szgz7hkr/pipeline:pull workloadIdentityClientId:a60934ba-6446-4fd2-929b-a62cb9cb15af workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] replicas:2 service:map[name:sessiongate port:8080] serviceAccount:map[name:sessiongate workloadIdentityClientId:695ee813-3803-4ae1-9c77-9b3166191069 workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] tolerations:[]]"
time=2026-02-26T23:55:55.616Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T23:55:55.860Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy namespace=sessiongate
time=2026-02-26T23:55:55.860Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy dryRun=false
time=2026-02-26T23:55:55.860Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T23:55:56.113Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T23:56:04.620Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy err="Internal error occurred: failed calling webhook \"validation.istio.io\": failed to call webhook: Post \"https://istiod-asm-1-26.aks-istio-system.svc:443/validate?timeout=10s\": proxy error from localhost:9443 while dialing 10.128.64.26:15017, code 500: 500 Internal Server Error"
time=2026-02-26T23:56:04.620Z level=INFO msg="Finished deploying Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T23:56:04.620Z level=INFO msg="Running inline diagnostics." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T23:56:07.494Z level=INFO msg="Determined release status." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy release=sessiongate namespace=sessiongate status=failed description="Release \"sessiongate\" failed: Internal error occurred: failed calling webhook \"validation.istio.io\": failed to call webhook: Post \"https://istiod-asm-1-26.aks-istio-system.svc:443/validate?timeout=10s\": proxy error from localhost:9443 while dialing 10.128.64.26:15017, code 500: 500 Internal Server Error" values="map[affinity:map[] auth:map[audience:6dae42f8-4368-4678-94ff-3960e28e3630 authority:https://sts.windows.net/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] azure:map[clientId:58b7a6ba-3af5-4931-916d-4b3e0493a52f cloudEnvironmentName:AzurePublicCloud tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] credsKeyVault:map[name:aro-hcp-dev-svc-kv secret:sessiongate-cert-prow-j7122560] httpRoute:map[gateway:map[name:ops-ingress-gateway namespace:aks-istio-ingress sectionName:sessiongate-https] host:sessiongate.j7122560.hcpsvc.osadev.cloud] image:map[digest:sha256:515473ffe4dec882fa676972e6e07bc6b4b707b5ef971a68ebf9d555e49558ff registry:arohcpsvcdev.azurecr.io repository:ci-op-szgz7hkr/pipeline] leaderElection:map[leaseDuration:15s renewDeadline:10s retryPeriod:2s] logLevel:2 mise:map[deploy:false policyLabel:Session Gate] nodeSelector:map[] pullBinding:map[registry:arohcpsvcdev.azurecr.io scope:repository:ci-op-szgz7hkr/pipeline:pull workloadIdentityClientId:a60934ba-6446-4fd2-929b-a62cb9cb15af workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] replicas:2 service:map[name:sessiongate port:8080] serviceAccount:map[name:sessiongate workloadIdentityClientId:695ee813-3803-4ae1-9c77-9b3166191069 workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] tolerations:[]]"
time=2026-02-26T23:56:07.497Z level=INFO msg="Kube-events kusto link for troubleshooting:" serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy url="https://hcp-dev-us-2.eastus2.kusto.windows.net/ServiceLogs?query=H4sIAAAAAAAA/5RUwW7aQBC9+ytWPgXJa0VUUIkqB0oqVapUIcopVQ/r9WA2rHfdmVkQER9fLU4a4mJIb9bsm5k3M88vscACgXxADSTuRKlYsSos3PjiETR/M66cEKNxVSba0HdVw98QbMEdI9Qo/RIe/EyEECKd2UAMuPAW0kykBETGu0oxyOdvWSunKqjBcUSkWZsYMz4bVxpXdRO1d4zeWkBZnEX8Xw0LqgSUYEFz5HO55g/ArdHdYXrAU43zYO0JhyZYe6XDNPDao3lSkc3cW6P3Eams9TtZA6PRJOl686/L5Xzhw5n388uC3wGIY3dwbPSxfXdt2IKkCrzuXZBG4Dn6rSkBZ1YR/XN53Rwn2pA0xMZL4yqEiHuz46nWPrSquE5/Foh9vXjW8T2sjDOdCSg/ycsVernWTa6eAkKufd1VX79kLsjt/TrrKXIPjfX7l7/h+ty9eKkB2aziIePdVgi0bqn37v2i8joZb8kkvz4lm1AAOmCgL9ERKDmI3RoQBJsaiFXdiAJ4B+DETakYYvgmHd4Ox/J2KIfj5fDDZDSajEYP6UDkuejFjCe3Hx/SwSA5iEdvnNgYV94Z5wBPfMw78Wpfp77VNazkIBr08fWVaCYaX7bg9xXJhPVVJmogUlUs6bEEFMX+ZPgSSP8JAAD//wpx5bhtBQAA"
time=2026-02-26T23:56:07.501Z level=INFO msg="Deployment complete." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T23:56:07.501Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy err="error running Helm release deployment Step, failed to deploy helm release: Internal error occurred: failed calling webhook \"validation.istio.io\": failed to call webhook: Post \"https://istiod-asm-1-26.aks-istio-system.svc:443/validate?timeout=10s\": proxy error from localhost:9443 while dialing 10.128.64.26:15017, code 500: 500 Internal Server Error"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 2c5d869
 n/a unknown failed #4235 (open) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 4dd0397 · merge 4dd0397
 n/a n/a passed #4232 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 3d97149 · merge ac3354a
 n/a provision failed ⚠#4234 (merged) 1
provision (1)
failed to run ARM step: failed to transform Bicep to ARM: failed to preprocess file: failed to preprocess content dev-infrastructure/configurations/audit-logs-eventhub.tmpl.bicepparam: failed to execute template: template: file:3:63: executing "file" at
22:16:32 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.Region/regional/auditLogsEventHub · suite step graph
Show raw failure
time=2026-02-26T22:51:53.028Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=auditLogsEventHub description="Step auditLogsEventHub\n  Kind: ARM\n  Template: templates/audit-logs-eventhub.bicep\n  Parameters: configurations/audit-logs-eventhub.tmpl.bicepparam"
time=2026-02-26T22:51:53.529Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=auditLogsEventHub err="failed to run ARM step: failed to transform Bicep to ARM: failed to preprocess file: failed to preprocess content dev-infrastructure/configurations/audit-logs-eventhub.tmpl.bicepparam: failed to execute template: template: file:3:63: executing \"file\" at <.auditlogsEventhub.kustoConsumerGroupName>: map has no entry for key \"auditlogsEventhub\""
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 93040b3
 n/a n/a passed #3913 (open) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 093ff16 · merge 4dd0397
 n/a unknown failed #4232 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head b1cdfeb · merge b1cdfeb
 n/a provision failed ★#4206 (merged) 1
provision (1)
Error response from registry: generic storage error: unknown_storage_failure
21:47:12 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.SessionGate/global/mirror-image · suite step graph
Show raw failure
time=2026-02-26T22:44:38.540Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image description="Step mirror-image\n  Kind: ImageMirror\n  From {<nil> sessiongate.image.registry <nil>}:{<nil> sessiongate.image.repository <nil>}@{<nil> sessiongate.image.digest <nil>} to {<nil> acr.svc.name <nil>}\n"
time=2026-02-26T22:45:13.810Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image err="error running Image Mirror Step, failed to execute shell command: Checking USE_OC_LOGIN_REGISTRIES: registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org\nSetting up registry authentication for CI source registry.\ninfo: Using registry public hostname registry.build06.ci.openshift.org\nSaved credentials for registry.build06.ci.openshift.org into /tmp/tmp.9XlvIHwNft/containers/auth.json\nLogging into target ACR arohcpsvcdev.\nLogin Succeeded\nMirroring image registry.build06.ci.openshift.org/ci-op-d1c75yws/pipeline@sha256:5a7ea3d2fad4267d150280e41fdfcc89c2eb4f795f4586efed656233973dd78a to arohcpsvcdev.azurecr.io/ci-op-d1c75yws/pipeline:5a7ea3d2fad4267d150280e41fdfcc89c2eb4f795f4586efed656233973dd78a.\nThe image will still be available under it's original digest sha256:5a7ea3d2fad4267d150280e41fdfcc89c2eb4f795f4586efed656233973dd78a in the target registry.\nError response from registry: generic storage error: unknown_storage_failure\n exit status 1"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
batch
head b1cdfeb · merge b1cdfeb
 n/a n/a passed #4206 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 318d31b
 n/a n/a passed #3880 (open) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 8700ec5 · merge 8700ec5
 n/a unknown failed #4119 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head c1d21b6 · merge 7cbe20c
 n/a unknown failed #4218 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 2ae66e5
 n/a e2e failed ★#4225 (closed) 18
e2e (18)
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
    <*fmt.wrapErrors | 0xc00161f170>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-w8n5vf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-w8n5vf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001069c30>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf",
            },
            <*fmt.wrapErrors | 0xc00161f140>{
                msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-w8n5vf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001069c30>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
    <*fmt.wrapErrors | 0xc00161f170>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-w8n5vf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-w8n5vf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001069c30>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf",
            },
            <*fmt.wrapErrors | 0xc00161f140>{
                msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-w8n5vf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001069c30>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-w8n5vf",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Cluster should become ready within 45 minutes
19:42:38 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to list HCP clusters without node pools at both subscription and resource group levels · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011fa7e0>: 
    failed to create HCP cluster list-test-cluster-pdbjp9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: failed waiting for cluster="list-test-cluster-pdbjp9" in resourcegroup="cluster-listing-pwc6jp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-pdbjp9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: failed waiting for cluster=\"list-test-cluster-pdbjp9\" in resourcegroup=\"cluster-listing-pwc6jp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000cc62a0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp",
            },
            <*fmt.wrapErrors | 0xc0011fa7b0>{
                msg: "failed waiting for cluster=\"list-test-cluster-pdbjp9\" in resourcegroup=\"cluster-listing-pwc6jp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000cc62a0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011fa7e0>: 
    failed to create HCP cluster list-test-cluster-pdbjp9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: failed waiting for cluster="list-test-cluster-pdbjp9" in resourcegroup="cluster-listing-pwc6jp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-pdbjp9, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: failed waiting for cluster=\"list-test-cluster-pdbjp9\" in resourcegroup=\"cluster-listing-pwc6jp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000cc62a0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp",
            },
            <*fmt.wrapErrors | 0xc0011fa7b0>{
                msg: "failed waiting for cluster=\"list-test-cluster-pdbjp9\" in resourcegroup=\"cluster-listing-pwc6jp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000cc62a0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-pdbjp9 in resource group cluster-listing-pwc6jp",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc00095d140>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-7v2zmp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-7v2zmp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001597a10>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp",
            },
            <*fmt.wrapErrors | 0xc00095d110>{
                msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-7v2zmp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001597a10>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc00095d140>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-7v2zmp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-7v2zmp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001597a10>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp",
            },
            <*fmt.wrapErrors | 0xc00095d110>{
                msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-7v2zmp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001597a10>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-7v2zmp",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc00121cb70>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-8x7bjm" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-8x7bjm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f8d880>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm",
            },
            <*fmt.wrapErrors | 0xc00121cb40>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-8x7bjm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f8d880>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc00121cb70>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-8x7bjm" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-8x7bjm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f8d880>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm",
            },
            <*fmt.wrapErrors | 0xc00121cb40>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-8x7bjm\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f8d880>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-8x7bjm",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d8f560>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-szvwv9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-szvwv9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e33440>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9",
            },
            <*fmt.wrapErrors | 0xc000d8f530>{
                msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-szvwv9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000e33440>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d8f560>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-szvwv9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-szvwv9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000e33440>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9",
            },
            <*fmt.wrapErrors | 0xc000d8f530>{
                msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-szvwv9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000e33440>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-szvwv9",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test SRE should be able to log into a cluster via a breakglass session · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:91]: Unexpected error:
    <*fmt.wrapErrors | 0xc00119f0e0>: 
    failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: failed waiting for cluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-h22lpz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-h22lpz\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001184540>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz",
            },
            <*fmt.wrapErrors | 0xc00119f0b0>{
                msg: "failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-h22lpz\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001184540>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:91]: Unexpected error:
    <*fmt.wrapErrors | 0xc00119f0e0>: 
    failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: failed waiting for cluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-h22lpz" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-h22lpz\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001184540>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz",
            },
            <*fmt.wrapErrors | 0xc00119f0b0>{
                msg: "failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-h22lpz\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001184540>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-h22lpz",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc00174ad50>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-pdpf46" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-pdpf46\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0015ff0b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46",
            },
            <*fmt.wrapErrors | 0xc00174ad20>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-pdpf46\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0015ff0b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc00174ad50>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-pdpf46" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-pdpf46\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0015ff0b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46",
            },
            <*fmt.wrapErrors | 0xc00174ad20>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-pdpf46\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0015ff0b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-pdpf46",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc0016a0690>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-gc2psn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-gc2psn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0009ff100>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn",
            },
            <*fmt.wrapErrors | 0xc0016a0660>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-gc2psn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0009ff100>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc0016a0690>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-gc2psn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-gc2psn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0009ff100>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn",
            },
            <*fmt.wrapErrors | 0xc0016a0660>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-gc2psn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0009ff100>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-gc2psn",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Interrupted by User
19:42:38 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite rp-api-compat-all/parallel
Show raw failure
fail [:0]: Interrupted by User
fail [:0]: Interrupted by User
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e8f1d0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-qmrk5d" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-qmrk5d\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0011478f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d",
            },
            <*fmt.wrapErrors | 0xc000e8f1a0>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-qmrk5d\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0011478f0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc000e8f1d0>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-qmrk5d" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-qmrk5d\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0011478f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d",
            },
            <*fmt.wrapErrors | 0xc000e8f1a0>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-qmrk5d\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0011478f0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-qmrk5d",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc00114af60>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-b98p8n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-b98p8n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00102c170>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n",
            },
            <*fmt.wrapErrors | 0xc00114af30>{
                msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-b98p8n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00102c170>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc00114af60>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-b98p8n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-b98p8n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00102c170>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n",
            },
            <*fmt.wrapErrors | 0xc00114af30>{
                msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-b98p8n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00102c170>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-b98p8n",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Engineering should be able to retrieve kusto logs for a cluster and services · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:87]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011194d0>: 
    failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: failed waiting for cluster="engineering-hcp-cluster" in resourcegroup="kusto-logs-kmfj7t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-kmfj7t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001011830>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t",
            },
            <*fmt.wrapErrors | 0xc0011194a0>{
                msg: "failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-kmfj7t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001011830>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:87]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011194d0>: 
    failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: failed waiting for cluster="engineering-hcp-cluster" in resourcegroup="kusto-logs-kmfj7t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-kmfj7t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001011830>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t",
            },
            <*fmt.wrapErrors | 0xc0011194a0>{
                msg: "failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-kmfj7t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001011830>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-kmfj7t",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc00147f380>: 
    failed to create HCP cluster ea-list5v47qc, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: failed waiting for cluster="ea-list5v47qc" in resourcegroup="ea-list-jnd5n2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-list5v47qc, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: failed waiting for cluster=\"ea-list5v47qc\" in resourcegroup=\"ea-list-jnd5n2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0011e54c0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2",
            },
            <*fmt.wrapErrors | 0xc00147f350>{
                msg: "failed waiting for cluster=\"ea-list5v47qc\" in resourcegroup=\"ea-list-jnd5n2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0011e54c0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc00147f380>: 
    failed to create HCP cluster ea-list5v47qc, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: failed waiting for cluster="ea-list5v47qc" in resourcegroup="ea-list-jnd5n2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-list5v47qc, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: failed waiting for cluster=\"ea-list5v47qc\" in resourcegroup=\"ea-list-jnd5n2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0011e54c0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2",
            },
            <*fmt.wrapErrors | 0xc00147f350>{
                msg: "failed waiting for cluster=\"ea-list5v47qc\" in resourcegroup=\"ea-list-jnd5n2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0011e54c0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list5v47qc in resource group ea-list-jnd5n2",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc0015795f0>: 
    failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-gmpxcj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-gmpxcj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00159b990>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj",
            },
            <*fmt.wrapErrors | 0xc0015795c0>{
                msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-gmpxcj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00159b990>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc0015795f0>: 
    failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-gmpxcj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-gmpxcj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00159b990>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj",
            },
            <*fmt.wrapErrors | 0xc0015795c0>{
                msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-gmpxcj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00159b990>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-gmpxcj",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012e80c0>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-4cfm2t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-4cfm2t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0011ded40>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t",
            },
            <*fmt.wrapErrors | 0xc0012e8090>{
                msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-4cfm2t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0011ded40>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012e80c0>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-4cfm2t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-4cfm2t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0011ded40>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t",
            },
            <*fmt.wrapErrors | 0xc0012e8090>{
                msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-4cfm2t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0011ded40>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-4cfm2t",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a5a750>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-jwzdq9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-jwzdq9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0017a2c70>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9",
            },
            <*fmt.wrapErrors | 0xc000a5a4e0>{
                msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-jwzdq9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0017a2c70>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a5a750>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-jwzdq9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-jwzdq9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0017a2c70>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9",
            },
            <*fmt.wrapErrors | 0xc000a5a4e0>{
                msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-jwzdq9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0017a2c70>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-jwzdq9",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
19:42:38 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012bd1d0>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-pm654m" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pm654m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00141a360>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m",
            },
            <*fmt.wrapErrors | 0xc0012bd170>{
                msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pm654m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00141a360>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012bd1d0>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-pm654m" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pm654m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00141a360>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m",
            },
            <*fmt.wrapErrors | 0xc0012bd170>{
                msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pm654m\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00141a360>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pm654m",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head e5b4a5c · merge e5b4a5c
 n/a n/a passed #3764 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 8e248ec
 n/a provision failed ★#4211 (open) 1
provision (1)
Error response from registry: generic storage error: unknown_storage_failure
19:40:05 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.SessionGate/global/mirror-image · suite step graph
Show raw failure
time=2026-02-26T20:39:01.997Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image description="Step mirror-image\n  Kind: ImageMirror\n  From {<nil> sessiongate.image.registry <nil>}:{<nil> sessiongate.image.repository <nil>}@{<nil> sessiongate.image.digest <nil>} to {<nil> acr.svc.name <nil>}\n"
time=2026-02-26T20:39:49.776Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image err="error running Image Mirror Step, failed to execute shell command: Checking USE_OC_LOGIN_REGISTRIES: registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org\nSetting up registry authentication for CI source registry.\ninfo: Using registry public hostname registry.build06.ci.openshift.org\nSaved credentials for registry.build06.ci.openshift.org into /tmp/tmp.MHIVNyZXw1/containers/auth.json\nLogging into target ACR arohcpsvcdev.\nLogin Succeeded\nMirroring image registry.build06.ci.openshift.org/ci-op-7s3i13lq/pipeline@sha256:5ab13f5f4b1769ee74924e2be6694e83d64cfeef47b72de079d4327126aa2768 to arohcpsvcdev.azurecr.io/ci-op-7s3i13lq/pipeline:5ab13f5f4b1769ee74924e2be6694e83d64cfeef47b72de079d4327126aa2768.\nThe image will still be available under it's original digest sha256:5ab13f5f4b1769ee74924e2be6694e83d64cfeef47b72de079d4327126aa2768 in the target registry.\nError response from registry: generic storage error: unknown_storage_failure\n exit status 1"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head d931913
 n/a provision failed ★#4198 (open) 1
provision (1)
ERROR CODE: DeploymentFailed; detail code Conflict; provider Microsoft.EventGrid
19:39:45 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.Region/regional/infra · suite step graph
Show raw failure
time=2026-02-26T20:13:27.106Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra description="Step infra\n  Kind: ARM\n  Template: templates/region.bicep\n  Parameters: configurations/region.tmpl.bicepparam"
time=2026-02-26T20:13:28.683Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra
time=2026-02-26T20:13:29.990Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra deployment=f7111b93b0d1f72d989a6075871d324992b310d68ab99fb8439822341aca9758
time=2026-02-26T20:15:00.699Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Region resourceGroup=regional step=infra err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j9131008/providers/Microsoft.Resources/deployments/f7111b93b0d1f72d989a6075871d324992b310d68ab99fb8439822341aca9758/operationStatuses/08584294700762803058\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j9131008/providers/Microsoft.Resources/deployments/maestro-infra-deployment\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n            \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j9131008/providers/Microsoft.EventGrid/namespaces/arohcp-prow-maestro-j9131008\\\",\\r\\n            \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n            \\\"details\\\": [\\r\\n              {\\r\\n                \\\"code\\\": \\\"Internal error\\\",\\r\\n                \\\"message\\\": \\\"The operation failed due to an internal server error. The initial state of the impacted resources (if any) are restored. Please try again in few minutes. If error still persists, report e820b139-89ef-4acc-a0b4-9ad45f7a0955:2/26/2026 8:14:46 PM (UTC) to our forums for assistance or raise a support ticket .\\\"\\r\\n              }\\r\\n            ]\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
batch
head e5b4a5c · merge e5b4a5c
 n/a n/a passed #3764 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 459bf8e · merge 4dd0397
 n/a unknown failed #4232 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 2345d73 · merge 2345d73
 n/a n/a passed #4233 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 60e1829 · merge 01e7af7
 n/a n/a passed #4122 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 551e259 · merge 551e259
 n/a n/a passed #4212 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head b1cdfeb · merge b1cdfeb
 n/a n/a passed #4206 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head ad97458 · merge 4dd0397
 n/a unknown failed #4232 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head fd85eea · merge 138964d
 n/a n/a passed #4226 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head bae1f6f · merge 4dd0397
 n/a unknown failed #4232 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
batch
head dcf56c7 · merge dcf56c7
 n/a e2e failed ★#3780 (merged) 1
e2e (1)
add password: error status code received from the API
17:23:02 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:130]: Unexpected error:
    <*fmt.wrapError | 0xc000784fa0>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc0009be090>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                            "cache-control": {"no-cache": {}},
                            "vary": {
                                "Accept-Encoding": {},
                            },
                            "content-type": {
                                "application/json": {},
                            },
                            "request-id": {
                                "9a73d530-cf0a-4400-a959-3638db9338be": {},
                            },
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"East US 2\",\"Slice\":\"E\",\"Ring\":\"5\",\"ScaleUnit\":\"000\",\"RoleInstance\":\"BN5PEPF0000E137\"}}": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Thu, 26 Feb 2026 19:05:07 GMT": {},
                            },
                            "client-request-id": {
                                "9a73d530-cf0a-4400-a959-3638db9338be": {},
                            },
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000784f20>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc000f593e0>{
                        backingStore: <*store.InMemoryBackingStore | 0xc000784f40>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "code": <*string | 0xc000f59260>"Request_ResourceNotFound",
                                "message": <*string | 0xc000f592b0>"Resource 'c1a3c5a6-e170-474c-80ed-20cd7dfcebdf' does not exist or one of its queried reference-property objects are not present.",
                                "innerError": <*odataerrors.InnerError | 0xc000f59440>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc000784f80>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                            },
                            subscribers: {},
                            changedValues: {"code": false, "message": false, "innerError": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:130]: Unexpected error:
    <*fmt.wrapError | 0xc000784fa0>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc0009be090>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                            "cache-control": {"no-cache": {}},
                            "vary": {
                                "Accept-Encoding": {},
                            },
                            "content-type": {
                                "application/json": {},
                            },
                            "request-id": {
                                "9a73d530-cf0a-4400-a959-3638db9338be": {},
                            },
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"East US 2\",\"Slice\":\"E\",\"Ring\":\"5\",\"ScaleUnit\":\"000\",\"RoleInstance\":\"BN5PEPF0000E137\"}}": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Thu, 26 Feb 2026 19:05:07 GMT": {},
                            },
                            "client-request-id": {
                                "9a73d530-cf0a-4400-a959-3638db9338be": {},
                            },
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000784f20>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc000f593e0>{
                        backingStore: <*store.InMemoryBackingStore | 0xc000784f40>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "code": <*string | 0xc000f59260>"Request_ResourceNotFound",
                                "message": <*string | 0xc000f592b0>"Resource 'c1a3c5a6-e170-474c-80ed-20cd7dfcebdf' does not exist or one of its queried reference-property objects are not present.",
                                "innerError": <*odataerrors.InnerError | 0xc000f59440>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc000784f80>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                            },
                            subscribers: {},
                            changedValues: {"code": false, "message": false, "innerError": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head d53c3d9 · merge a36f37a
 n/a provision failed ⚠#4205 (merged) 1
provision (1)
resource not ready, name: sessiongate, kind: Deployment, status: InProgress context deadline exceeded
17:08:56 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.SessionGate/service/deploy · suite step graph
Show raw failure
time=2026-02-26T18:01:36.390Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy description="Step deploy\n Kind: Helm\n"
time=2026-02-26T18:01:36.978Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy values="map[affinity:map[] auth:map[audience:6dae42f8-4368-4678-94ff-3960e28e3630 authority:https://sts.windows.net/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] azure:map[clientId:995538a1-5e50-4377-9b1b-291906c337e8 cloudEnvironmentName:AzurePublicCloud tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] credsKeyVault:map[name:aro-hcp-dev-svc-kv secret:sessiongate-cert-prow-j1544576] httpRoute:map[gateway:map[name:ops-ingress-gateway namespace:aks-istio-ingress sectionName:sessiongate-https] host:sessiongate.j1544576.hcpsvc.osadev.cloud] image:map[digest:sha256:01eb1340cda3b9e2988d69c58cca459cd11254eff3272ee49ea170ffd9de3c1f registry:arohcpsvcdev.azurecr.io repository:ci-op-5rmggnbr/pipeline] leaderElection:map[leaseDuration:15s renewDeadline:10s retryPeriod:2s] logLevel:2 mise:map[deploy:false policyLabel:Session Gate] nodeSelector:map[] pullBinding:map[registry:arohcpsvcdev.azurecr.io scope:repository:ci-op-5rmggnbr/pipeline:pull workloadIdentityClientId:d93c4053-c801-470f-bb5e-c876e889e0b8 workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] replicas:2 service:map[name:sessiongate port:8080] serviceAccount:map[name:sessiongate workloadIdentityClientId:3bd23cbc-2852-4280-ac58-72f9b9af4eee workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] tolerations:[]]"
time=2026-02-26T18:01:36.978Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T18:01:37.259Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy namespace=sessiongate
time=2026-02-26T18:01:37.259Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy dryRun=false
time=2026-02-26T18:01:37.259Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T18:01:37.677Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T18:06:44.366Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy err="resource not ready, name: sessiongate, kind: Deployment, status: InProgress\ncontext deadline exceeded"
time=2026-02-26T18:06:44.366Z level=INFO msg="Finished deploying Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T18:06:44.366Z level=INFO msg="Running inline diagnostics." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T18:06:49.207Z level=INFO msg="Determined release status." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy release=sessiongate namespace=sessiongate status=failed description="Release \"sessiongate\" failed: resource not ready, name: sessiongate, kind: Deployment, status: InProgress\ncontext deadline exceeded" values="map[affinity:map[] auth:map[audience:6dae42f8-4368-4678-94ff-3960e28e3630 authority:https://sts.windows.net/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] azure:map[clientId:995538a1-5e50-4377-9b1b-291906c337e8 cloudEnvironmentName:AzurePublicCloud tenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] credsKeyVault:map[name:aro-hcp-dev-svc-kv secret:sessiongate-cert-prow-j1544576] httpRoute:map[gateway:map[name:ops-ingress-gateway namespace:aks-istio-ingress sectionName:sessiongate-https] host:sessiongate.j1544576.hcpsvc.osadev.cloud] image:map[digest:sha256:01eb1340cda3b9e2988d69c58cca459cd11254eff3272ee49ea170ffd9de3c1f registry:arohcpsvcdev.azurecr.io repository:ci-op-5rmggnbr/pipeline] leaderElection:map[leaseDuration:15s renewDeadline:10s retryPeriod:2s] logLevel:2 mise:map[deploy:false policyLabel:Session Gate] nodeSelector:map[] pullBinding:map[registry:arohcpsvcdev.azurecr.io scope:repository:ci-op-5rmggnbr/pipeline:pull workloadIdentityClientId:d93c4053-c801-470f-bb5e-c876e889e0b8 workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] replicas:2 service:map[name:sessiongate port:8080] serviceAccount:map[name:sessiongate workloadIdentityClientId:3bd23cbc-2852-4280-ac58-72f9b9af4eee workloadIdentityTenantId:XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] tolerations:[]]"
time=2026-02-26T18:06:49.208Z level=INFO msg="Kube-events kusto link for troubleshooting:" serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy url="https://hcp-dev-us-2.eastus2.kusto.windows.net/ServiceLogs?query=H4sIAAAAAAAA/6SUTWvbThDG7/oUi04xeEXi/5+0dckhTQqFQjFuTik9rFYTaZPVjjoza+PgD1/kl0QofonpbTX77I95mNGTeBBFwBjJAqsrVRgxYnIPZ5g/gpXvLhRjFnKhHKp16Yep4aUEMwirCjfGbsuDX4lSSqU/gWbOQjpUKQOzw1Aaefu5Ft9C43FRQ5B/1GsLJO7B2fZM8EDAFVArMk+sHYtD7UJJwLxlTeFPBJbrKBUEaV86DH0srUXaRKn29LQxfG0txvf6mKLvX2mLQQi9X7d98iPtwRRAGjzYHU66kC8uFC6UB1j5TsVpjF4/R5jXlibR+w62id4fexSlQnLPq9FN0Du7WI3ce5z3h346oAYhZ1nz8Xke5ASUar+Hb3d3kynGHeg922YJZEI4cwXQjTdvvGm2zcHFv4ksWE83AXALDy643sZw1gFmhlBXtsnMcyTILNat8oXmIwvQruXcnHVtgilh+9emye/PyVPMgQII8Nc2TDhZqnkFBEpcDSymblQOMgcI6qwwAm35LB2djy71+UiPLu8uPo7PL8b/fbhPByrL1F7N5fj/T/fpYJAs1SO6oJ5cKK5cCECdCMSgXpOvG3n9rEuWqiFsb18bHaoGi7X4fZCh8lgOVQ3MpmyRSAWQyhcd8wWw/RsAAP//tUsDTqgFAAA="
time=2026-02-26T18:06:49.210Z level=INFO msg="Deployment complete." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy
time=2026-02-26T18:06:49.210Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=service step=deploy err="error running Helm release deployment Step, failed to deploy helm release: resource not ready, name: sessiongate, kind: Deployment, status: InProgress\ncontext deadline exceeded"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 2fe3821
 n/a n/a passed #3973 (open) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 2966930 · merge 667202a
 n/a n/a passed #3635 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head e6b55da · merge e6b55da
 n/a n/a passed #4166 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 0cb534b · merge 4c15703
 n/a unknown failed #4075 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head e5b4a5c · merge e5b4a5c
 n/a n/a passed #3764 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head e9d3aed · merge e9d3aed
 n/a n/a passed #4216 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 6250bf2 · merge 6250bf2
 n/a n/a passed #4229 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 7e51a2c
 n/a n/a passed #3925 (open) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 40f4003 · merge 97dcd34
 n/a n/a passed #4128 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head b1cdfeb · merge b1cdfeb
 n/a e2e failed ★#4206 (merged) 1
e2e (1)
ERROR CODE: InternalServerError; detail code AuthorizationPermissionMismatch; provider Microsoft.RedHatOpenShift
15:21:18 UTC · failed at e2e · test Customer should be able to list HCP clusters without node pools at both subscription and resource group levels · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapError | 0xc0015083c0>: 
    failed to create HCP cluster list-test-cluster-7nxzjr: failed waiting for cluster="list-test-cluster-7nxzjr" in resourcegroup="cluster-listing-b9d86s" to finish creating: GET https://rp.j2239104.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957",
      "name": "316ab2aa-6ef3-41f4-950d-3837ec8f1957",
      "status": "Failed",
      "startTime": "2026-02-26T16:57:25.884160289Z",
      "endTime": "2026-02-26T16:59:49.321806889Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://arohcpprowoidcj2239104.blob.core.windows.net/$web\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\nERROR CODE: AuthorizationPermissionMismatch\n--------------------------------------------------------------------------------\n\u003c?xml version=\"1.0\" encoding=\"utf-8\"?\u003e\u003cError\u003e\u003cCode\u003eAuthorizationPermissionMismatch\u003c/Code\u003e\u003cMessage\u003eThis request is not authorized to perform this operation using this permission.\nRequestId:0ba28688-e01e-003f-3641-a7551a000000\nTime:2026-02-26T16:58:59.0886326Z\u003c/Message\u003e\u003c/Error\u003e\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster list-test-cluster-7nxzjr: failed waiting for cluster=\"list-test-cluster-7nxzjr\" in resourcegroup=\"cluster-listing-b9d86s\" to finish creating: GET https://rp.j2239104.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"name\": \"316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T16:57:25.884160289Z\",\n  \"endTime\": \"2026-02-26T16:59:49.321806889Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj2239104.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:0ba28688-e01e-003f-3641-a7551a000000\\nTime:2026-02-26T16:58:59.0886326Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc0015083a0>{
            msg: "failed waiting for cluster=\"list-test-cluster-7nxzjr\" in resourcegroup=\"cluster-listing-b9d86s\" to finish creating: GET https://rp.j2239104.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"name\": \"316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T16:57:25.884160289Z\",\n  \"endTime\": \"2026-02-26T16:59:49.321806889Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj2239104.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:0ba28688-e01e-003f-3641-a7551a000000\\nTime:2026-02-26T16:58:59.0886326Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapError | 0xc0015083c0>: 
    failed to create HCP cluster list-test-cluster-7nxzjr: failed waiting for cluster="list-test-cluster-7nxzjr" in resourcegroup="cluster-listing-b9d86s" to finish creating: GET https://rp.j2239104.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957",
      "name": "316ab2aa-6ef3-41f4-950d-3837ec8f1957",
      "status": "Failed",
      "startTime": "2026-02-26T16:57:25.884160289Z",
      "endTime": "2026-02-26T16:59:49.321806889Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://arohcpprowoidcj2239104.blob.core.windows.net/$web\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\nERROR CODE: AuthorizationPermissionMismatch\n--------------------------------------------------------------------------------\n\u003c?xml version=\"1.0\" encoding=\"utf-8\"?\u003e\u003cError\u003e\u003cCode\u003eAuthorizationPermissionMismatch\u003c/Code\u003e\u003cMessage\u003eThis request is not authorized to perform this operation using this permission.\nRequestId:0ba28688-e01e-003f-3641-a7551a000000\nTime:2026-02-26T16:58:59.0886326Z\u003c/Message\u003e\u003c/Error\u003e\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster list-test-cluster-7nxzjr: failed waiting for cluster=\"list-test-cluster-7nxzjr\" in resourcegroup=\"cluster-listing-b9d86s\" to finish creating: GET https://rp.j2239104.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"name\": \"316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T16:57:25.884160289Z\",\n  \"endTime\": \"2026-02-26T16:59:49.321806889Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj2239104.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:0ba28688-e01e-003f-3641-a7551a000000\\nTime:2026-02-26T16:58:59.0886326Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc0015083a0>{
            msg: "failed waiting for cluster=\"list-test-cluster-7nxzjr\" in resourcegroup=\"cluster-listing-b9d86s\" to finish creating: GET https://rp.j2239104.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"name\": \"316ab2aa-6ef3-41f4-950d-3837ec8f1957\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T16:57:25.884160289Z\",\n  \"endTime\": \"2026-02-26T16:59:49.321806889Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj2239104.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:0ba28688-e01e-003f-3641-a7551a000000\\nTime:2026-02-26T16:58:59.0886326Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 2ae66e5
 n/a e2e failed ★#4225 (closed) 13
e2e (13)
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
    <*fmt.wrapErrors | 0xc001003470>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-djclcg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-djclcg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00135bc50>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg",
            },
            <*fmt.wrapErrors | 0xc001003440>{
                msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-djclcg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00135bc50>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: Unexpected error:
    <*fmt.wrapErrors | 0xc001003470>: 
    failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: failed waiting for cluster="hcp-cluster-np-128" in resourcegroup="clusternp128-djclcg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster hcp-cluster-np-128, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-djclcg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00135bc50>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg",
            },
            <*fmt.wrapErrors | 0xc001003440>{
                msg: "failed waiting for cluster=\"hcp-cluster-np-128\" in resourcegroup=\"clusternp128-djclcg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00135bc50>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster hcp-cluster-np-128 in resource group clusternp128-djclcg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012af7d0>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-nffc6t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-nffc6t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0012a64b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t",
            },
            <*fmt.wrapErrors | 0xc0012af7a0>{
                msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-nffc6t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0012a64b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc0012af7d0>: 
    failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-nffc6t" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-nffc6t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0012a64b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t",
            },
            <*fmt.wrapErrors | 0xc0012af7a0>{
                msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-nffc6t\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0012a64b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster arm64-vm-hcp-cluster in resource group arm64-vm-cluster-nffc6t",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Deserializaion Error: no output from command
15:03:57 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite rp-api-compat-all/parallel
Show raw failure
> github.com/Azure/ARO-HCP/test/e2e.init.func16.2({0x7f1854070660, 0xc000816db0})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
                | 
                | By("waiting for first cluster to complete creation")
                > _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
                | 	Frequency: framework.StandardPollInterval,
                | })
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x80b5f60?, 0xc000816db0?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 88
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 02/26/26 17:39:50.537
  "ts"="2026-02-26 17:39:50.538108" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-26 17:39:50.538368" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-b6nhld" "resourceGroup"="customer-rg-52gf6d"
  "ts"="2026-02-26 17:39:54.692118" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-b6nhld" "resourceGroup"=""
  "ts"="2026-02-26 17:39:55.250960" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-cm6ldk" "resourceGroup"="customer-rg-52gf6d"
  "ts"="2026-02-26 17:39:55.421305" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-cm6ldk" "resourceGroup"=""
  "ts"="2026-02-26 17:39:56.228414" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 17:39:56.228539" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 17:39:56.228622" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-26 17:39:56.229817" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-244"
  "ts"="2026-02-26 17:39:56.229832" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-280"
  "ts"="2026-02-26 17:39:56.229883" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-199"
  "ts"="2026-02-26 17:39:56.229847" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-52gf6d"
  "ts"="2026-02-26 17:39:56.836836" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-244" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 17:39:57.240653" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-280" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 17:39:57.672409" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-199" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 17:39:58.169797" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
  "ts"="2026-02-26 17:39:58.526460" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-244" "deployment"="msi-deployment-244"
  "ts"="2026-02-26 17:39:58.961521" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-280" "deployment"="msi-deployment-280"
  "ts"="2026-02-26 17:39:59.354090" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-199" "deployment"="msi-deployment-199"
  "ts"="2026-02-26 17:39:59.814951" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="customer-infra-basic-hcp-cluster2-cm6ldk"
  "ts"="2026-02-26 17:40:01.586555" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
  "ts"="2026-02-26 17:40:02.135210" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="customer-infra-basic-hcp-cluster-b6nhld"
  "ts"="2026-02-26 17:40:02.767984" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-26 17:40:02.768112" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-26 17:40:02.768220" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-52gf6d"
Command Error: signal: killed
Deserializaion Error: no output from command
> github.com/Azure/ARO-HCP/test/e2e.init.func16.2({0x7f1854070660, 0xc000816db0})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
                | 
                | By("waiting for first cluster to complete creation")
                > _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
                | 	Frequency: framework.StandardPollInterval,
                | })
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x80b5f60?, 0xc000816db0?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 88
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 02/26/26 17:39:50.537
  "ts"="2026-02-26 17:39:50.538108" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-26 17:39:50.538368" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-b6nhld" "resourceGroup"="customer-rg-52gf6d"
  "ts"="2026-02-26 17:39:54.692118" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-b6nhld" "resourceGroup"=""
  "ts"="2026-02-26 17:39:55.250960" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-cm6ldk" "resourceGroup"="customer-rg-52gf6d"
  "ts"="2026-02-26 17:39:55.421305" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-cm6ldk" "resourceGroup"=""
  "ts"="2026-02-26 17:39:56.228414" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 17:39:56.228539" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 17:39:56.228622" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-26 17:39:56.229817" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-244"
  "ts"="2026-02-26 17:39:56.229832" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-280"
  "ts"="2026-02-26 17:39:56.229883" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-199"
  "ts"="2026-02-26 17:39:56.229847" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-52gf6d"
  "ts"="2026-02-26 17:39:56.836836" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-244" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 17:39:57.240653" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-280" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 17:39:57.672409" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-199" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 17:39:58.169797" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
  "ts"="2026-02-26 17:39:58.526460" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-244" "deployment"="msi-deployment-244"
  "ts"="2026-02-26 17:39:58.961521" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-280" "deployment"="msi-deployment-280"
  "ts"="2026-02-26 17:39:59.354090" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-199" "deployment"="msi-deployment-199"
  "ts"="2026-02-26 17:39:59.814951" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="customer-infra-basic-hcp-cluster2-cm6ldk"
  "ts"="2026-02-26 17:40:01.586555" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
  "ts"="2026-02-26 17:40:02.135210" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-52gf6d" "deployment"="customer-infra-basic-hcp-cluster-b6nhld"
  "ts"="2026-02-26 17:40:02.767984" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-26 17:40:02.768112" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-26 17:40:02.768220" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-52gf6d"
Command Error: signal: killed
Deserializaion Error: no output from command
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to update nodepool replicas and autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011a16e0>: 
    failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-nhdrn4" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-nhdrn4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d711e0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4",
            },
            <*fmt.wrapErrors | 0xc0011a16b0>{
                msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-nhdrn4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000d711e0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011a16e0>: 
    failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-nhdrn4" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-nhdrn4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d711e0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4",
            },
            <*fmt.wrapErrors | 0xc0011a16b0>{
                msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-nhdrn4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000d711e0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-nhdrn4",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc0008ef020>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-xl8xs5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-xl8xs5\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00100c200>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5",
            },
            <*fmt.wrapErrors | 0xc0008eeff0>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-xl8xs5\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00100c200>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc0008ef020>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-xl8xs5" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-xl8xs5\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00100c200>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5",
            },
            <*fmt.wrapErrors | 0xc0008eeff0>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-xl8xs5\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00100c200>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-xl8xs5",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Cluster should become ready within 45 minutes
15:03:57 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Engineering should be able to retrieve kusto logs for a cluster and services · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:87]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a949c0>: 
    failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: failed waiting for cluster="engineering-hcp-cluster" in resourcegroup="kusto-logs-9k6lwk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-9k6lwk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001379870>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk",
            },
            <*fmt.wrapErrors | 0xc000a94990>{
                msg: "failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-9k6lwk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001379870>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/kusto_logs_present.go:87]: Unexpected error:
    <*fmt.wrapErrors | 0xc000a949c0>: 
    failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: failed waiting for cluster="engineering-hcp-cluster" in resourcegroup="kusto-logs-9k6lwk" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster engineering-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-9k6lwk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001379870>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk",
            },
            <*fmt.wrapErrors | 0xc000a94990>{
                msg: "failed waiting for cluster=\"engineering-hcp-cluster\" in resourcegroup=\"kusto-logs-9k6lwk\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001379870>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster engineering-hcp-cluster in resource group kusto-logs-9k6lwk",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011d5710>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-tln996" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-tln996\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00118b510>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996",
            },
            <*fmt.wrapErrors | 0xc0011d56e0>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-tln996\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00118b510>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc0011d5710>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-tln996" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-tln996\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00118b510>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996",
            },
            <*fmt.wrapErrors | 0xc0011d56e0>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-tln996\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00118b510>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-tln996",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc000c08390>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-pcvvcv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-pcvvcv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010cc4b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv",
            },
            <*fmt.wrapErrors | 0xc000c08300>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-pcvvcv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0010cc4b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc000c08390>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-pcvvcv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-pcvvcv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010cc4b0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv",
            },
            <*fmt.wrapErrors | 0xc000c08300>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-pcvvcv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0010cc4b0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-pcvvcv",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fbf530>: 
    failed to create HCP cluster ea-list59w2fq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: failed waiting for cluster="ea-list59w2fq" in resourcegroup="ea-list-n7vfgg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-list59w2fq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: failed waiting for cluster=\"ea-list59w2fq\" in resourcegroup=\"ea-list-n7vfgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f0fa20>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg",
            },
            <*fmt.wrapErrors | 0xc000fbf500>{
                msg: "failed waiting for cluster=\"ea-list59w2fq\" in resourcegroup=\"ea-list-n7vfgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f0fa20>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fbf530>: 
    failed to create HCP cluster ea-list59w2fq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: failed waiting for cluster="ea-list59w2fq" in resourcegroup="ea-list-n7vfgg" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-list59w2fq, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: failed waiting for cluster=\"ea-list59w2fq\" in resourcegroup=\"ea-list-n7vfgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f0fa20>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg",
            },
            <*fmt.wrapErrors | 0xc000fbf500>{
                msg: "failed waiting for cluster=\"ea-list59w2fq\" in resourcegroup=\"ea-list-n7vfgg\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f0fa20>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-list59w2fq in resource group ea-list-n7vfgg",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010a7740>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-xnbf4n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-xnbf4n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00137cde0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n",
            },
            <*fmt.wrapErrors | 0xc0010a7710>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-xnbf4n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00137cde0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010a7740>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-xnbf4n" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-xnbf4n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00137cde0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n",
            },
            <*fmt.wrapErrors | 0xc0010a7710>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-xnbf4n\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00137cde0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-xnbf4n",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test SRE should be able to log into a cluster via a breakglass session · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:91]: Unexpected error:
    <*fmt.wrapErrors | 0xc000b80ed0>: 
    failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: failed waiting for cluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-hc87bh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-hc87bh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0014738e0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh",
            },
            <*fmt.wrapErrors | 0xc000b80ea0>{
                msg: "failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-hc87bh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0014738e0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/admin_api.go:91]: Unexpected error:
    <*fmt.wrapErrors | 0xc000b80ed0>: 
    failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: failed waiting for cluster="sre-hcp-cluster" in resourcegroup="admin-api-breakglass-hc87bh" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster sre-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-hc87bh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0014738e0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh",
            },
            <*fmt.wrapErrors | 0xc000b80ea0>{
                msg: "failed waiting for cluster=\"sre-hcp-cluster\" in resourcegroup=\"admin-api-breakglass-hc87bh\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0014738e0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster sre-hcp-cluster in resource group admin-api-breakglass-hc87bh",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
15:03:57 UTC · failed at e2e · test Customer should be able to list HCP clusters without node pools at both subscription and resource group levels · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc0016119e0>: 
    failed to create HCP cluster list-test-cluster-r9tffb, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: failed waiting for cluster="list-test-cluster-r9tffb" in resourcegroup="cluster-listing-jfwtfx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-r9tffb, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: failed waiting for cluster=\"list-test-cluster-r9tffb\" in resourcegroup=\"cluster-listing-jfwtfx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000fad280>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx",
            },
            <*fmt.wrapErrors | 0xc0016119b0>{
                msg: "failed waiting for cluster=\"list-test-cluster-r9tffb\" in resourcegroup=\"cluster-listing-jfwtfx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000fad280>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc0016119e0>: 
    failed to create HCP cluster list-test-cluster-r9tffb, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: failed waiting for cluster="list-test-cluster-r9tffb" in resourcegroup="cluster-listing-jfwtfx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-r9tffb, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: failed waiting for cluster=\"list-test-cluster-r9tffb\" in resourcegroup=\"cluster-listing-jfwtfx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000fad280>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx",
            },
            <*fmt.wrapErrors | 0xc0016119b0>{
                msg: "failed waiting for cluster=\"list-test-cluster-r9tffb\" in resourcegroup=\"cluster-listing-jfwtfx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000fad280>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-r9tffb in resource group cluster-listing-jfwtfx",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 8e248ec
 n/a provision failed ★#4211 (open) 1
provision (1)
Error: Put "<url>": unexpected EOF
14:56:38 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.SessionGate/global/mirror-image · suite step graph
Show raw failure
time=2026-02-26T15:59:04.164Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image description="Step mirror-image\n  Kind: ImageMirror\n  From {<nil> sessiongate.image.registry <nil>}:{<nil> sessiongate.image.repository <nil>}@{<nil> sessiongate.image.digest <nil>} to {<nil> acr.svc.name <nil>}\n"
time=2026-02-26T15:59:07.318Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image err="error running Image Mirror Step, failed to execute shell command: Checking USE_OC_LOGIN_REGISTRIES: registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org\nSetting up registry authentication for CI source registry.\ninfo: Using registry public hostname registry.build06.ci.openshift.org\nSaved credentials for registry.build06.ci.openshift.org into /tmp/tmp.EFTrAXRzgz/containers/auth.json\nLogging into target ACR arohcpsvcdev.\nLogin Succeeded\nMirroring image registry.build06.ci.openshift.org/ci-op-mdmz0cms/pipeline@sha256:a3132d48f67d74ec20b81d652ab3fff5fb0f3370fce694f9720cece0d540d27f to arohcpsvcdev.azurecr.io/ci-op-mdmz0cms/pipeline:a3132d48f67d74ec20b81d652ab3fff5fb0f3370fce694f9720cece0d540d27f.\nThe image will still be available under it's original digest sha256:a3132d48f67d74ec20b81d652ab3fff5fb0f3370fce694f9720cece0d540d27f in the target registry.\nError: Put \"https://arohcpsvcdev.azurecr.io/v2/ci-op-mdmz0cms/pipeline/blobs/uploads/611c634a-b7ca-4976-bd5b-a917b94336c9?_nouploadcache=false&_state=G0XYL6FBqIa2PyF_hlCNGRmxq-A8nzQEwxSE9hwE10Z7Ik5hbWUiOiJjaS1vcC1tZG16MGNtcy9waXBlbGluZSIsIlVVSUQiOiI2MTFjNjM0YS1iN2NhLTQ5NzYtYmQ1Yi1hOTE3Yjk0MzM2YzkiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjYtMDItMjZUMTU6NTk6MDcuMDYzOTgzNTc5WiJ9&digest=sha256%3Ad6f922f5b32836446d94dbb2e46cd5d47628d4910ae9760e665af4ed57169533\": unexpected EOF\n exit status 1"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head dcf56c7 · merge dcf56c7
 n/a n/a passed #3780 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head dba199d · merge dba199d
 n/a n/a passed #4100 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head bafae7a
 n/a n/a passed #4210 (open) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head c182a32 · merge c182a32
 n/a n/a passed #4126 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 2966930 · merge 667202a
 n/a provision failed ★#3635 (merged) 1
provision (1)
Error response from registry: generic storage error: unknown_storage_failure
14:30:00 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.SessionGate/global/mirror-image · suite step graph
Show raw failure
time=2026-02-26T15:20:05.459Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image description="Step mirror-image\n  Kind: ImageMirror\n  From {<nil> sessiongate.image.registry <nil>}:{<nil> sessiongate.image.repository <nil>}@{<nil> sessiongate.image.digest <nil>} to {<nil> acr.svc.name <nil>}\n"
time=2026-02-26T15:20:43.140Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.SessionGate resourceGroup=global step=mirror-image err="error running Image Mirror Step, failed to execute shell command: Checking USE_OC_LOGIN_REGISTRIES: registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org registry.build06.ci.openshift.org\nSetting up registry authentication for CI source registry.\ninfo: Using registry public hostname registry.build06.ci.openshift.org\nSaved credentials for registry.build06.ci.openshift.org into /tmp/tmp.cPzb88aOJT/containers/auth.json\nLogging into target ACR arohcpsvcdev.\nLogin Succeeded\nMirroring image registry.build06.ci.openshift.org/ci-op-glt56nnw/pipeline@sha256:d341b352350f683969cbb8c0eed104759a1440a09bfe8c680e0ea2ea95e14eec to arohcpsvcdev.azurecr.io/ci-op-glt56nnw/pipeline:d341b352350f683969cbb8c0eed104759a1440a09bfe8c680e0ea2ea95e14eec.\nThe image will still be available under it's original digest sha256:d341b352350f683969cbb8c0eed104759a1440a09bfe8c680e0ea2ea95e14eec in the target registry.\nError response from registry: generic storage error: unknown_storage_failure\n exit status 1"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head b1cdfeb · merge b1cdfeb
 n/a e2e failed ★#4206 (merged) 1
e2e (1)
failed to search for managed resource groups: failed to list resource groups while discovering managed groups: AzureCLICredential: signal: killed
12:49:42 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
    <*errors.joinError | 0xc000f8c660>: 
    failed to search for managed resource groups: failed to list resource groups while discovering managed groups: AzureCLICredential: signal: killed
    {
        errs: [
            <*fmt.wrapError | 0xc000ffe520>{
                msg: "failed to search for managed resource groups: failed to list resource groups while discovering managed groups: AzureCLICredential: signal: killed",
                err: <*fmt.wrapError | 0xc000ffe500>{
                    msg: "failed to list resource groups while discovering managed groups: AzureCLICredential: signal: killed",
                    err: <*azidentity.AuthenticationFailedError | 0xc001704d50>{
                        RawResponse: nil,
                        credType: "AzureCLICredential",
                        message: "signal: killed",
                        omitResponse: false,
                    },
                },
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243]: Unexpected error:
    <*errors.joinError | 0xc000f8c660>: 
    failed to search for managed resource groups: failed to list resource groups while discovering managed groups: AzureCLICredential: signal: killed
    {
        errs: [
            <*fmt.wrapError | 0xc000ffe520>{
                msg: "failed to search for managed resource groups: failed to list resource groups while discovering managed groups: AzureCLICredential: signal: killed",
                err: <*fmt.wrapError | 0xc000ffe500>{
                    msg: "failed to list resource groups while discovering managed groups: AzureCLICredential: signal: killed",
                    err: <*azidentity.AuthenticationFailedError | 0xc001704d50>{
                        RawResponse: nil,
                        credType: "AzureCLICredential",
                        message: "signal: killed",
                        omitResponse: false,
                    },
                },
            },
        ],
    }
occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head e6b55da · merge e6b55da
 n/a n/a passed #4166 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head c182a32 · merge c182a32
 n/a n/a passed #4126 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head b541ca7 · merge b541ca7
 n/a n/a passed #4196 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head e726e43 · merge e5b4a5c
 n/a n/a passed #3764 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head a4fb1d6 · merge a36f37a
 n/a e2e failed ★#4205 (merged) 2
e2e (2)
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift
10:37:37 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
    <*fmt.wrapError | 0xc000f723c0>: 
    failed creating external auth "ea-list" in resourcegroup="ea-list-j7767t" for cluster="ea-listnplnzn": PUT https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-j7767t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listnplnzn/externalAuths/ea-list
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed creating external auth \"ea-list\" in resourcegroup=\"ea-list-j7767t\" for cluster=\"ea-listnplnzn\": PUT https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-j7767t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listnplnzn/externalAuths/ea-list\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc00063e780>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Request-Id": [
                        "091a6625-f578-4572-89d6-eef220ef4fd9",
                    ],
                    "Date": [
                        "Thu, 26 Feb 2026 11:52:58 GMT",
                    ],
                    "Content-Length": ["186"],
                    "X-Envoy-Upstream-Service-Time": ["10003"],
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "Retry-After": ["10"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000f72300>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 186,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "PUT",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j4896896.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-j7767t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listnplnzn/externalAuths/ea-list",
                        RawPath: "",
                        OmitHost: false,
                        ForceQuery: false,
                        RawQuery: "api-version=2024-06-10-preview",
                        Fragment: "",
                        RawFragment: "",
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "Content-Type": ["application/json"],
                        "User-Agent": [
                            "azsdk-go-armredhatopenshifthcp/v0.1.0 (go1....

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:118]: Unexpected error:
    <*fmt.wrapError | 0xc000f723c0>: 
    failed creating external auth "ea-list" in resourcegroup="ea-list-j7767t" for cluster="ea-listnplnzn": PUT https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-j7767t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listnplnzn/externalAuths/ea-list
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed creating external auth \"ea-list\" in resourcegroup=\"ea-list-j7767t\" for cluster=\"ea-listnplnzn\": PUT https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-j7767t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listnplnzn/externalAuths/ea-list\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc00063e780>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Request-Id": [
                        "091a6625-f578-4572-89d6-eef220ef4fd9",
                    ],
                    "Date": [
                        "Thu, 26 Feb 2026 11:52:58 GMT",
                    ],
                    "Content-Length": ["186"],
                    "X-Envoy-Upstream-Service-Time": ["10003"],
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "Retry-After": ["10"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000f72300>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 186,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "PUT",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j4896896.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-j7767t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listnplnzn/externalAuths/ea-list",
                        RawPath: "",
                        OmitHost: false,
                        ForceQuery: false,
                        RawQuery: "api-version=2024-06-10-preview",
                        Fragment: "",
                        RawFragment: "",
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "Content-Type": ["application/json"],
                        "User-Agent": [
                            "azsdk-go-armredhatopenshifthcp/v0.1.0 (go1....

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
ERROR CODE: LockContention; detail message Failed to acquire lock: timed out; provider Microsoft.RedHatOpenShift
10:37:37 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
    <*fmt.wrapError | 0xc000730440>: 
    failed to start credential request: POST https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-4r59dj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-4r59dj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0015606f0>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Request-Id": [
                        "dc8fa544-ae88-4bc0-a51a-667baaf0a1f5",
                    ],
                    "Date": [
                        "Thu, 26 Feb 2026 11:52:58 GMT",
                    ],
                    "Content-Length": ["186"],
                    "X-Envoy-Upstream-Service-Time": ["10004"],
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "Retry-After": ["10"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000730360>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 186,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j4896896.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-4r59dj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential",
                        RawPath: "",
                        OmitHost: false,
                        ForceQuery: false,
                        RawQuery: "api-version=2024-06-10-preview",
                        Fragment: "",
                        RawFragment: "",
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "User-Agent": [
                            "azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
          ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:100]: Unexpected error:
    <*fmt.wrapError | 0xc000730440>: 
    failed to start credential request: POST https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-4r59dj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential
    --------------------------------------------------------------------------------
    RESPONSE 503: 503 Service Unavailable
    ERROR CODE: LockContention
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "LockContention",
        "message": "Failed to acquire lock: timed out",
        "target": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to start credential request: POST https://rp.j4896896.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-4r59dj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential\n--------------------------------------------------------------------------------\nRESPONSE 503: 503 Service Unavailable\nERROR CODE: LockContention\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"LockContention\",\n    \"message\": \"Failed to acquire lock: timed out\",\n    \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*exported.ResponseError | 0xc0015606f0>{
            ErrorCode: "LockContention",
            StatusCode: 503,
            RawResponse: {
                Status: "503 Service Unavailable",
                StatusCode: 503,
                Proto: "HTTP/2.0",
                ProtoMajor: 2,
                ProtoMinor: 0,
                Header: {
                    "X-Ms-Error-Code": ["LockContention"],
                    "X-Ms-Request-Id": [
                        "dc8fa544-ae88-4bc0-a51a-667baaf0a1f5",
                    ],
                    "Date": [
                        "Thu, 26 Feb 2026 11:52:58 GMT",
                    ],
                    "Content-Length": ["186"],
                    "X-Envoy-Upstream-Service-Time": ["10004"],
                    "Server": ["istio-envoy"],
                    "Content-Type": ["application/json"],
                    "Retry-After": ["10"],
                },
                Body: <*exported.nopClosingBytesReader | 0xc000730360>{
                    s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 76, 111, 99, 107, 67, 111, 110, 116, 101, 110, 116, 105, 111, 110, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 70, 97, 105, 108, 101, 100, 32, 116, 111, 32, 97, 99, 113, 117, 105, 114, 101, 32, 108, 111, 99, 107, 58, 32, 116, 105, 109, 101, 100, 32, 111, 117, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 47, 115, 117, 98, 115, 99, 114, 105, 112, 116, 105, 111, 110, 115, 47, 57, 55, 52, 101, 98, 100, 52, 54, 45, 56, 97, 100, 51, 45, 52, 49, 101, 51, 45, 97, 102, 101, 102, 45, 55, 101, 102, 50, 53, 102, 100, 53, 99, 51, 55, 49, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                    i: 0,
                },
                ContentLength: 186,
                TransferEncoding: nil,
                Close: false,
                Uncompressed: false,
                Trailer: nil,
                Request: {
                    Method: "POST",
                    URL: {
                        Scheme: "https",
                        Opaque: "",
                        User: nil,
                        Host: "rp.j4896896.hcpsvc.osadev.cloud",
                        Path: "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/basic-cluster-4r59dj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster/requestAdminCredential",
                        RawPath: "",
                        OmitHost: false,
                        ForceQuery: false,
                        RawQuery: "api-version=2024-06-10-preview",
                        Fragment: "",
                        RawFragment: "",
                    },
                    Proto: "HTTP/1.1",
                    ProtoMajor: 1,
                    ProtoMinor: 1,
                    Header: {
                        "User-Agent": [
                            "azsdk-go-armredhatopenshifthcp/v0.1.0 (go1.25.7; linux)",
                        ],
                        "X-Ms-Arm-Resource-System-Data": [
          ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 2ae66e5
 n/a e2e failed ★#4225 (closed) 17
e2e (17)
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc001016ba0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-7wmdlf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-7wmdlf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000ddea60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf",
            },
            <*fmt.wrapErrors | 0xc001016b70>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-7wmdlf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000ddea60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:100]: Unexpected error:
    <*fmt.wrapErrors | 0xc001016ba0>: 
    failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: failed waiting for cluster="pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-7wmdlf" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster pullsecret-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-7wmdlf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000ddea60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf",
            },
            <*fmt.wrapErrors | 0xc001016b70>{
                msg: "failed waiting for cluster=\"pullsecret-hcp-cluster\" in resourcegroup=\"pullsecret-test-7wmdlf\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000ddea60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster pullsecret-hcp-cluster in resource group pullsecret-test-7wmdlf",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Interrupted by User
10:27:33 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.19 · suite rp-api-compat-all/parallel
Show raw failure
fail [:0]: Interrupted by User
fail [:0]: Interrupted by User
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009bc600>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-mrcfvp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-mrcfvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0016be400>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp",
            },
            <*fmt.wrapErrors | 0xc0009bc5d0>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-mrcfvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0016be400>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:83]: Unexpected error:
    <*fmt.wrapErrors | 0xc0009bc600>: 
    failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-mrcfvp" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-autoscale-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-mrcfvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0016be400>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp",
            },
            <*fmt.wrapErrors | 0xc0009bc5d0>{
                msg: "failed waiting for cluster=\"np-autoscale-cluster\" in resourcegroup=\"np-autoscaling-mrcfvp\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0016be400>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-autoscale-cluster in resource group np-autoscaling-mrcfvp",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to list HCP clusters without node pools at both subscription and resource group levels · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fe4720>: 
    failed to create HCP cluster list-test-cluster-llxr82, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: failed waiting for cluster="list-test-cluster-llxr82" in resourcegroup="cluster-listing-qhbgh2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-llxr82, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: failed waiting for cluster=\"list-test-cluster-llxr82\" in resourcegroup=\"cluster-listing-qhbgh2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00113a720>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2",
            },
            <*fmt.wrapErrors | 0xc000fe46f0>{
                msg: "failed waiting for cluster=\"list-test-cluster-llxr82\" in resourcegroup=\"cluster-listing-qhbgh2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00113a720>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fe4720>: 
    failed to create HCP cluster list-test-cluster-llxr82, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: failed waiting for cluster="list-test-cluster-llxr82" in resourcegroup="cluster-listing-qhbgh2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-llxr82, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: failed waiting for cluster=\"list-test-cluster-llxr82\" in resourcegroup=\"cluster-listing-qhbgh2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00113a720>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2",
            },
            <*fmt.wrapErrors | 0xc000fe46f0>{
                msg: "failed waiting for cluster=\"list-test-cluster-llxr82\" in resourcegroup=\"cluster-listing-qhbgh2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00113a720>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-llxr82 in resource group cluster-listing-qhbgh2",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Interrupted by User
10:27:33 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35]: Interrupted by User
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:35]: Interrupted by User
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc000f5e6f0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-kqgwvn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kqgwvn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000de1980>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn",
            },
            <*fmt.wrapErrors | 0xc000f5e6c0>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kqgwvn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000de1980>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapErrors | 0xc000f5e6f0>: 
    failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-kqgwvn" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kqgwvn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000de1980>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn",
            },
            <*fmt.wrapErrors | 0xc000f5e6c0>{
                msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-kqgwvn\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000de1980>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-cluster in resource group external-auth-cluster-kqgwvn",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d6ee10>: 
    failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-wx7qgt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wx7qgt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0014fefe0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt",
            },
            <*fmt.wrapErrors | 0xc000d6ede0>{
                msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wx7qgt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0014fefe0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:90]: Unexpected error:
    <*fmt.wrapErrors | 0xc000d6ee10>: 
    failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: failed waiting for cluster="basic-hcp-cluster" in resourcegroup="basic-cluster-wx7qgt" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wx7qgt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0014fefe0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt",
            },
            <*fmt.wrapErrors | 0xc000d6ede0>{
                msg: "failed waiting for cluster=\"basic-hcp-cluster\" in resourcegroup=\"basic-cluster-wx7qgt\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0014fefe0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-hcp-cluster in resource group basic-cluster-wx7qgt",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fbf410>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-g4fk95" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-g4fk95\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0009e3d10>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95",
            },
            <*fmt.wrapErrors | 0xc000fbf3e0>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-g4fk95\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0009e3d10>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:166]: Unexpected error:
    <*fmt.wrapErrors | 0xc000fbf410>: 
    failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: failed waiting for cluster="node-limit-cluster" in resourcegroup="node-limit-test-g4fk95" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster node-limit-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-g4fk95\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0009e3d10>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95",
            },
            <*fmt.wrapErrors | 0xc000fbf3e0>{
                msg: "failed waiting for cluster=\"node-limit-cluster\" in resourcegroup=\"node-limit-test-g4fk95\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0009e3d10>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster node-limit-cluster in resource group node-limit-test-g4fk95",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Cluster should become ready within 45 minutes
10:27:33 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:158]: Timed out after 2700.001s.
Cluster should become ready within 45 minutes
Expected
    <bool>: false
to be true
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc001480630>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-pf2qnr" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pf2qnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d71d60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr",
            },
            <*fmt.wrapErrors | 0xc001480600>{
                msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pf2qnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000d71d60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:106]: Unexpected error:
    <*fmt.wrapErrors | 0xc001480630>: 
    failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: failed waiting for cluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-pf2qnr" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster basic-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pf2qnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000d71d60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr",
            },
            <*fmt.wrapErrors | 0xc001480600>{
                msg: "failed waiting for cluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-pf2qnr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000d71d60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster basic-cluster in resource group rg-cluster-nsg-subnet-reuse-pf2qnr",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
    <*fmt.wrapErrors | 0xc001126b70>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-bxxtl2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-bxxtl2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001014770>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2",
            },
            <*fmt.wrapErrors | 0xc001126b40>{
                msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-bxxtl2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001014770>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:97]: Unexpected error:
    <*fmt.wrapErrors | 0xc001126b70>: 
    failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: failed waiting for cluster="autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-bxxtl2" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster autoscaling-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-bxxtl2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001014770>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2",
            },
            <*fmt.wrapErrors | 0xc001126b40>{
                msg: "failed waiting for cluster=\"autoscaling-hcp-cluster\" in resourcegroup=\"autoscaling-cluster-bxxtl2\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001014770>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster autoscaling-hcp-cluster in resource group autoscaling-cluster-bxxtl2",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to update nodepool replicas and autoscaling · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
    <*fmt.wrapErrors | 0xc00061c630>: 
    failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-stt5wc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-stt5wc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00178a1f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc",
            },
            <*fmt.wrapErrors | 0xc00061c600>{
                msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-stt5wc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00178a1f0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_update_nodes.go:82]: Unexpected error:
    <*fmt.wrapErrors | 0xc00061c630>: 
    failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: failed waiting for cluster="np-update-nodes-hcp-cluster" in resourcegroup="nodepool-update-nodes-stt5wc" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster np-update-nodes-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-stt5wc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00178a1f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc",
            },
            <*fmt.wrapErrors | 0xc00061c600>{
                msg: "failed waiting for cluster=\"np-update-nodes-hcp-cluster\" in resourcegroup=\"nodepool-update-nodes-stt5wc\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00178a1f0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster np-update-nodes-hcp-cluster in resource group nodepool-update-nodes-stt5wc",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Deserializaion Error: no output from command
10:27:33 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite rp-api-compat-all/parallel
Show raw failure
> github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7fcb8c4e3c60, 0xc000a522d0})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
                | 
                | By("waiting for first cluster to complete creation")
                > _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
                | 	Frequency: framework.StandardPollInterval,
                | })
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8076598?, 0xc000a522d0?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 81
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 02/26/26 13:06:10.725
  "ts"="2026-02-26 13:06:10.726178" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-26 13:06:10.726334" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-554r9z" "resourceGroup"="customer-rg-fjtg4k"
  "ts"="2026-02-26 13:06:11.785997" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-554r9z" "resourceGroup"=""
  "ts"="2026-02-26 13:06:12.255638" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-24sj2m" "resourceGroup"="customer-rg-fjtg4k"
  "ts"="2026-02-26 13:06:12.424837" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-24sj2m" "resourceGroup"=""
  "ts"="2026-02-26 13:06:13.044924" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 13:06:13.045170" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 13:06:13.045383" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-26 13:06:13.047759" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-fjtg4k"
  "ts"="2026-02-26 13:06:13.048019" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-172"
  "ts"="2026-02-26 13:06:13.049425" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-122"
  "ts"="2026-02-26 13:06:13.046916" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-140"
  "ts"="2026-02-26 13:06:13.826491" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
  "ts"="2026-02-26 13:06:14.512930" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-172" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 13:06:15.252506" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-122" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 13:06:15.869704" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-140" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 13:06:16.440683" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="customer-infra-basic-hcp-cluster2-24sj2m"
  "ts"="2026-02-26 13:06:17.111713" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-172" "deployment"="msi-deployment-172"
  "ts"="2026-02-26 13:06:17.695672" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-122" "deployment"="msi-deployment-122"
  "ts"="2026-02-26 13:06:18.412782" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-140" "deployment"="msi-deployment-140"
  "ts"="2026-02-26 13:06:19.013534" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
  "ts"="2026-02-26 13:06:21.506054" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="customer-infra-basic-hcp-cluster-554r9z"
  "ts"="2026-02-26 13:06:22.253168" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-26 13:06:22.253431" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-26 13:06:22.253617" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-fjtg4k"
Command Error: signal: killed
Deserializaion Error: no output from command
> github.com/Azure/ARO-HCP/test/e2e.init.func15.2({0x7fcb8c4e3c60, 0xc000a522d0})
              /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:126
                | 
                | By("waiting for first cluster to complete creation")
                > _, err = poller1.PollUntilDone(ctx, &runtime.PollUntilDoneOptions{
                | 	Frequency: framework.StandardPollInterval,
                | })
            github.com/onsi/ginkgo/v2/internal.extractBodyFunction.func2({0x8076598?, 0xc000a522d0?})
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/node.go:465
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode.func3()
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:901
            github.com/onsi/ginkgo/v2/internal.(*Suite).runNode in goroutine 81
              /go/pkg/mod/github.com/openshift/onsi-ginkgo/v2@v2.6.1-0.20250416174521-4eb003743b54/internal/suite.go:888
    ------------------------------
    [FAILED] in [It] - /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:129 @ 02/26/26 13:06:10.725
  "ts"="2026-02-26 13:06:10.726178" "level"=0 "msg"="Commiting timing metadata."
  "ts"="2026-02-26 13:06:10.726334" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster-554r9z" "resourceGroup"="customer-rg-fjtg4k"
  "ts"="2026-02-26 13:06:11.785997" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster-554r9z" "resourceGroup"=""
  "ts"="2026-02-26 13:06:12.255638" "level"=0 "msg"="Dumping deployment operations." "deployment"="customer-infra-basic-hcp-cluster2-24sj2m" "resourceGroup"="customer-rg-fjtg4k"
  "ts"="2026-02-26 13:06:12.424837" "level"=0 "msg"="Dumping deployment operations." "deployment"="mi-basic-hcp-cluster2-24sj2m" "resourceGroup"=""
  "ts"="2026-02-26 13:06:13.044924" "level"=0 "msg"="Wrote timing metadata" "path"="/tmp/secret/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 13:06:13.045170" "level"=0 "msg"="Wrote timing metadata" "path"="/logs/artifacts/test-timing/timing-metadata-b8ed2189eb62b4145bd17832fa47015d3fc1ad56caa60a743b61b98540ac41f3.yaml.gz"
  "ts"="2026-02-26 13:06:13.045383" "level"=0 "msg"="collecting debug info"
  "ts"="2026-02-26 13:06:13.047759" "level"=0 "msg"="collecting deployments" "resourceGroup"="customer-rg-fjtg4k"
  "ts"="2026-02-26 13:06:13.048019" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-172"
  "ts"="2026-02-26 13:06:13.049425" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-122"
  "ts"="2026-02-26 13:06:13.046916" "level"=0 "msg"="collecting deployments" "resourceGroup"="aro-hcp-test-msi-containers-dev-140"
  "ts"="2026-02-26 13:06:13.826491" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="pooledNonMsiScopedAssignments-mooiin3edme32"
  "ts"="2026-02-26 13:06:14.512930" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-172" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 13:06:15.252506" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-122" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 13:06:15.869704" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-140" "deployment"="pooledMsiScopedAssignments"
  "ts"="2026-02-26 13:06:16.440683" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="customer-infra-basic-hcp-cluster2-24sj2m"
  "ts"="2026-02-26 13:06:17.111713" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-172" "deployment"="msi-deployment-172"
  "ts"="2026-02-26 13:06:17.695672" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-122" "deployment"="msi-deployment-122"
  "ts"="2026-02-26 13:06:18.412782" "level"=0 "msg"="collecting operations" "resourceGroup"="aro-hcp-test-msi-containers-dev-140" "deployment"="msi-deployment-140"
  "ts"="2026-02-26 13:06:19.013534" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="pooledNonMsiScopedAssignments-eqbgltuyzhpg4"
  "ts"="2026-02-26 13:06:21.506054" "level"=0 "msg"="collecting operations" "resourceGroup"="customer-rg-fjtg4k" "deployment"="customer-infra-basic-hcp-cluster-554r9z"
  "ts"="2026-02-26 13:06:22.253168" "level"=0 "msg"="finished collecting debug info"
  "ts"="2026-02-26 13:06:22.253431" "level"=0 "msg"="deleting created resources"
  "ts"="2026-02-26 13:06:22.253617" "level"=0 "msg"="deleting all hcp clusters in resource group" "resourceGroup"="customer-rg-fjtg4k"
Command Error: signal: killed
Deserializaion Error: no output from command
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc001124f00>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-vqzb76" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-vqzb76\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0012a6280>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76",
            },
            <*fmt.wrapErrors | 0xc001124ed0>{
                msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-vqzb76\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0012a6280>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:160]: Unexpected error:
    <*fmt.wrapErrors | 0xc001124f00>: 
    failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: failed waiting for cluster="patch-tags-cluster" in resourcegroup="patch-tags-vqzb76" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster patch-tags-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-vqzb76\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0012a6280>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76",
            },
            <*fmt.wrapErrors | 0xc001124ed0>{
                msg: "failed waiting for cluster=\"patch-tags-cluster\" in resourcegroup=\"patch-tags-vqzb76\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc0012a6280>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster patch-tags-cluster in resource group patch-tags-vqzb76",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc0007983c0>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-qmkdkx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-qmkdkx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001045190>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx",
            },
            <*fmt.wrapErrors | 0xc000798390>{
                msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-qmkdkx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001045190>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:133]: Unexpected error:
    <*fmt.wrapErrors | 0xc0007983c0>: 
    failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: failed waiting for cluster="cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-qmkdkx" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster cidr-connectivity-test, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-qmkdkx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc001045190>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx",
            },
            <*fmt.wrapErrors | 0xc000798390>{
                msg: "failed waiting for cluster=\"cidr-connectivity-test\" in resourcegroup=\"e2e-cidr-connectivity-qmkdkx\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc001045190>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-qmkdkx",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc001518f30>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-w4ksp4" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-w4ksp4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00101ff20>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4",
            },
            <*fmt.wrapErrors | 0xc001518f00>{
                msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-w4ksp4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00101ff20>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: Unexpected error:
    <*fmt.wrapErrors | 0xc001518f30>: 
    failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: failed waiting for cluster="disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-w4ksp4" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster disabled-image-registry-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-w4ksp4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00101ff20>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4",
            },
            <*fmt.wrapErrors | 0xc001518f00>{
                msg: "failed waiting for cluster=\"disabled-image-registry-hcp-cluster\" in resourcegroup=\"disabled-image-registry-w4ksp4\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc00101ff20>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster disabled-image-registry-hcp-cluster in resource group disabled-image-registry-w4ksp4",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
10:27:33 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc000eaeba0>: 
    failed to create HCP cluster ea-listqfwr9c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: failed waiting for cluster="ea-listqfwr9c" in resourcegroup="ea-list-m66mhv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-listqfwr9c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: failed waiting for cluster=\"ea-listqfwr9c\" in resourcegroup=\"ea-list-m66mhv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000b77550>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv",
            },
            <*fmt.wrapErrors | 0xc000eaeb70>{
                msg: "failed waiting for cluster=\"ea-listqfwr9c\" in resourcegroup=\"ea-list-m66mhv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000b77550>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:84]: Unexpected error:
    <*fmt.wrapErrors | 0xc000eaeba0>: 
    failed to create HCP cluster ea-listqfwr9c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: failed waiting for cluster="ea-listqfwr9c" in resourcegroup="ea-list-m66mhv" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster ea-listqfwr9c, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: failed waiting for cluster=\"ea-listqfwr9c\" in resourcegroup=\"ea-list-m66mhv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000b77550>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv",
            },
            <*fmt.wrapErrors | 0xc000eaeb70>{
                msg: "failed waiting for cluster=\"ea-listqfwr9c\" in resourcegroup=\"ea-list-m66mhv\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000b77550>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster ea-listqfwr9c in resource group ea-list-m66mhv",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head c8160d3
 n/a unknown failed #4208 (closed) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 9177bd9 · merge 9177bd9
 n/a n/a passed #4222 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 3ca804d · merge 3ca804d
 n/a n/a passed #3679 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 35894b0
 n/a provision failed ⚠#4223 (closed) 1
provision (1)
ERROR CODE: DeploymentFailed; detail code BadRequest; detail message Resources should be in the same region. Resource '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.ContainerService/managedClusters/prow-j5647744-mgmt-1' is in region 'westus3' and resource '/subscriptions/<subscription>/resourcegroups/<resource-group>/providers/Microsoft.EventHub/namespaces/hcp-dev-us-eh' is in region 'eastus2'."\\\ \\ }; provider Microsoft.EventHub
07:41:05 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.Management.Infra/management/cluster · suite step graph
Show raw failure
time=2026-02-26T08:11:49.144Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster description="Step cluster\n  Kind: ARM\n  Template: templates/mgmt-cluster.bicep\n  Parameters: configurations/mgmt-cluster.tmpl.bicepparam"
time=2026-02-26T08:11:49.840Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster
time=2026-02-26T08:11:51.159Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster deployment=476cb1d61701423f45b76d3170e7f8c698b389a17cee3febfd45563b3d1d1ced
time=2026-02-26T08:21:24.238Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j5647744-mgmt-1/providers/Microsoft.Resources/deployments/476cb1d61701423f45b76d3170e7f8c698b389a17cee3febfd45563b3d1d1ced/operationStatuses/08584295133750695708\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j5647744-mgmt-1/providers/Microsoft.Resources/deployments/aks-diagnostic-setting\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"BadRequest\\\",\\r\\n            \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j5647744-mgmt-1/providers/Microsoft.ContainerService/managedClusters/prow-j5647744-mgmt-1/providers/Microsoft.Insights/diagnosticSettings/aks-audit-logs\\\",\\r\\n            \\\"message\\\": \\\"{\\\\r\\\\n  \\\\\\\"code\\\\\\\": \\\\\\\"BadRequest\\\\\\\",\\\\r\\\\n  \\\\\\\"message\\\\\\\": \\\\\\\"Resources should be in the same region. Resource '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j5647744-mgmt-1/providers/Microsoft.ContainerService/managedClusters/prow-j5647744-mgmt-1' is in region 'westus3' and resource '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-kusto-us/providers/Microsoft.EventHub/namespaces/hcp-dev-us-eh' is in region 'eastus2'.\\\\\\\"\\\\r\\\\n}\\\"\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 09aa40c · merge 97dcd34
 n/a provision failed ⚠#4128 (merged) 1
provision (1)
unable to build kubernetes objects from release manifest: resource mapping not found for name: "aro-hcp-exporter" namespace: "aro-hcp-exporter" from "": no matches for kind "ServiceMonitor" in version "monitoring.coreos.com/v1" ensure CRDs are installed first
07:38:26 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.Service.Infra/service/aro-hcp-exporter · suite step graph
Show raw failure
time=2026-02-26T08:25:51.606Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter description="Step aro-hcp-exporter\n Kind: Helm\n"
time=2026-02-26T08:25:52.342Z level=INFO msg="Resolved input values." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter values="map[cacheTTL:60m collectionInterval:2m deployment:map[name:aro-hcp-exporter] enabledCollectors:[service-tag-usage] image:map[digest:sha256:b138301009f792415bbd9283194d5142126db46886f3dd7ecd6f6ba855e53c18 registry:arohcpsvcdev.azurecr.io repository:arohcpmetrics] listenAddress::8080 service:map[name:aro-hcp-exporter] serviceAccount:map[create:true msiClientId:901057f4-b5dc-4730-b552-4c66e66fe060 name:aro-hcp-exporter] subscriptionNames:[XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX]]"
time=2026-02-26T08:25:52.342Z level=INFO msg="Applying namespaces." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter
time=2026-02-26T08:25:52.724Z level=INFO msg="Namespace applied successfully." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter namespace=aro-hcp-exporter
time=2026-02-26T08:25:52.725Z level=INFO msg="Rolling out Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter dryRun=false
time=2026-02-26T08:25:52.725Z level=INFO msg="Searching for release history..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter
time=2026-02-26T08:25:53.130Z level=INFO msg="No release history found, running the first release..." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter
time=2026-02-26T08:25:54.571Z level=ERROR msg="Failed to roll out the Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter err="unable to build kubernetes objects from release manifest: resource mapping not found for name: \"aro-hcp-exporter\" namespace: \"aro-hcp-exporter\" from \"\": no matches for kind \"ServiceMonitor\" in version \"monitoring.coreos.com/v1\"\nensure CRDs are installed first"
time=2026-02-26T08:25:54.571Z level=INFO msg="Finished deploying Helm release." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter
time=2026-02-26T08:25:54.571Z level=INFO msg="Running inline diagnostics." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter
time=2026-02-26T08:25:54.696Z level=ERROR msg="Failed to capture diagnostics for Helm release" serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter err="failed to get status for release aro-hcp-exporter: release: not found"
time=2026-02-26T08:25:54.696Z level=INFO msg="Deployment complete." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter
time=2026-02-26T08:25:54.697Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Service.Infra resourceGroup=service step=aro-hcp-exporter err="error running Helm release deployment Step, failed to deploy helm release: unable to build kubernetes objects from release manifest: resource mapping not found for name: \"aro-hcp-exporter\" namespace: \"aro-hcp-exporter\" from \"\": no matches for kind \"ServiceMonitor\" in version \"monitoring.coreos.com/v1\"\nensure CRDs are installed first"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 9e3436b · merge 9177bd9
 n/a unknown failed #4222 (merged) 1 non-artifact-backed failure (no junit artifacts)
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 551e259 · merge 551e259
 n/a e2e failed ★#4212 (merged) 1
e2e (1)
failed to create route: the server is currently unable to handle the request
06:20:39 UTC · failed at e2e · test Customer should be able to create an HCP cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
    <*fmt.wrapError | 0xc000c218e0>: 
    failed to create route: the server is currently unable to handle the request
    {
        msg: "failed to create route: the server is currently unable to handle the request",
        err: <*errors.StatusError | 0xc00134f040>{
            ErrStatus: {
                TypeMeta: {Kind: "", APIVersion: ""},
                ListMeta: {
                    SelfLink: "",
                    ResourceVersion: "",
                    Continue: "",
                    RemainingItemCount: nil,
                },
                Status: "Failure",
                Message: "the server is currently unable to handle the request",
                Reason: "ServiceUnavailable",
                Details: {
                    Name: "",
                    Group: "",
                    Kind: "",
                    UID: "",
                    Causes: [
                        {
                            Type: "UnexpectedServerResponse",
                            Message: "error trying to reach service: tls: first record does not look like a TLS handshake",
                            Field: "",
                        },
                    ],
                    RetryAfterSeconds: 0,
                },
                Code: 503,
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create.go:131]: Unexpected error:
    <*fmt.wrapError | 0xc000c218e0>: 
    failed to create route: the server is currently unable to handle the request
    {
        msg: "failed to create route: the server is currently unable to handle the request",
        err: <*errors.StatusError | 0xc00134f040>{
            ErrStatus: {
                TypeMeta: {Kind: "", APIVersion: ""},
                ListMeta: {
                    SelfLink: "",
                    ResourceVersion: "",
                    Continue: "",
                    RemainingItemCount: nil,
                },
                Status: "Failure",
                Message: "the server is currently unable to handle the request",
                Reason: "ServiceUnavailable",
                Details: {
                    Name: "",
                    Group: "",
                    Kind: "",
                    UID: "",
                    Causes: [
                        {
                            Type: "UnexpectedServerResponse",
                            Message: "error trying to reach service: tls: first record does not look like a TLS handshake",
                            Field: "",
                        },
                    ],
                    RetryAfterSeconds: 0,
                },
                Code: 503,
            },
        },
    }
occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 3ca804d · merge 3ca804d
 n/a n/a passed #3679 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 66b441c · merge 66b441c
 n/a n/a passed #3956 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
batch
head 66b441c · merge 66b441c
 n/a provision failed ★#3956 (merged) 1
provision (1)
ERROR CODE: DeploymentFailed; detail code OperationNotAllowed; detail message Operation is not allowed because there's an in progress upgrade managed cluster operation (operation ID: <uuid>) on the managed cluster started on UTC <timestamp>.; provider Microsoft.ContainerService
04:24:13 UTC · failed at provision · test Run pipeline step Microsoft.Azure.ARO.HCP.Management.Infra/management/cluster · suite step graph
Show raw failure
time=2026-02-26T04:53:17.598Z level=INFO msg="Running step." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster description="Step cluster\n  Kind: ARM\n  Template: templates/mgmt-cluster.bicep\n  Parameters: configurations/mgmt-cluster.tmpl.bicepparam"
time=2026-02-26T04:53:18.391Z level=DEBUG+2 msg="Starting ARM deployment" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster
time=2026-02-26T04:53:19.792Z level=DEBUG+3 msg="Deployment started" serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster deployment=1a2b2df63d329fd750de1093dc1e6e42a28fcc94f1bbd1233db2cb80ac726218
time=2026-02-26T05:07:53.714Z level=ERROR msg="Step errored." serviceGroup=Microsoft.Azure.ARO.HCP.Management.Infra resourceGroup=management step=cluster err="failed to run ARM step: failed to poll deployment: failed to wait for deployment completion: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourcegroups/hcp-underlay-prow-j1283968-mgmt-1/providers/Microsoft.Resources/deployments/1a2b2df63d329fd750de1093dc1e6e42a28fcc94f1bbd1233db2cb80ac726218/operationStatuses/08584295252865036397\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: DeploymentFailed\n--------------------------------------------------------------------------------\n{\n  \"status\": \"Failed\",\n  \"error\": {\n    \"code\": \"DeploymentFailed\",\n    \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\n    \"details\": [\n      {\n        \"code\": \"Conflict\",\n        \"message\": \"{\\r\\n  \\\"status\\\": \\\"Failed\\\",\\r\\n  \\\"error\\\": {\\r\\n    \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n    \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n    \\\"details\\\": [\\r\\n      {\\r\\n        \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n        \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j1283968-mgmt-1/providers/Microsoft.Resources/deployments/cluster-zanamtwfjijog\\\",\\r\\n        \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n        \\\"details\\\": [\\r\\n          {\\r\\n            \\\"code\\\": \\\"ResourceDeploymentFailure\\\",\\r\\n            \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j1283968-mgmt-1/providers/Microsoft.Resources/deployments/user-agent-pools\\\",\\r\\n            \\\"message\\\": \\\"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\\\",\\r\\n            \\\"details\\\": [\\r\\n              {\\r\\n                \\\"code\\\": \\\"DeploymentFailed\\\",\\r\\n                \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j1283968-mgmt-1/providers/Microsoft.Resources/deployments/user-agent-pools\\\",\\r\\n                \\\"message\\\": \\\"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\\\",\\r\\n                \\\"details\\\": [\\r\\n                  {\\r\\n                    \\\"code\\\": \\\"Conflict\\\",\\r\\n                    \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j1283968-mgmt-1/providers/Microsoft.ContainerService/managedClusters/prow-j1283968-mgmt-1/agentPools/user3\\\",\\r\\n                    \\\"message\\\": \\\"{\\\\r\\\\n  \\\\\\\"code\\\\\\\": \\\\\\\"OperationNotAllowed\\\\\\\",\\\\r\\\\n  \\\\\\\"details\\\\\\\": null,\\\\r\\\\n  \\\\\\\"message\\\\\\\": \\\\\\\"Operation is not allowed because there's an in progress upgrade managed cluster operation (operation ID: bbca5fb5-9d62-4574-9d97-394497a22428) on the managed cluster started on UTC 2026-02-26T05:04:52Z. Please wait for it to finish before starting a new operation. You can also use 'az aks operation-abort ...' to abort the ongoing operation.\\\\\\\",\\\\r\\\\n  \\\\\\\"subcode\\\\\\\": \\\\\\\"\\\\\\\"\\\\r\\\\n}\\\"\\r\\n                  },\\r\\n                  {\\r\\n                    \\\"code\\\": \\\"Conflict\\\",\\r\\n                    \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j1283968-mgmt-1/providers/Microsoft.ContainerService/managedClusters/prow-j1283968-mgmt-1/agentPools/user2\\\",\\r\\n                    \\\"message\\\": \\\"{\\\\r\\\\n  \\\\\\\"code\\\\\\\": \\\\\\\"OperationNotAllowed\\\\\\\",\\\\r\\\\n  \\\\\\\"details\\\\\\\": null,\\\\r\\\\n  \\\\\\\"message\\\\\\\": \\\\\\\"Operation is not allowed because there's an in progress upgrade managed cluster operation (operation ID: bbca5fb5-9d62-4574-9d97-394497a22428) on the managed cluster started on UTC 2026-02-26T05:04:52Z. Please wait for it to finish before starting a new operation. You can also use 'az aks operation-abort ...' to abort the ongoing operation.\\\\\\\",\\\\r\\\\n  \\\\\\\"subcode\\\\\\\": \\\\\\\"\\\\\\\"\\\\r\\\\n}\\\"\\r\\n                  },\\r\\n                  {\\r\\n                    \\\"code\\\": \\\"Conflict\\\",\\r\\n                    \\\"target\\\": \\\"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/hcp-underlay-prow-j1283968-mgmt-1/providers/Microsoft.ContainerService/managedClusters/prow-j1283968-mgmt-1/agentPools/user1\\\",\\r\\n                    \\\"message\\\": \\\"{\\\\r\\\\n  \\\\\\\"code\\\\\\\": \\\\\\\"OperationNotAllowed\\\\\\\",\\\\r\\\\n  \\\\\\\"details\\\\\\\": null,\\\\r\\\\n  \\\\\\\"message\\\\\\\": \\\\\\\"Operation is not allowed because there's an in progress upgrade managed cluster operation (operation ID: bbca5fb5-9d62-4574-9d97-394497a22428) on the managed cluster started on UTC 2026-02-26T05:04:52Z. Please wait for it to finish before starting a new operation. You can also use 'az aks operation-abort ...' to abort the ongoing operation.\\\\\\\",\\\\r\\\\n  \\\\\\\"subcode\\\\\\\": \\\\\\\"\\\\\\\"\\\\r\\\\n}\\\"\\r\\n                  }\\r\\n                ]\\r\\n              }\\r\\n            ]\\r\\n          }\\r\\n        ]\\r\\n      }\\r\\n    ]\\r\\n  }\\r\\n}\"\n      }\n    ]\n  }\n}\n--------------------------------------------------------------------------------\n"
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 551e259 · merge 551e259
 n/a n/a passed #4212 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head a02b279 · merge a02b279
 n/a n/a passed #4207 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
post-goodmerged PR
head 096bc31 · merge 096bc31
 n/a e2e failed ★#4213 (merged) 1
e2e (1)
ERROR CODE: InternalServerError; detail code AuthorizationPermissionMismatch; provider Microsoft.RedHatOpenShift
01:01:23 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapError | 0xc000a166c0>: 
    failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-7mwptw" to finish creating: GET https://rp.j8670592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248",
      "name": "34cf1182-0561-47e6-a596-52cca686f248",
      "status": "Failed",
      "startTime": "2026-02-26T01:56:59.133998051Z",
      "endTime": "2026-02-26T01:59:27.238045379Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://arohcpprowoidcj8670592.blob.core.windows.net/$web\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\nERROR CODE: AuthorizationPermissionMismatch\n--------------------------------------------------------------------------------\n\u003c?xml version=\"1.0\" encoding=\"utf-8\"?\u003e\u003cError\u003e\u003cCode\u003eAuthorizationPermissionMismatch\u003c/Code\u003e\u003cMessage\u003eThis request is not authorized to perform this operation using this permission.\nRequestId:06cbcb17-201e-003e-2cc3-a65ee2000000\nTime:2026-02-26T01:59:04.2086279Z\u003c/Message\u003e\u003c/Error\u003e\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-7mwptw\" to finish creating: GET https://rp.j8670592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\",\n  \"name\": \"34cf1182-0561-47e6-a596-52cca686f248\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T01:56:59.133998051Z\",\n  \"endTime\": \"2026-02-26T01:59:27.238045379Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj8670592.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:06cbcb17-201e-003e-2cc3-a65ee2000000\\nTime:2026-02-26T01:59:04.2086279Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc000a166a0>{
            msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-7mwptw\" to finish creating: GET https://rp.j8670592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\",\n  \"name\": \"34cf1182-0561-47e6-a596-52cca686f248\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T01:56:59.133998051Z\",\n  \"endTime\": \"2026-02-26T01:59:27.238045379Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj8670592.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:06cbcb17-201e-003e-2cc3-a65ee2000000\\nTime:2026-02-26T01:59:04.2086279Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapError | 0xc000a166c0>: 
    failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-7mwptw" to finish creating: GET https://rp.j8670592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248",
      "name": "34cf1182-0561-47e6-a596-52cca686f248",
      "status": "Failed",
      "startTime": "2026-02-26T01:56:59.133998051Z",
      "endTime": "2026-02-26T01:59:27.238045379Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://arohcpprowoidcj8670592.blob.core.windows.net/$web\n--------------------------------------------------------------------------------\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\nERROR CODE: AuthorizationPermissionMismatch\n--------------------------------------------------------------------------------\n\u003c?xml version=\"1.0\" encoding=\"utf-8\"?\u003e\u003cError\u003e\u003cCode\u003eAuthorizationPermissionMismatch\u003c/Code\u003e\u003cMessage\u003eThis request is not authorized to perform this operation using this permission.\nRequestId:06cbcb17-201e-003e-2cc3-a65ee2000000\nTime:2026-02-26T01:59:04.2086279Z\u003c/Message\u003e\u003c/Error\u003e\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-7mwptw\" to finish creating: GET https://rp.j8670592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\",\n  \"name\": \"34cf1182-0561-47e6-a596-52cca686f248\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T01:56:59.133998051Z\",\n  \"endTime\": \"2026-02-26T01:59:27.238045379Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj8670592.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:06cbcb17-201e-003e-2cc3-a65ee2000000\\nTime:2026-02-26T01:59:04.2086279Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc000a166a0>{
            msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-7mwptw\" to finish creating: GET https://rp.j8670592.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/34cf1182-0561-47e6-a596-52cca686f248\",\n  \"name\": \"34cf1182-0561-47e6-a596-52cca686f248\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-02-26T01:56:59.133998051Z\",\n  \"endTime\": \"2026-02-26T01:59:27.238045379Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://arohcpprowoidcj8670592.blob.core.windows.net/$web\\n--------------------------------------------------------------------------------\\nRESPONSE 403: 403 This request is not authorized to perform this operation using this permission.\\nERROR CODE: AuthorizationPermissionMismatch\\n--------------------------------------------------------------------------------\\n\ufeff\\u003c?xml version=\\\"1.0\\\" encoding=\\\"utf-8\\\"?\\u003e\\u003cError\\u003e\\u003cCode\\u003eAuthorizationPermissionMismatch\\u003c/Code\\u003e\\u003cMessage\\u003eThis request is not authorized to perform this operation using this permission.\\nRequestId:06cbcb17-201e-003e-2cc3-a65ee2000000\\nTime:2026-02-26T01:59:04.2086279Z\\u003c/Message\\u003e\\u003c/Error\\u003e\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
merged PR
head 4af200c · merge 8550ece
 n/a n/a passed #4219 (merged) 0 n/a
n/a pull-ci-Azure-ARO-HCP-main-e2e-parallel
head 9cc1144
 n/a e2e failed ⚠#4217 (closed) 1
e2e (1)
Version .* (doesn't exist|is disabled)
00:03:15 UTC · failed at e2e · test Customer should not be able to create a 4.18 HCP cluster · suite rp-api-compat-all/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
    <*fmt.wrapError | 0xc00131ce00>: 
    failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-6n48lb": PUT https://rp.j2451328.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-6n48lb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.18\": must be at least 4.19",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-6n48lb\": PUT https://rp.j2451328.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-6n48lb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InvalidRequestContent\",\n    \"message\": \"Invalid value: \\\"4.18\\\": must be at least 4.19\",\n    \"target\": \"properties.version.id\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc00131cde0>{
            msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-6n48lb\": PUT https://rp.j2451328.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-6n48lb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InvalidRequestContent\",\n    \"message\": \"Invalid value: \\\"4.18\\\": must be at least 4.19\",\n    \"target\": \"properties.version.id\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc0010fa060>{
                ErrorCode: "InvalidRequestContent",
                StatusCode: 400,
                RawResponse: {
                    Status: "400 Bad Request",
                    StatusCode: 400,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Error-Code": [
                            "InvalidRequestContent",
                        ],
                        "X-Ms-Request-Id": [
                            "ffc6c346-35d4-4618-92bc-a082353413ad",
                        ],
                        "Date": [
                            "Thu, 26 Feb 2026 00:59:17 GMT",
                        ],
                        "Content-Length": ["176"],
                        "X-Envoy-Upstream-Service-Time": ["47"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0xc00131cd20>{
                        s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 118, 97, 108, 105, 100, 82, 101, 113, 117, 101, 115, 116, 67, 111, 110, 116, 101, 110, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 118, 97, 108, 105, 100, 32, 118, 97, 108, 117, 101, 58, 32, 92, 34, 52, 46, 49, 56, 92, 34, 58, 32, 109, 117, 115, 116, 32, 98, 101, 32, 97, 116, 32, 108, 101, 97, 115, 116, 32, 52, 46, 49, 57, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 112, 114, 111, 112, 101, 114, 116, 105, 101, 115, 46, 118, 101, 114, 115, 105, 111, 110, 46, 105, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 176,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Me...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

to match error
    <*matchers.MatchRegexpMatcher | 0xc0010fa0f0>: {
        Regexp: "Version .* (doesn't exist|is disabled)",
        Args: nil,
    }
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_missing_info.go:82]: Expected
    <*fmt.wrapError | 0xc00131ce00>: 
    failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation "illegal-hcp-cluster" in resourcegroup="illegal-ocp-version-6n48lb": PUT https://rp.j2451328.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-6n48lb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidRequestContent
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidRequestContent",
        "message": "Invalid value: \"4.18\": must be at least 4.19",
        "target": "properties.version.id"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster illegal-hcp-cluster: failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-6n48lb\": PUT https://rp.j2451328.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-6n48lb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InvalidRequestContent\",\n    \"message\": \"Invalid value: \\\"4.18\\\": must be at least 4.19\",\n    \"target\": \"properties.version.id\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc00131cde0>{
            msg: "failed starting cluster creation \"illegal-hcp-cluster\" in resourcegroup=\"illegal-ocp-version-6n48lb\": PUT https://rp.j2451328.hcpsvc.osadev.cloud/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/illegal-ocp-version-6n48lb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/illegal-hcp-cluster\n--------------------------------------------------------------------------------\nRESPONSE 400: 400 Bad Request\nERROR CODE: InvalidRequestContent\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"InvalidRequestContent\",\n    \"message\": \"Invalid value: \\\"4.18\\\": must be at least 4.19\",\n    \"target\": \"properties.version.id\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc0010fa060>{
                ErrorCode: "InvalidRequestContent",
                StatusCode: 400,
                RawResponse: {
                    Status: "400 Bad Request",
                    StatusCode: 400,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Error-Code": [
                            "InvalidRequestContent",
                        ],
                        "X-Ms-Request-Id": [
                            "ffc6c346-35d4-4618-92bc-a082353413ad",
                        ],
                        "Date": [
                            "Thu, 26 Feb 2026 00:59:17 GMT",
                        ],
                        "Content-Length": ["176"],
                        "X-Envoy-Upstream-Service-Time": ["47"],
                        "Server": ["istio-envoy"],
                        "Content-Type": ["application/json"],
                    },
                    Body: <*exported.nopClosingBytesReader | 0xc00131cd20>{
                        s: [123, 10, 32, 32, 32, 32, 34, 101, 114, 114, 111, 114, 34, 58, 32, 123, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 99, 111, 100, 101, 34, 58, 32, 34, 73, 110, 118, 97, 108, 105, 100, 82, 101, 113, 117, 101, 115, 116, 67, 111, 110, 116, 101, 110, 116, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 109, 101, 115, 115, 97, 103, 101, 34, 58, 32, 34, 73, 110, 118, 97, 108, 105, 100, 32, 118, 97, 108, 117, 101, 58, 32, 92, 34, 52, 46, 49, 56, 92, 34, 58, 32, 109, 117, 115, 116, 32, 98, 101, 32, 97, 116, 32, 108, 101, 97, 115, 116, 32, 52, 46, 49, 57, 34, 44, 10, 32, 32, 32, 32, 32, 32, 32, 32, 34, 116, 97, 114, 103, 101, 116, 34, 58, 32, 34, 112, 114, 111, 112, 101, 114, 116, 105, 101, 115, 46, 118, 101, 114, 115, 105, 111, 110, 46, 105, 100, 34, 10, 32, 32, 32, 32, 125, 10, 125],
                        i: 0,
                    },
                    ContentLength: 176,
                    TransferEncoding: nil,
                    Close: false,
                    Uncompressed: false,
                    Trailer: nil,
                    Request: {
                        Me...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

to match error
    <*matchers.MatchRegexpMatcher | 0xc0010fa0f0>: {
        Regexp: "Version .* (doesn't exist|is disabled)",
        Args: nil,
    }