CIHealth
<
Single Day: Aug 14▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: PROD

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel-ocp-nightly
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 5
e2e (5)
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:52 UTC · failed at e2e · test Customer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS
Unexpected error:
    <*fmt.wrapErrors | 0xc00150e6f0>: 
    failed to create HCP cluster private-kas, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster private-kas in resource group private-kas-78mmb95dktph, error: failed waiting for cluster="private-kas" in resourcegroup="private-kas-78mmb95dktph" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster private-kas in resource group private-kas-78mmb95dktph, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS
Unexpected error:
    <*fmt.wrapErrors | 0xc00150e6f0>: 
    failed to create HCP cluster private-kas, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster private-kas in resource group private-kas-78mmb95dktph, error: failed waiting for cluster="private-kas" in resourcegroup="private-kas-78mmb95dktph" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster private-kas in resource group private-kas-78mmb95dktph, error: context deadline exceeded
    ...
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
23:00:52 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 5.1 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-nightly-5-1-m6trbc6hm8kc/cluster-nightly-5-1-9mdncv should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc00095f230>: 
    failed to create HCP cluster cluster-nightly-5-1-9mdncv, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-1-9mdncv in resource group rg-nightly-5-1-m6trbc6hm8kc, error: failed waiting for cluster="cluster-nightly-5-1-9mdncv" in resourcegroup="rg-nightly-5-1-m6trbc6hm8kc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-1-9mdncv in resource group rg-nightly-5-1-m6trbc6hm8kc, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-nightly-5-1-m6trbc6hm8kc/cluster-nightly-5-1-9mdncv should provision
Unexpected error:
    <*fmt.wrapErrors | 0xc00095f230>: 
    failed to create HCP cluster cluster-nightly-5-1-9mdncv, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-1-9mdncv in resource group rg-nightly-5-1-m6trbc6hm8kc, error: failed waiting for cluster="cluster-nightly-5-1-9mdncv" in resourcegroup="rg-nightly-5-1-m6trbc6hm8kc" to finish creating, caused by: timeout '20.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster cluster-nightly-5-1-9mdncv in resource group rg-nightly-5-1-m6trbc6hm8kc, error: context deadline exceeded
    ...
occurred
(wrapped at ) RemoteFailed: Get "<url>": dial tcp: lookup <host> on <dns-server>: read udp <ip>-><ip>: i/o timeout
23:00:52 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.20 minor to 4.21 minor · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:89]: failed to find upgrade targets in minor 4.21.0 for install version 4.20.0
Unexpected error:
    <*utils.LineTrackingError | 0xc000f5bda0>: 
    (wrapped at control_plane_desired_version_controller.go:458) RemoteFailed: Get "https://multi.ocp.releases.ci.openshift.org/graph?arch=multi&channel=nightly-4.21&id=6ba7b810-9dad-11d1-80b4-00c04fd430c8&version=4.20.0": dial tcp: lookup multi.ocp.releases.ci.openshift.org on 172.30.0.10:53: read udp 10.131.210.197:35653->172.30.0.10:53: i/o timeout
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:89]: failed to find upgrade targets in minor 4.21.0 for install version 4.20.0
Unexpected error:
    <*utils.LineTrackingError | 0xc000f5bda0>: 
    (wrapped at control_plane_desired_version_controller.go:458) RemoteFailed: Get "https://multi.ocp.releases.ci.openshift.org/graph?arch=multi&channel=nightly-4.21&id=6ba7b810-9dad-11d1-80b4-00c04fd430c8&version=4.20.0": dial tcp: lookup multi.ocp.releases.ci.openshift.org on 172.30.0.10:53: read udp 10.131.210.197:35653->172.30.0.10:53: i/o timeout
    ...
occurred
VerifyNodesReady failed: can't list nodes in the cluster: Get "<url>": dial tcp: lookup <host> on <dns-server>: read udp <ip>-><ip>: i/o timeout
23:00:52 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:192]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc002400300>: 
    VerifyCiliumOperational failed: failed to get cilium namespace: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/api/v1/namespaces/kube-system": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/apis/apiregistration.k8s.io/v1/apiservices": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    VerifyBasicAccess failed: failed to list services: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/api/v1/namespaces/default/services": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    VerifyNodesReady failed: can't list nodes in the cluster: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/api/v1/nodes": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:192]: failed to verify nodes are Ready with Cilium CNI for cluster "cilium-cluster"
Unexpected error:
    <*errors.joinError | 0xc002400300>: 
    VerifyCiliumOperational failed: failed to get cilium namespace: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/api/v1/namespaces/kube-system": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    VerifyAllAPIServicesAvailable failed: failed to list all APIServices: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/apis/apiregistration.k8s.io/v1/apiservices": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    VerifyBasicAccess failed: failed to list services: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/api/v1/namespaces/default/services": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    VerifyNodesReady failed: can't list nodes in the cluster: Get "https://api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io:443/api/v1/nodes": dial tcp: lookup api.cilium-cluster.f2fj.uksouth.aroapp-hcp.io on 172.30.0.10:53: read udp 10.131.210.197:42819->172.30.0.10:53: i/o timeout
    ...
occurred
VerifyVMOSDiskCustomerEncryption(nodePool=<nodepool>) failed: OS disk encryption verification failed for 2/2 VMs: disk des-encrypt-des-np-w9d2c-bm8tg_OSDisk for VM des-encrypt-des-np-w9d2c-bm8tg has encryption type EncryptionAtRestWithPlatformKey, expected
23:00:52 UTC · failed at e2e · test Nodepool OS Disk Encryption should create a nodepool with customer-managed disk encryption via DES · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_osdisk_encryption.go:163]: cluster verification failed
Unexpected error:
    <*errors.joinError | 0xc000d9adf8>: 
    VerifyVMOSDiskCustomerEncryption(nodePool=des-np) failed: OS disk encryption verification failed for 2/2 VMs: disk des-encrypt-des-np-w9d2c-bm8tg_OSDisk for VM des-encrypt-des-np-w9d2c-bm8tg has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    disk des-encrypt-des-np-w9d2c-djq6l_OSDisk for VM des-encrypt-des-np-w9d2c-djq6l has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_osdisk_encryption.go:163]: cluster verification failed
Unexpected error:
    <*errors.joinError | 0xc000d9adf8>: 
    VerifyVMOSDiskCustomerEncryption(nodePool=des-np) failed: OS disk encryption verification failed for 2/2 VMs: disk des-encrypt-des-np-w9d2c-bm8tg_OSDisk for VM des-encrypt-des-np-w9d2c-bm8tg has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    disk des-encrypt-des-np-w9d2c-djq6l_OSDisk for VM des-encrypt-des-np-w9d2c-djq6l has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    ...
occurred
branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 11
e2e (11)
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test Customer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS
Unexpected error:
    <*fmt.wrapError | 0xc000885b20>: 
    failed to create HCP cluster private-kas: failed waiting for cluster="private-kas" in resourcegroup="private-kas-57plvn4qvpmn" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/36272d57-fc14-4249-a0c9-36ab337c304f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/36272d57-fc14-4249-a0c9-36ab337c304f",
      "name": "36272d57-fc14-4249-a0c9-36ab337c304f",
      "status": "Failed",
      "startTime": "2026-08-14T02:45:02.566197044Z",
      "endTime": "2026-08-14T03:04:11.269044628Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS
Unexpected error:
    <*fmt.wrapError | 0xc000885b20>: 
    failed to create HCP cluster private-kas: failed waiting for cluster="private-kas" in resourcegroup="private-kas-57plvn4qvpmn" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/36272d57-fc14-4249-a0c9-36ab337c304f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/36272d57-fc14-4249-a0c9-36ab337c304f",
      "name": "36272d57-fc14-4249-a0c9-36ab337c304f",
      "status": "Failed",
      "startTime": "2026-08-14T02:45:02.566197044Z",
      "endTime": "2026-08-14T03:04:11.269044628Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [router]; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-candidate-4-22-hndkzs2fvmfl/cluster-candidate-4-22-6t6qsl should provision
Unexpected error:
    <*fmt.wrapError | 0xc0004aed60>: 
    failed to create HCP cluster cluster-candidate-4-22-6t6qsl: failed waiting for cluster="cluster-candidate-4-22-6t6qsl" in resourcegroup="rg-candidate-4-22-hndkzs2fvmfl" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/cc154f54-f074-4deb-840e-e31ead99c2cf
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/cc154f54-f074-4deb-840e-e31ead99c2cf",
      "name": "cc154f54-f074-4deb-840e-e31ead99c2cf",
      "status": "Failed",
      "startTime": "2026-08-14T03:17:23.637851587Z",
      "endTime": "2026-08-14T03:36:32.688237575Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-candidate-4-22-hndkzs2fvmfl/cluster-candidate-4-22-6t6qsl should provision
Unexpected error:
    <*fmt.wrapError | 0xc0004aed60>: 
    failed to create HCP cluster cluster-candidate-4-22-6t6qsl: failed waiting for cluster="cluster-candidate-4-22-6t6qsl" in resourcegroup="rg-candidate-4-22-hndkzs2fvmfl" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/cc154f54-f074-4deb-840e-e31ead99c2cf
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/cc154f54-f074-4deb-840e-e31ead99c2cf",
      "name": "cc154f54-f074-4deb-840e-e31ead99c2cf",
      "status": "Failed",
      "startTime": "2026-08-14T03:17:23.637851587Z",
      "endTime": "2026-08-14T03:36:32.688237575Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [router]; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-candidate-4-21-gw8xvm5qcvv2/cluster-candidate-4-21-pp5hmz should provision
Unexpected error:
    <*fmt.wrapError | 0xc000e194a0>: 
    failed to create HCP cluster cluster-candidate-4-21-pp5hmz: failed waiting for cluster="cluster-candidate-4-21-pp5hmz" in resourcegroup="rg-candidate-4-21-gw8xvm5qcvv2" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/84898c46-00b7-4dd1-a53c-b2ca17b692d9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/84898c46-00b7-4dd1-a53c-b2ca17b692d9",
      "name": "84898c46-00b7-4dd1-a53c-b2ca17b692d9",
      "status": "Failed",
      "startTime": "2026-08-14T03:16:14.161226952Z",
      "endTime": "2026-08-14T03:35:22.643256613Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-candidate-4-21-gw8xvm5qcvv2/cluster-candidate-4-21-pp5hmz should provision
Unexpected error:
    <*fmt.wrapError | 0xc000e194a0>: 
    failed to create HCP cluster cluster-candidate-4-21-pp5hmz: failed waiting for cluster="cluster-candidate-4-21-pp5hmz" in resourcegroup="rg-candidate-4-21-gw8xvm5qcvv2" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/84898c46-00b7-4dd1-a53c-b2ca17b692d9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/84898c46-00b7-4dd1-a53c-b2ca17b692d9",
      "name": "84898c46-00b7-4dd1-a53c-b2ca17b692d9",
      "status": "Failed",
      "startTime": "2026-08-14T03:16:14.161226952Z",
      "endTime": "2026-08-14T03:35:22.643256613Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-candidate-5-0-9j77hrzg8ncp/cluster-candidate-5-0-zmjqkw should provision
Unexpected error:
    <*fmt.wrapError | 0xc000a93080>: 
    failed to create HCP cluster cluster-candidate-5-0-zmjqkw: failed waiting for cluster="cluster-candidate-5-0-zmjqkw" in resourcegroup="rg-candidate-5-0-9j77hrzg8ncp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/3dfd9a55-aee6-412e-8f37-2823b565dbaa
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/3dfd9a55-aee6-412e-8f37-2823b565dbaa",
      "name": "3dfd9a55-aee6-412e-8f37-2823b565dbaa",
      "status": "Failed",
      "startTime": "2026-08-14T03:17:52.205226636Z",
      "endTime": "2026-08-14T03:36:52.523278161Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:107]: HCP cluster rg-candidate-5-0-9j77hrzg8ncp/cluster-candidate-5-0-zmjqkw should provision
Unexpected error:
    <*fmt.wrapError | 0xc000a93080>: 
    failed to create HCP cluster cluster-candidate-5-0-zmjqkw: failed waiting for cluster="cluster-candidate-5-0-zmjqkw" in resourcegroup="rg-candidate-5-0-9j77hrzg8ncp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/3dfd9a55-aee6-412e-8f37-2823b565dbaa
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/3dfd9a55-aee6-412e-8f37-2823b565dbaa",
      "name": "3dfd9a55-aee6-412e-8f37-2823b565dbaa",
      "status": "Failed",
      "startTime": "2026-08-14T03:17:52.205226636Z",
      "endTime": "2026-08-14T03:36:52.523278161Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:133]: failed to create HCP cluster np-version-upgrade-cluster-5rd9rv with version 4.21.28
Unexpected error:
    <*fmt.wrapError | 0xc0004056e0>: 
    failed to create HCP cluster np-version-upgrade-cluster-5rd9rv: failed waiting for cluster="np-version-upgrade-cluster-5rd9rv" in resourcegroup="rg-np-version-upgrade-5rd9rv-l9ghdszlwlsv" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/0e09a54a-837a-4de9-b361-ff6d83501f2b
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/0e09a54a-837a-4de9-b361-ff6d83501f2b",
      "name": "0e09a54a-837a-4de9-b361-ff6d83501f2b",
      "status": "Failed",
      "startTime": "2026-08-14T03:48:47.042378322Z",
      "endTime": "2026-08-14T04:07:53.883454309Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:133]: failed to create HCP cluster np-version-upgrade-cluster-5rd9rv with version 4.21.28
Unexpected error:
    <*fmt.wrapError | 0xc0004056e0>: 
    failed to create HCP cluster np-version-upgrade-cluster-5rd9rv: failed waiting for cluster="np-version-upgrade-cluster-5rd9rv" in resourcegroup="rg-np-version-upgrade-5rd9rv-l9ghdszlwlsv" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/0e09a54a-837a-4de9-b361-ff6d83501f2b
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/0e09a54a-837a-4de9-b361-ff6d83501f2b",
      "name": "0e09a54a-837a-4de9-b361-ff6d83501f2b",
      "status": "Failed",
      "startTime": "2026-08-14T03:48:47.042378322Z",
      "endTime": "2026-08-14T04:07:53.883454309Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
cluster entered terminal Failed state after role assignment deployment
02:16:33 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:220]: Timed out after 2520.004s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:216 with:
cluster entered terminal Failed state after role assignment deployment
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
not to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:220]: Timed out after 2520.004s.
cluster should eventually succeed after role assignments are created
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:216 with:
cluster entered terminal Failed state after role assignment deployment
Expected
    <armredhatopenshifthcp.ProvisioningState>: ...
not to equal
    <armredhatopenshifthcp.ProvisioningState>: ...
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [router]; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapError | 0xc0011b2dc0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-gzpbnd6vfw85" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6b4ed26f-20cb-49d2-8347-71352ec46934
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6b4ed26f-20cb-49d2-8347-71352ec46934",
      "name": "6b4ed26f-20cb-49d2-8347-71352ec46934",
      "status": "Failed",
      "startTime": "2026-08-14T03:26:58.343365873Z",
      "endTime": "2026-08-14T03:46:02.916994515Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors
Unexpected error:
    <*fmt.wrapError | 0xc0011b2dc0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-gzpbnd6vfw85" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6b4ed26f-20cb-49d2-8347-71352ec46934
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6b4ed26f-20cb-49d2-8347-71352ec46934",
      "name": "6b4ed26f-20cb-49d2-8347-71352ec46934",
      "status": "Failed",
      "startTime": "2026-08-14T03:26:58.343365873Z",
      "endTime": "2026-08-14T03:46:02.916994515Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [ignition-server-proxy, router]; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test FIPS Mode Support with v2026-06-30 API should create an HCP cluster with FIPS mode enabled via cryptoRestrictions property · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:106]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS
Unexpected error:
    <*fmt.wrapError | 0xc000f1e300>: 
    failed waiting for cluster="fips-enabled-cluster" in resourcegroup="fips-enabled-tljvzmwbv4xj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/48d4732f-5b96-418a-9969-c3a53bdbb197
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/48d4732f-5b96-418a-9969-c3a53bdbb197",
      "name": "48d4732f-5b96-418a-9969-c3a53bdbb197",
      "status": "Failed",
      "startTime": "2026-08-14T02:43:51.361386579Z",
      "endTime": "2026-08-14T03:03:00.950264593Z",
      "error": {
        "code": "InternalServerError",
        "message": "[hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [ignition-server-proxy deployment has 1 unavailable replicas, router deployment has 1 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:106]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS
Unexpected error:
    <*fmt.wrapError | 0xc000f1e300>: 
    failed waiting for cluster="fips-enabled-cluster" in resourcegroup="fips-enabled-tljvzmwbv4xj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/48d4732f-5b96-418a-9969-c3a53bdbb197
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/48d4732f-5b96-418a-9969-c3a53bdbb197",
      "name": "48d4732f-5b96-418a-9969-c3a53bdbb197",
      "status": "Failed",
      "startTime": "2026-08-14T02:43:51.361386579Z",
      "endTime": "2026-08-14T03:03:00.950264593Z",
      "error": {
        "code": "InternalServerError",
        "message": "[hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [ignition-server-proxy deployment has 1 unavailable replicas, router deployment has 1 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [ignition-server-proxy, kube-controller-manager, router]; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test Customer should create a cluster with private ingress using v20260630preview and verify the ingress is internal · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:103]: failed to create HCP cluster "private-ingress" with private ingress
Unexpected error:
    <*fmt.wrapError | 0xc000db6d40>: 
    failed to create HCP cluster private-ingress: failed waiting for cluster="private-ingress" in resourcegroup="private-ingress-76q2mvkzgs8k" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6ad92bcc-e43e-416f-a5de-dced9c7ed8b5
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6ad92bcc-e43e-416f-a5de-dced9c7ed8b5",
      "name": "6ad92bcc-e43e-416f-a5de-dced9c7ed8b5",
      "status": "Failed",
      "startTime": "2026-08-14T02:43:39.311083657Z",
      "endTime": "2026-08-14T03:02:41.194409983Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [ignition-server-proxy deployment has 1 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas, router deployment has 1 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:103]: failed to create HCP cluster "private-ingress" with private ingress
Unexpected error:
    <*fmt.wrapError | 0xc000db6d40>: 
    failed to create HCP cluster private-ingress: failed waiting for cluster="private-ingress" in resourcegroup="private-ingress-76q2mvkzgs8k" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6ad92bcc-e43e-416f-a5de-dced9c7ed8b5
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/6ad92bcc-e43e-416f-a5de-dced9c7ed8b5",
      "name": "6ad92bcc-e43e-416f-a5de-dced9c7ed8b5",
      "status": "Failed",
      "startTime": "2026-08-14T02:43:39.311083657Z",
      "endTime": "2026-08-14T03:02:41.194409983Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [ignition-server-proxy deployment has 1 unavailable replicas, kube-controller-manager deployment has 1 unavailable replicas, router deployment has 1 unavailable replicas]"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [router]; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:98]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapError | 0xc00111ad20>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-xbqvklmbb74c" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/b02104af-2b12-4182-8206-cc4bfa7d8e2e
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/b02104af-2b12-4182-8206-cc4bfa7d8e2e",
      "name": "b02104af-2b12-4182-8206-cc4bfa7d8e2e",
      "status": "Failed",
      "startTime": "2026-08-14T02:45:19.145147789Z",
      "endTime": "2026-08-14T03:04:21.089268067Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:98]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapError | 0xc00111ad20>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-xbqvklmbb74c" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/b02104af-2b12-4182-8206-cc4bfa7d8e2e
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/b02104af-2b12-4182-8206-cc4bfa7d8e2e",
      "name": "b02104af-2b12-4182-8206-cc4bfa7d8e2e",
      "status": "Failed",
      "startTime": "2026-08-14T02:45:19.145147789Z",
      "endTime": "2026-08-14T03:04:21.089268067Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: [router]; provider Microsoft.RedHatOpenShift
02:16:33 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:106]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapError | 0xc0005909e0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-5hmf99mz8grk" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/e63ffd4d-7579-49ea-a155-d0c16fc0026b
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/e63ffd4d-7579-49ea-a155-d0c16fc0026b",
      "name": "e63ffd4d-7579-49ea-a155-d0c16fc0026b",
      "status": "Failed",
      "startTime": "2026-08-14T02:45:20.431028652Z",
      "endTime": "2026-08-14T03:04:21.145173957Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:106]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd
Unexpected error:
    <*fmt.wrapError | 0xc0005909e0>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="complex-cilium-kv-5hmf99mz8grk" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/e63ffd4d-7579-49ea-a155-d0c16fc0026b
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/e63ffd4d-7579-49ea-a155-d0c16fc0026b",
      "name": "e63ffd4d-7579-49ea-a155-d0c16fc0026b",
      "status": "Failed",
      "startTime": "2026-08-14T02:45:20.431028652Z",
      "endTime": "2026-08-14T03:04:21.145173957Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [hypershiftHostedCluster] hosted cluster has no installed version; hosted cluster degraded: UnavailableReplicas: router deployment has 1 unavailable replicas"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 1
e2e (1)
VerifyVMOSDiskCustomerEncryption(nodePool=<nodepool>) failed: OS disk encryption verification failed for 2/2 VMs: disk des-encrypt-des-np-gs4jx-fkqfk_OSDisk for VM des-encrypt-des-np-gs4jx-fkqfk has encryption type EncryptionAtRestWithPlatformKey, expected
02:00:38 UTC · failed at e2e · test Nodepool OS Disk Encryption should create a nodepool with customer-managed disk encryption via DES · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_osdisk_encryption.go:163]: cluster verification failed
Unexpected error:
    <*errors.joinError | 0xc0010db638>: 
    VerifyVMOSDiskCustomerEncryption(nodePool=des-np) failed: OS disk encryption verification failed for 2/2 VMs: disk des-encrypt-des-np-gs4jx-fkqfk_OSDisk for VM des-encrypt-des-np-gs4jx-fkqfk has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    disk des-encrypt-des-np-gs4jx-stqv5_OSDisk for VM des-encrypt-des-np-gs4jx-stqv5 has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_osdisk_encryption.go:163]: cluster verification failed
Unexpected error:
    <*errors.joinError | 0xc0010db638>: 
    VerifyVMOSDiskCustomerEncryption(nodePool=des-np) failed: OS disk encryption verification failed for 2/2 VMs: disk des-encrypt-des-np-gs4jx-fkqfk_OSDisk for VM des-encrypt-des-np-gs4jx-fkqfk has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    disk des-encrypt-des-np-gs4jx-stqv5_OSDisk for VM des-encrypt-des-np-gs4jx-stqv5 has encryption type EncryptionAtRestWithPlatformKey, expected EncryptionAtRestWithCustomerKey
    ...
occurred