CIHealth
<
Single Day: Aug 2▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: STG

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel-ocp-nightly
post-goodmerged PR
No additional run metadata captured
 unknown failed n/a 1 non-artifact-backed failure (no junit artifacts)
branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a
branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 3
e2e (3)
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; provider Microsoft.RedHatOpenShift
12:11:17 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapError | 0xc000edcf00>: 
    failed to create HCP cluster np-autoscale-cluster: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-knj7h6hzlfwp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/f917f08c-8a2c-4163-bb74-d390cf107a2f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/f917f08c-8a2c-4163-bb74-d390cf107a2f",
      "name": "f917f08c-8a2c-4163-bb74-d390cf107a2f",
      "status": "Failed",
      "startTime": "2026-08-02T13:02:04.086966136Z",
      "endTime": "2026-08-02T13:21:05.521842933Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster
Unexpected error:
    <*fmt.wrapError | 0xc000edcf00>: 
    failed to create HCP cluster np-autoscale-cluster: failed waiting for cluster="np-autoscale-cluster" in resourcegroup="np-autoscaling-knj7h6hzlfwp" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/f917f08c-8a2c-4163-bb74-d390cf107a2f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/f917f08c-8a2c-4163-bb74-d390cf107a2f",
      "name": "f917f08c-8a2c-4163-bb74-d390cf107a2f",
      "status": "Failed",
      "startTime": "2026-08-02T13:02:04.086966136Z",
      "endTime": "2026-08-02T13:21:05.521842933Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceNodePoolStatus] <no_message>; provider Microsoft.RedHatOpenShift
12:11:17 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:174]: failed to create node pool "np-j4qppb" for cluster "cluster-candidate-4-20-j4qppb"
Unexpected error:
    <*fmt.wrapError | 0xc0008815c0>: 
    failed to create NodePool np-j4qppb: failed waiting for nodepool="np-j4qppb" for cluster "cluster-candidate-4-20-j4qppb" in resourcegroup="rg-candidate-4-20-zb8h44nq84p2" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/fa27d164-3505-46d6-9212-77ee4b295f06
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/fa27d164-3505-46d6-9212-77ee4b295f06",
      "name": "fa27d164-3505-46d6-9212-77ee4b295f06",
      "status": "Failed",
      "startTime": "2026-08-02T12:46:31.600627494Z",
      "endTime": "2026-08-02T13:05:44.21314904Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:174]: failed to create node pool "np-j4qppb" for cluster "cluster-candidate-4-20-j4qppb"
Unexpected error:
    <*fmt.wrapError | 0xc0008815c0>: 
    failed to create NodePool np-j4qppb: failed waiting for nodepool="np-j4qppb" for cluster "cluster-candidate-4-20-j4qppb" in resourcegroup="rg-candidate-4-20-zb8h44nq84p2" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/fa27d164-3505-46d6-9212-77ee4b295f06
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/fa27d164-3505-46d6-9212-77ee4b295f06",
      "name": "fa27d164-3505-46d6-9212-77ee4b295f06",
      "status": "Failed",
      "startTime": "2026-08-02T12:46:31.600627494Z",
      "endTime": "2026-08-02T13:05:44.21314904Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; provider Microsoft.RedHatOpenShift
12:11:17 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:98]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapError | 0xc0010369a0>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-x69ppfm57fk5" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1ff8b02c-bced-44bb-ad32-f146e0933a3f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1ff8b02c-bced-44bb-ad32-f146e0933a3f",
      "name": "1ff8b02c-bced-44bb-ad32-f146e0933a3f",
      "status": "Failed",
      "startTime": "2026-08-02T12:34:42.292729397Z",
      "endTime": "2026-08-02T12:53:44.10791095Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:98]: failed to create HCP cluster "private-kv-cluster" with private keyvault
Unexpected error:
    <*fmt.wrapError | 0xc0010369a0>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-x69ppfm57fk5" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1ff8b02c-bced-44bb-ad32-f146e0933a3f
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/1ff8b02c-bced-44bb-ad32-f146e0933a3f",
      "name": "1ff8b02c-bced-44bb-ad32-f146e0933a3f",
      "status": "Failed",
      "startTime": "2026-08-02T12:34:42.292729397Z",
      "endTime": "2026-08-02T12:53:44.10791095Z",
      "error": {
        "code": "InternalServerError",
        "message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
      }
    }
    --------------------------------------------------------------------------------
    
    ...
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 1
e2e (1)
DeleteHCPCluster timed out after <minutes> minutes; context deadline exceeded
02:00:06 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:293]: Unexpected error:
    <*errors.joinError | 0xc0016f00a8>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="customer-rg-49dj9jsdlscw", caused by: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-49dj9jsdlscw" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster basic-hcp-cluster in resource group customer-rg-49dj9jsdlscw, error: context deadline exceeded, error: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-49dj9jsdlscw" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster basic-hcp-cluster in resource group customer-rg-49dj9jsdlscw, error: context deadline exceeded
    ...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:293]: Unexpected error:
    <*errors.joinError | 0xc0016f00a8>: 
    failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="customer-rg-49dj9jsdlscw", caused by: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-49dj9jsdlscw" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster basic-hcp-cluster in resource group customer-rg-49dj9jsdlscw, error: context deadline exceeded, error: failed waiting for hcpCluster="basic-hcp-cluster" in resourcegroup="customer-rg-49dj9jsdlscw" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster basic-hcp-cluster in resource group customer-rg-49dj9jsdlscw, error: context deadline exceeded
    ...
occurred