CIHealth
<
Single Day: Oct 21▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: INT

Time (UTC)RuntimeJobRegionFailed atResultPRFailed testsDetails
1h 41m 0s branch-ci-Azure-ARO-HCP-main-e2e-integration-e2e-parallel-all
post-goodmerged PR
No additional run metadata captured
 westus3 unknown failed n/a 5
unknown (5)
VerifyImagePulled(acrpullxt7r5cdx2wbm.azurecr.io/ubi-minimal) timed out after 2m0.005s: failed to list pods in namespace acr-pull-test-day2: context deadline exceeded
20:28:07 UTC · failed at unknown · test Customer should be able to create a cluster with ACR pull via managed identity and pull from a private ACR · suite integration/parallel/all
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_container_registry.go:346]: [day 2] pod in namespace acr-pull-test-day2 never pulled image ubi-minimal from private ACR acrpullxt7r5cdx2wbm.azurecr.io
Unexpected error:
    <*fmt.wrapError | 0xfec25889960>: 
    VerifyImagePulled(acrpullxt7r5cdx2wbm.azurecr.io/ubi-minimal) timed out after 2m0.005s: failed to list pods in namespace acr-pull-test-day2: context deadline exceeded
    {
        msg: "VerifyImagePulled(acrpullxt7r5cdx2wbm.azurecr.io/ubi-minimal) timed out after 2m0.005s: failed to list pods in namespace acr-pull-test-day2: context deadline exceeded",
        err: <*fmt.wrapError | 0xfec25889880>{
            msg: "failed to list pods in namespace acr-pull-test-day2: context deadline exceeded",
            err: <context.deadlineExceededError>{},
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_container_registry.go:346]: [day 2] pod in namespace acr-pull-test-day2 never pulled image ubi-minimal from private ACR acrpullxt7r5cdx2wbm.azurecr.io
Unexpected error:
    <*fmt.wrapError | 0xfec25889960>: 
    VerifyImagePulled(acrpullxt7r5cdx2wbm.azurecr.io/ubi-minimal) timed out after 2m0.005s: failed to list pods in namespace acr-pull-test-day2: context deadline exceeded
    {
        msg: "VerifyImagePulled(acrpullxt7r5cdx2wbm.azurecr.io/ubi-minimal) timed out after 2m0.005s: failed to list pods in namespace acr-pull-test-day2: context deadline exceeded",
        err: <*fmt.wrapError | 0xfec25889880>{
            msg: "failed to list pods in namespace acr-pull-test-day2: context deadline exceeded",
            err: <context.deadlineExceededError>{},
        },
    }
occurred
ERROR CODE: DeadlineExceeded; detail code SubscriptionRequestsThrottled; detail message Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '<uuid>' exceeded. Please try again after '<seconds>' seconds after additional tokens are available.; provider Microsoft.RedHatOpenShift
20:28:07 UTC · failed at unknown · test Customer should create a cluster using v20260901preview API and verify cluster health · suite integration/parallel/all
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
    <*fmt.wrapError | 0x16dd5f842340>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-h4vdzmhsx8jj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/214af887-1dd9-4618-9147-3df5b406eba9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/214af887-1dd9-4618-9147-3df5b406eba9",
      "name": "214af887-1dd9-4618-9147-3df5b406eba9",
      "status": "Failed",
      "startTime": "2026-10-21T21:02:58.414383168Z",
      "endTime": "2026-10-21T21:21:59.161334523Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine v20260901-np-1-4x84k-cvs95: Failed: interfaces failed to create or update. err: failed to get existing resource v20260901preview-h4vdzmhsx8jj--managed/v20260901-np-1-4x84k-cvs95-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-h4vdzmhsx8jj--managed/providers/Microsoft.Network/networkInterfaces/v20260901-np-1-4x84k-cvs95-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '6096f642-63a0-4dd6-958d-715a87f33535' exceeded. Please try again after '2' seconds after additional tokens are available. Refer to https://aka.ms... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/214af887-1dd9-4618-9147-3df5b406eba9
            correlation ID: 6a1aa67d-c740-4581-b0a0-1116fc9156bb
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:102]: failed to create node pool "np-1" for v20260901preview cluster "v20260901"
Unexpected error:
    <*fmt.wrapError | 0x16dd5f842340>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "v20260901" in resourcegroup="v20260901preview-h4vdzmhsx8jj" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/214af887-1dd9-4618-9147-3df5b406eba9
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/214af887-1dd9-4618-9147-3df5b406eba9",
      "name": "214af887-1dd9-4618-9147-3df5b406eba9",
      "status": "Failed",
      "startTime": "2026-10-21T21:02:58.414383168Z",
      "endTime": "2026-10-21T21:21:59.161334523Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine v20260901-np-1-4x84k-cvs95: Failed: interfaces failed to create or update. err: failed to get existing resource v20260901preview-h4vdzmhsx8jj--managed/v20260901-np-1-4x84k-cvs95-nic (service: interfaces): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-h4vdzmhsx8jj--managed/providers/Microsoft.Network/networkInterfaces/v20260901-np-1-4x84k-cvs95-nic\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '6096f642-63a0-4dd6-958d-715a87f33535' exceeded. Please try again after '2' seconds after additional tokens are available. Refer to https://aka.ms... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/214af887-1dd9-4618-9147-3df5b406eba9
            correlation ID: 6a1aa67d-c740-4581-b0a0-1116fc9156bb
            client request ID: unavailable
occurred
CreateOrUpdateExternalAuthAndWait timed out after <minutes> minutes; context deadline exceeded
20:28:07 UTC · failed at unknown · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite integration/parallel/all
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:276]: failed to create external auth config "ext-auth-cidr"
Unexpected error:
    <*fmt.wrapErrors | 0x24f636554f60>: 
    failed waiting for external auth "ext-auth-cidr" in resourcegroup="e2e-cidr-connectivity-mksjxrdvl2vg" for cluster="cidr-connectivity-test" to finish creating or updating, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ext-auth-cidr in cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-mksjxrdvl2vg, error: context deadline exceeded
    {
        msg: "failed waiting for external auth \"ext-auth-cidr\" in resourcegroup=\"e2e-cidr-connectivity-mksjxrdvl2vg\" for cluster=\"cidr-connectivity-test\" to finish creating or updating, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ext-auth-cidr in cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-mksjxrdvl2vg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0x24f635e3a480>{
                s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ext-auth-cidr in cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-mksjxrdvl2vg",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:276]: failed to create external auth config "ext-auth-cidr"
Unexpected error:
    <*fmt.wrapErrors | 0x24f636554f60>: 
    failed waiting for external auth "ext-auth-cidr" in resourcegroup="e2e-cidr-connectivity-mksjxrdvl2vg" for cluster="cidr-connectivity-test" to finish creating or updating, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ext-auth-cidr in cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-mksjxrdvl2vg, error: context deadline exceeded
    {
        msg: "failed waiting for external auth \"ext-auth-cidr\" in resourcegroup=\"e2e-cidr-connectivity-mksjxrdvl2vg\" for cluster=\"cidr-connectivity-test\" to finish creating or updating, caused by: timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ext-auth-cidr in cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-mksjxrdvl2vg, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0x24f635e3a480>{
                s: "timeout '15.000000' minutes exceeded during CreateOrUpdateExternalAuthAndWait for external auth ext-auth-cidr in cluster cidr-connectivity-test in resource group e2e-cidr-connectivity-mksjxrdvl2vg",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
ERROR CODE: DeadlineExceeded; detail code SubscriptionRequestsThrottled; detail message Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '<uuid>' exceeded. Please try again after '<seconds>' seconds after additional tokens are available.; provider Microsoft.RedHatOpenShift
20:28:07 UTC · failed at unknown · test FIPS Mode Support with v2026-09-01 API should create an HCP cluster with FIPS mode enabled via cryptoRestrictions property · suite integration/parallel/all
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:103]: failed to create node pool "np-1" for fips-enabled cluster "fips-enabled-cluster"
Unexpected error:
    <*fmt.wrapError | 0x3c4c027a02e0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "fips-enabled-cluster" in resourcegroup="fips-enabled-6xshnph7ptd9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/363f69bc-d1f2-4956-842d-980aba640091
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/363f69bc-d1f2-4956-842d-980aba640091",
      "name": "363f69bc-d1f2-4956-842d-980aba640091",
      "status": "Failed",
      "startTime": "2026-10-21T21:02:55.100233745Z",
      "endTime": "2026-10-21T21:21:58.935771192Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine j1s0i5w0t2h9v3h-np-1-br8d2-5c77c: Failed: virtualmachine failed to create or update. err: failed to get existing resource fips-enabled-6xshnph7ptd9--managed/j1s0i5w0t2h9v3h-np-1-br8d2-5c77c (service: virtualmachine): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-6xshnph7ptd9--managed/providers/Microsoft.Compute/virtualMachines/j1s0i5w0t2h9v3h-np-1-br8d2-5c77c\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '6096f642-63a0-4dd6-958d-715a87f33535' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https:... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/363f69bc-d1f2-4956-842d-980aba640091
            correlation ID: 90349399-701b-4ce9-affd-54978e664c51
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:103]: failed to create node pool "np-1" for fips-enabled cluster "fips-enabled-cluster"
Unexpected error:
    <*fmt.wrapError | 0x3c4c027a02e0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "fips-enabled-cluster" in resourcegroup="fips-enabled-6xshnph7ptd9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/363f69bc-d1f2-4956-842d-980aba640091
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/363f69bc-d1f2-4956-842d-980aba640091",
      "name": "363f69bc-d1f2-4956-842d-980aba640091",
      "status": "Failed",
      "startTime": "2026-10-21T21:02:55.100233745Z",
      "endTime": "2026-10-21T21:21:58.935771192Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [clusterServiceNodePoolStatus] cluster service node pool is installing; [hypershiftNodePool] hypershift NodePool status replicas is 0, want 2; node pool condition AllMachinesReady is False: 2 of 2 machines are not ready\nMachine j1s0i5w0t2h9v3h-np-1-br8d2-5c77c: Failed: virtualmachine failed to create or update. err: failed to get existing resource fips-enabled-6xshnph7ptd9--managed/j1s0i5w0t2h9v3h-np-1-br8d2-5c77c (service: virtualmachine): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-6xshnph7ptd9--managed/providers/Microsoft.Compute/virtualMachines/j1s0i5w0t2h9v3h-np-1-br8d2-5c77c\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '6096f642-63a0-4dd6-958d-715a87f33535' exceeded. Please try again after '1' seconds after additional tokens are available. Refer to https:... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/363f69bc-d1f2-4956-842d-980aba640091
            correlation ID: 90349399-701b-4ce9-affd-54978e664c51
            client request ID: unavailable
occurred
ERROR CODE: DeadlineExceeded; detail code SubscriptionRequestsThrottled; detail message Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '<uuid>' exceeded. Please try again after '10' se... message truncated; provider Microsoft.RedHatOpenShift
20:28:07 UTC · failed at unknown · test Customer should create a cluster with private ingress using v20260901preview and verify the ingress is internal · suite integration/parallel/all
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:123]: failed to create node pool "np-1" for private ingress cluster "private-ingress"
Unexpected error:
    <*fmt.wrapError | 0x14b6bdca84e0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-ingress" in resourcegroup="private-ingress-gxdr6w65gk4m" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/f8d1a217-26ee-4eb3-92f9-7a398b20fbf3
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/f8d1a217-26ee-4eb3-92f9-7a398b20fbf3",
      "name": "f8d1a217-26ee-4eb3-92f9-7a398b20fbf3",
      "status": "Failed",
      "startTime": "2026-10-21T21:02:30.132303735Z",
      "endTime": "2026-10-21T21:21:38.466559997Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine private-ingress-np-1-z68fd-hf6g2: Failed: availabilitysets failed to create or update. err: failed to get existing resource private-ingress-gxdr6w65gk4m--managed/2tjdfde52u2f4iccs1dt8sgim461diee_private-ingress-np-1-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-gxdr6w65gk4m--managed/providers/Microsoft.Compute/availabilitySets/2tjdfde52u2f4iccs1dt8sgim461diee_private-ingress-np-1-as\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '6096f642-63a0-4dd6-958d-715a87f33535' exceeded. Please try again after '10' se... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/f8d1a217-26ee-4eb3-92f9-7a398b20fbf3
            correlation ID: 3e8f1379-1d07-482e-b286-68789ae9a346
            client request ID: unavailable
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:123]: failed to create node pool "np-1" for private ingress cluster "private-ingress"
Unexpected error:
    <*fmt.wrapError | 0x14b6bdca84e0>: 
    failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-ingress" in resourcegroup="private-ingress-gxdr6w65gk4m" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/f8d1a217-26ee-4eb3-92f9-7a398b20fbf3
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: DeadlineExceeded
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/f8d1a217-26ee-4eb3-92f9-7a398b20fbf3",
      "name": "f8d1a217-26ee-4eb3-92f9-7a398b20fbf3",
      "status": "Failed",
      "startTime": "2026-10-21T21:02:30.132303735Z",
      "endTime": "2026-10-21T21:21:38.466559997Z",
      "error": {
        "code": "DeadlineExceeded",
        "message": "node pool creation did not complete before the deadline; [hypershiftNodePool] hypershift NodePool status replicas is 1, want 2; node pool condition AllMachinesReady is False: 1 of 2 machines are not ready\nMachine private-ingress-np-1-z68fd-hf6g2: Failed: availabilitysets failed to create or update. err: failed to get existing resource private-ingress-gxdr6w65gk4m--managed/2tjdfde52u2f4iccs1dt8sgim461diee_private-ingress-np-1-as (service: availabilitysets): GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-gxdr6w65gk4m--managed/providers/Microsoft.Compute/availabilitySets/2tjdfde52u2f4iccs1dt8sgim461diee_private-ingress-np-1-as\n--------------------------------------------------------------------------------\nRESPONSE 429: 429 Too Many Requests\nERROR CODE: SubscriptionRequestsThrottled\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"code\": \"SubscriptionRequestsThrottled\",\n    \"message\": \"Number of 'read' requests for subscription 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX' actor '6096f642-63a0-4dd6-958d-715a87f33535' exceeded. Please try again after '10' se... message truncated\n"
      }
    }
    --------------------------------------------------------------------------------
    
    <Azure error internals omitted>
        Azure request IDs:
          GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westus3/hcpOperationStatuses/f8d1a217-26ee-4eb3-92f9-7a398b20fbf3
            correlation ID: 3e8f1379-1d07-482e-b286-68789ae9a346
            client request ID: unavailable
occurred