No runs match your search.
Environment: PROD
| Time (UTC) | Job | Failed at | Result | PR | Failed tests | Details |
|---|---|---|---|---|---|---|
| periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel-ocp-nightly post-goodmerged PR |
e2e | failed | n/a | 1 | e2e (1)ERROR CODE: NoRegisteredProviderFound; detail message No registered resource provider found for location 'uksouth' and API version '2026-06-30-preview' for type 'HCPOpenShiftClusters'. The supported api-versions are '2025-12-23-preview, 2024-06-10-preview'. The supported locations are 'centraluseuap, eastus2euap, uksouth, switzerlandnorth, canadacentral, australiaeast, westeurope, centralindia, brazilsouth, eastus2'.; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS
Unexpected error:
<*fmt.wrapError | 0xc0004351e0>:
failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-q9gpdmtglj9j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-q9gpdmtglj9j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: NoRegisteredProviderFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NoRegisteredProviderFound",
"message": "No registered resource provider found for location 'uksouth' and API version '2026-06-30-preview' for type 'HCPOpenShiftClusters'. The supported api-versions are '2025-12-23-preview, 2024-06-10-preview'. The supported locations are 'centraluseuap, eastus2euap, uksouth, switzerlandnorth, canadacentral, australiaeast, westeurope, centralindia, brazilsouth, eastus2'."
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS
Unexpected error:
<*fmt.wrapError | 0xc0004351e0>:
failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-q9gpdmtglj9j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-q9gpdmtglj9j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas
--------------------------------------------------------------------------------
RESPONSE 400: 400 Bad Request
ERROR CODE: NoRegisteredProviderFound
--------------------------------------------------------------------------------
{
"error": {
"code": "NoRegisteredProviderFound",
"message": "No registered resource provider found for location 'uksouth' and API version '2026-06-30-preview' for type 'HCPOpenShiftClusters'. The supported api-versions are '2025-12-23-preview, 2024-06-10-preview'. The supported locations are 'centraluseuap, eastus2euap, uksouth, switzerlandnorth, canadacentral, australiaeast, westeurope, centralindia, brazilsouth, eastus2'."
}
}
--------------------------------------------------------------------------------
...
occurred |
|
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
e2e | failed | n/a | 2 | e2e (2)DeleteHCPCluster timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc000fb0258>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="admin-credential-lifecycle-test-9vnswkxphvxb", caused by: failed waiting for hcpCluster="admin-cred-lifecycle-7wqzzv" in resourcegroup="admin-credential-lifecycle-test-9vnswkxphvxb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-7wqzzv in resource group admin-credential-lifecycle-test-9vnswkxphvxb, error: context deadline exceeded, error: failed waiting for hcpCluster="admin-cred-lifecycle-7wqzzv" in resourcegroup="admin-credential-lifecycle-test-9vnswkxphvxb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-7wqzzv in resource group admin-credential-lifecycle-test-9vnswkxphvxb, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc000fb0258>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="admin-credential-lifecycle-test-9vnswkxphvxb", caused by: failed waiting for hcpCluster="admin-cred-lifecycle-7wqzzv" in resourcegroup="admin-credential-lifecycle-test-9vnswkxphvxb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-7wqzzv in resource group admin-credential-lifecycle-test-9vnswkxphvxb, error: context deadline exceeded, error: failed waiting for hcpCluster="admin-cred-lifecycle-7wqzzv" in resourcegroup="admin-credential-lifecycle-test-9vnswkxphvxb" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster admin-cred-lifecycle-7wqzzv in resource group admin-credential-lifecycle-test-9vnswkxphvxb, error: context deadline exceeded
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceNodePoolStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
<*fmt.wrapError | 0xc000606880>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-7xkpn5bkr29m" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/06b3812c-7ebf-4b90-8f77-3d0a9e26580c
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/06b3812c-7ebf-4b90-8f77-3d0a9e26580c",
"name": "06b3812c-7ebf-4b90-8f77-3d0a9e26580c",
"status": "Failed",
"startTime": "2026-07-30T19:13:37.600674519Z",
"endTime": "2026-07-30T19:32:46.554485887Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:136]: failed to create node pool "np-1" for private keyvault cluster "private-kv-cluster"
Unexpected error:
<*fmt.wrapError | 0xc000606880>:
failed to create NodePool np-1: failed waiting for nodepool="np-1" for cluster "private-kv-cluster" in resourcegroup="private-keyvault-7xkpn5bkr29m" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/06b3812c-7ebf-4b90-8f77-3d0a9e26580c
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/westeurope/hcpOperationStatuses/06b3812c-7ebf-4b90-8f77-3d0a9e26580c",
"name": "06b3812c-7ebf-4b90-8f77-3d0a9e26580c",
"status": "Failed",
"startTime": "2026-07-30T19:13:37.600674519Z",
"endTime": "2026-07-30T19:32:46.554485887Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred |
|
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
unknown | failed | n/a | 1 | non-artifact-backed failure (no junit artifacts) | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
e2e | failed | n/a | 3 | e2e (3)DeleteResourceGroup timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:145]: failed to delete customer resource group "cx-rg-cluster-pxnh4n9clmln"
Unexpected error:
<*fmt.wrapErrors | 0xc001ade210>:
failed to delete resource group, caused by: timeout '60.000000' minutes exceeded during DeleteResourceGroup for resource group cx-rg-cluster-pxnh4n9clmln, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:145]: failed to delete customer resource group "cx-rg-cluster-pxnh4n9clmln"
Unexpected error:
<*fmt.wrapErrors | 0xc001ade210>:
failed to delete resource group, caused by: timeout '60.000000' minutes exceeded during DeleteResourceGroup for resource group cx-rg-cluster-pxnh4n9clmln, error: context deadline exceeded
...
occurredAll ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)] Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:411]: Timed out after 600.000s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:410 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
<[]string | len:1, cap:1>: ...
to be empty
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:411]: Timed out after 600.000s.
The function passed to Eventually failed at /opt/app-root/src/github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:410 with:
All ClusterOperators should report Available=True, but these are not available: [monitoring (Available=Unknown)]
Expected
<[]string | len:1, cap:1>: ...
to be emptyERROR CODE: InternalServerError; detail message [clusterServiceNodePoolStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:173]: failed to create node pool "np-fk7h4x" for cluster "cluster-candidate-4-20-fk7h4x"
Unexpected error:
<*fmt.wrapError | 0xc000d80d60>:
failed to create NodePool np-fk7h4x: failed waiting for nodepool="np-fk7h4x" for cluster "cluster-candidate-4-20-fk7h4x" in resourcegroup="rg-candidate-4-20-87krhtz52qvw" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/253ac28d-0828-4407-ba5f-731d8255e9b8
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/253ac28d-0828-4407-ba5f-731d8255e9b8",
"name": "253ac28d-0828-4407-ba5f-731d8255e9b8",
"status": "Failed",
"startTime": "2026-07-30T13:18:30.696627194Z",
"endTime": "2026-07-30T13:37:34.938776476Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:173]: failed to create node pool "np-fk7h4x" for cluster "cluster-candidate-4-20-fk7h4x"
Unexpected error:
<*fmt.wrapError | 0xc000d80d60>:
failed to create NodePool np-fk7h4x: failed waiting for nodepool="np-fk7h4x" for cluster "cluster-candidate-4-20-fk7h4x" in resourcegroup="rg-candidate-4-20-87krhtz52qvw" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/253ac28d-0828-4407-ba5f-731d8255e9b8
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/canadacentral/hcpOperationStatuses/253ac28d-0828-4407-ba5f-731d8255e9b8",
"name": "253ac28d-0828-4407-ba5f-731d8255e9b8",
"status": "Failed",
"startTime": "2026-07-30T13:18:30.696627194Z",
"endTime": "2026-07-30T13:37:34.938776476Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred |
|
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
e2e | failed | n/a | 15 | e2e (15)ERROR CODE: InternalServerError; detail message [clusterServiceNodePoolStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:477]: failed to create nodepool nps-420-422 at version 4.20.31
Unexpected error:
<*fmt.wrapError | 0xc00059d820>:
failed to create NodePool nps-420-422: failed waiting for nodepool="nps-420-422" for cluster "np-skip-minor-h2zsf4" in resourcegroup="rg-np-skip-minor-h2zsf4-b89k8srsvpkk" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/4149625e-4e5f-4a3a-bc28-d3fd3193e580
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/4149625e-4e5f-4a3a-bc28-d3fd3193e580",
"name": "4149625e-4e5f-4a3a-bc28-d3fd3193e580",
"status": "Failed",
"startTime": "2026-07-30T11:13:08.228285368Z",
"endTime": "2026-07-30T11:32:19.157857139Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:477]: failed to create nodepool nps-420-422 at version 4.20.31
Unexpected error:
<*fmt.wrapError | 0xc00059d820>:
failed to create NodePool nps-420-422: failed waiting for nodepool="nps-420-422" for cluster "np-skip-minor-h2zsf4" in resourcegroup="rg-np-skip-minor-h2zsf4-b89k8srsvpkk" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/4149625e-4e5f-4a3a-bc28-d3fd3193e580
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/4149625e-4e5f-4a3a-bc28-d3fd3193e580",
"name": "4149625e-4e5f-4a3a-bc28-d3fd3193e580",
"status": "Failed",
"startTime": "2026-07-30T11:13:08.228285368Z",
"endTime": "2026-07-30T11:32:19.157857139Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceNodePoolStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:330]: failed to create nodepool npnoedge-4-20 at version 4.20.0
Unexpected error:
<*fmt.wrapError | 0xc001010980>:
failed to create NodePool npnoedge-4-20: failed waiting for nodepool="npnoedge-4-20" for cluster "np-noedge-8fbqqx" in resourcegroup="rg-np-noedge-8fbqqx-gpzkq677gbw9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/83da4bb2-8e81-42c2-bc1f-51306215a06d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/83da4bb2-8e81-42c2-bc1f-51306215a06d",
"name": "83da4bb2-8e81-42c2-bc1f-51306215a06d",
"status": "Failed",
"startTime": "2026-07-30T11:11:05.787386838Z",
"endTime": "2026-07-30T11:30:19.267053416Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:330]: failed to create nodepool npnoedge-4-20 at version 4.20.0
Unexpected error:
<*fmt.wrapError | 0xc001010980>:
failed to create NodePool npnoedge-4-20: failed waiting for nodepool="npnoedge-4-20" for cluster "np-noedge-8fbqqx" in resourcegroup="rg-np-noedge-8fbqqx-gpzkq677gbw9" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/83da4bb2-8e81-42c2-bc1f-51306215a06d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/83da4bb2-8e81-42c2-bc1f-51306215a06d",
"name": "83da4bb2-8e81-42c2-bc1f-51306215a06d",
"status": "Failed",
"startTime": "2026-07-30T11:11:05.787386838Z",
"endTime": "2026-07-30T11:30:19.267053416Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurredUpdateNodePoolAndWait timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up
Unexpected error:
<*fmt.wrapErrors | 0xc00294ae10>:
failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-djtcdz2tpstd" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-djtcdz2tpstd, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:185]: failed to update node pool np-1 with new taints and scale up
Unexpected error:
<*fmt.wrapErrors | 0xc00294ae10>:
failed waiting for nodepool="np-1" in cluster="cluster-np-labels-taints" resourcegroup="rg-np-labels-taints-djtcdz2tpstd" to finish updating, caused by: timeout '20.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool np-1 in cluster cluster-np-labels-taints in resource group rg-np-labels-taints-djtcdz2tpstd, error: context deadline exceeded
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [cosmosCluster] .api.url is empty; [hypershiftHostedCluster] ReadDesire has no kube content; [servingCABundle] ServingCABundle not yet populated; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:109]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
<*fmt.wrapError | 0xc0005a2c40>:
failed to create HCP cluster negative-tests-cluster: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-8mclbsqjtf6m" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/321a074f-327c-4334-8a5c-1f095d42d969
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/321a074f-327c-4334-8a5c-1f095d42d969",
"name": "321a074f-327c-4334-8a5c-1f095d42d969",
"status": "Failed",
"startTime": "2026-07-30T11:17:15.938139325Z",
"endTime": "2026-07-30T11:36:19.215744518Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [cosmosCluster] .api.url is empty; [hypershiftHostedCluster] ReadDesire has no kube content; [servingCABundle] ServingCABundle not yet populated"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:109]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
<*fmt.wrapError | 0xc0005a2c40>:
failed to create HCP cluster negative-tests-cluster: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-8mclbsqjtf6m" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/321a074f-327c-4334-8a5c-1f095d42d969
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/321a074f-327c-4334-8a5c-1f095d42d969",
"name": "321a074f-327c-4334-8a5c-1f095d42d969",
"status": "Failed",
"startTime": "2026-07-30T11:17:15.938139325Z",
"endTime": "2026-07-30T11:36:19.215744518Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [cosmosCluster] .api.url is empty; [hypershiftHostedCluster] ReadDesire has no kube content; [servingCABundle] ServingCABundle not yet populated"
}
}
--------------------------------------------------------------------------------
...
occurredDeleteHCPCluster timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc001e86348>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="external-auth-cluster-55gxhxj67hwg", caused by: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-55gxhxj67hwg" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ea-cluster in resource group external-auth-cluster-55gxhxj67hwg, error: context deadline exceeded, error: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-55gxhxj67hwg" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ea-cluster in resource group external-auth-cluster-55gxhxj67hwg, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc001e86348>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="external-auth-cluster-55gxhxj67hwg", caused by: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-55gxhxj67hwg" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ea-cluster in resource group external-auth-cluster-55gxhxj67hwg, error: context deadline exceeded, error: failed waiting for hcpCluster="ea-cluster" in resourcegroup="external-auth-cluster-55gxhxj67hwg" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ea-cluster in resource group external-auth-cluster-55gxhxj67hwg, error: context deadline exceeded
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceNodePoolStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:219]: failed to create no-AZ nodepool autoscale-noaz with autoscaling
Unexpected error:
<*fmt.wrapError | 0xc000f6f760>:
failed to create NodePool autoscale-noaz: failed waiting for nodepool="autoscale-noaz" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-mxv4cfnvmvfm" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/c4814543-e6f4-4086-8a84-c7857bb4b347
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/c4814543-e6f4-4086-8a84-c7857bb4b347",
"name": "c4814543-e6f4-4086-8a84-c7857bb4b347",
"status": "Failed",
"startTime": "2026-07-30T11:12:24.693112447Z",
"endTime": "2026-07-30T11:31:29.283599663Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:219]: failed to create no-AZ nodepool autoscale-noaz with autoscaling
Unexpected error:
<*fmt.wrapError | 0xc000f6f760>:
failed to create NodePool autoscale-noaz: failed waiting for nodepool="autoscale-noaz" for cluster "np-autoscale-cluster" in resourcegroup="np-autoscaling-mxv4cfnvmvfm" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/c4814543-e6f4-4086-8a84-c7857bb4b347
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/c4814543-e6f4-4086-8a84-c7857bb4b347",
"name": "c4814543-e6f4-4086-8a84-c7857bb4b347",
"status": "Failed",
"startTime": "2026-07-30T11:12:24.693112447Z",
"endTime": "2026-07-30T11:31:29.283599663Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceNodePoolStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster
Unexpected error:
<*fmt.wrapError | 0xc000b0a980>:
failed to create HCP cluster np-dg-minor-d2c552: failed waiting for cluster="np-dg-minor-d2c552" in resourcegroup="rg-np-dg-minor-d2c552-s6hmsbqstnwg" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/eb7b0509-b11a-4301-9d26-8282b9e6c9e3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/eb7b0509-b11a-4301-9d26-8282b9e6c9e3",
"name": "eb7b0509-b11a-4301-9d26-8282b9e6c9e3",
"status": "Failed",
"startTime": "2026-07-30T11:13:06.699460126Z",
"endTime": "2026-07-30T11:32:19.320944112Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:736]: failed to create HCP cluster
Unexpected error:
<*fmt.wrapError | 0xc000b0a980>:
failed to create HCP cluster np-dg-minor-d2c552: failed waiting for cluster="np-dg-minor-d2c552" in resourcegroup="rg-np-dg-minor-d2c552-s6hmsbqstnwg" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/eb7b0509-b11a-4301-9d26-8282b9e6c9e3
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/eb7b0509-b11a-4301-9d26-8282b9e6c9e3",
"name": "eb7b0509-b11a-4301-9d26-8282b9e6c9e3",
"status": "Failed",
"startTime": "2026-07-30T11:13:06.699460126Z",
"endTime": "2026-07-30T11:32:19.320944112Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurredUpdateNodePoolAndWait timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-21 to version 4.21.26
Unexpected error:
<*fmt.wrapErrors | 0xc001096720>:
failed waiting for nodepool="npupgrade-4-21" in cluster="np-version-upgrade-cluster-m98bwq" resourcegroup="rg-np-version-upgrade-m98bwq-6wlkt7dwt5st" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-21 in cluster np-version-upgrade-cluster-m98bwq in resource group rg-np-version-upgrade-m98bwq-6wlkt7dwt5st, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-21 to version 4.21.26
Unexpected error:
<*fmt.wrapErrors | 0xc001096720>:
failed waiting for nodepool="npupgrade-4-21" in cluster="np-version-upgrade-cluster-m98bwq" resourcegroup="rg-np-version-upgrade-m98bwq-6wlkt7dwt5st" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-21 in cluster np-version-upgrade-cluster-m98bwq in resource group rg-np-version-upgrade-m98bwq-6wlkt7dwt5st, error: context deadline exceeded
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster
Unexpected error:
<*fmt.wrapError | 0xc000a99b20>:
failed to create HCP cluster np-downgrade-cp7c49: failed waiting for cluster="np-downgrade-cp7c49" in resourcegroup="rg-np-downgrade-cp7c49-jvr6w2dtdt2g" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b9dd0096-3c57-462e-a4e7-d5aae3bc006d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b9dd0096-3c57-462e-a4e7-d5aae3bc006d",
"name": "b9dd0096-3c57-462e-a4e7-d5aae3bc006d",
"status": "Failed",
"startTime": "2026-07-30T11:10:46.754483041Z",
"endTime": "2026-07-30T11:29:49.202419101Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:589]: failed to create HCP cluster
Unexpected error:
<*fmt.wrapError | 0xc000a99b20>:
failed to create HCP cluster np-downgrade-cp7c49: failed waiting for cluster="np-downgrade-cp7c49" in resourcegroup="rg-np-downgrade-cp7c49-jvr6w2dtdt2g" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b9dd0096-3c57-462e-a4e7-d5aae3bc006d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/b9dd0096-3c57-462e-a4e7-d5aae3bc006d",
"name": "b9dd0096-3c57-462e-a4e7-d5aae3bc006d",
"status": "Failed",
"startTime": "2026-07-30T11:10:46.754483041Z",
"endTime": "2026-07-30T11:29:49.202419101Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurredDeleteHCPCluster timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc000290558>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs", caused by: failed waiting for hcpCluster="cp-ystream-upgrade-4-21-bn6vtx" in resourcegroup="rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cp-ystream-upgrade-4-21-bn6vtx in resource group rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs, error: context deadline exceeded, error: failed waiting for hcpCluster="cp-ystream-upgrade-4-21-bn6vtx" in resourcegroup="rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cp-ystream-upgrade-4-21-bn6vtx in resource group rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc000290558>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs", caused by: failed waiting for hcpCluster="cp-ystream-upgrade-4-21-bn6vtx" in resourcegroup="rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cp-ystream-upgrade-4-21-bn6vtx in resource group rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs, error: context deadline exceeded, error: failed waiting for hcpCluster="cp-ystream-upgrade-4-21-bn6vtx" in resourcegroup="rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster cp-ystream-upgrade-4-21-bn6vtx in resource group rg-cp-ystream-upgrade-4-21-dbzwqxwppnjs, error: context deadline exceeded
...
occurredUpdateNodePoolAndWait timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.21.26
Unexpected error:
<*fmt.wrapErrors | 0xc001a941e0>:
failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-d45wt7" resourcegroup="rg-np-version-upgrade-d45wt7-r5nbl95ln47b" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-d45wt7 in resource group rg-np-version-upgrade-d45wt7-r5nbl95ln47b, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.21.26
Unexpected error:
<*fmt.wrapErrors | 0xc001a941e0>:
failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-d45wt7" resourcegroup="rg-np-version-upgrade-d45wt7-r5nbl95ln47b" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-d45wt7 in resource group rg-np-version-upgrade-d45wt7-r5nbl95ln47b, error: context deadline exceeded
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; [cosmosCluster] .api.url is empty; [hypershiftHostedCluster] ReadDesire has no kube content; [servingCABundle] ServingCABundle not yet populated; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
<*fmt.wrapError | 0xc000e269a0>:
failed to create HCP cluster shoebox-hcp-cluster: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-k2rwpg65mjh7" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/db817875-2c58-4fcf-8b75-f06b629d5f70
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/db817875-2c58-4fcf-8b75-f06b629d5f70",
"name": "db817875-2c58-4fcf-8b75-f06b629d5f70",
"status": "Failed",
"startTime": "2026-07-30T11:15:52.679864378Z",
"endTime": "2026-07-30T11:34:59.507212138Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [cosmosCluster] .api.url is empty; [hypershiftHostedCluster] ReadDesire has no kube content; [servingCABundle] ServingCABundle not yet populated"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:269]: failed to create HCP cluster shoebox-hcp-cluster
Unexpected error:
<*fmt.wrapError | 0xc000e269a0>:
failed to create HCP cluster shoebox-hcp-cluster: failed waiting for cluster="shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-k2rwpg65mjh7" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/db817875-2c58-4fcf-8b75-f06b629d5f70
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/db817875-2c58-4fcf-8b75-f06b629d5f70",
"name": "db817875-2c58-4fcf-8b75-f06b629d5f70",
"status": "Failed",
"startTime": "2026-07-30T11:15:52.679864378Z",
"endTime": "2026-07-30T11:34:59.507212138Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e; [cosmosCluster] .api.url is empty; [hypershiftHostedCluster] ReadDesire has no kube content; [servingCABundle] ServingCABundle not yet populated"
}
}
--------------------------------------------------------------------------------
...
occurredUpdateNodePoolAndWait timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.20.31
Unexpected error:
<*fmt.wrapErrors | 0xc0008aacf0>:
failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-dch7fj" resourcegroup="rg-np-version-upgrade-dch7fj-w9xwlnksswtg" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-dch7fj in resource group rg-np-version-upgrade-dch7fj-w9xwlnksswtg, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:210]: failed to upgrade node pool npupgrade-4-20 to version 4.20.31
Unexpected error:
<*fmt.wrapErrors | 0xc0008aacf0>:
failed waiting for nodepool="npupgrade-4-20" in cluster="np-version-upgrade-cluster-dch7fj" resourcegroup="rg-np-version-upgrade-dch7fj-w9xwlnksswtg" to finish updating, caused by: timeout '45.000000' minutes exceeded during UpdateNodePoolAndWait for nodepool npupgrade-4-20 in cluster np-version-upgrade-cluster-dch7fj in resource group rg-np-version-upgrade-dch7fj-w9xwlnksswtg, error: context deadline exceeded
...
occurredDeleteHCPCluster timed out after <minutes> minutes; context deadline exceeded Show raw failurefail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc001168180>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="ephemeral-osdisk-lq29kqkt9n82", caused by: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-lq29kqkt9n82" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-lq29kqkt9n82, error: context deadline exceeded, error: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-lq29kqkt9n82" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-lq29kqkt9n82, error: context deadline exceeded
...
occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:285]: Unexpected error:
<*errors.joinError | 0xc001168180>:
failed to cleanup resource group: failed deleting hcp clusters in resourcegroup="ephemeral-osdisk-lq29kqkt9n82", caused by: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-lq29kqkt9n82" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-lq29kqkt9n82, error: context deadline exceeded, error: failed waiting for hcpCluster="ephemeral-disk" in resourcegroup="ephemeral-osdisk-lq29kqkt9n82" to finish deleting, caused by: timeout '25.000000' minutes exceeded during DeleteHCPCluster for cluster ephemeral-disk in resource group ephemeral-osdisk-lq29kqkt9n82, error: context deadline exceeded
...
occurredERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
<*fmt.wrapError | 0xc0010f2580>:
failed to create HCP cluster oidc-wi-cluster: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-v96q89jj47wk" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/72daab77-8240-4076-a664-61b47746481d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/72daab77-8240-4076-a664-61b47746481d",
"name": "72daab77-8240-4076-a664-61b47746481d",
"status": "Failed",
"startTime": "2026-07-30T11:14:44.528119762Z",
"endTime": "2026-07-30T11:33:49.266559979Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:216]: failed to create HCP cluster oidc-wi-cluster
Unexpected error:
<*fmt.wrapError | 0xc0010f2580>:
failed to create HCP cluster oidc-wi-cluster: failed waiting for cluster="oidc-wi-cluster" in resourcegroup="oidc-wi-v96q89jj47wk" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/72daab77-8240-4076-a664-61b47746481d
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2euap/hcpOperationStatuses/72daab77-8240-4076-a664-61b47746481d",
"name": "72daab77-8240-4076-a664-61b47746481d",
"status": "Failed",
"startTime": "2026-07-30T11:14:44.528119762Z",
"endTime": "2026-07-30T11:33:49.266559979Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred |
|
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
e2e | failed | n/a | 1 | e2e (1)ERROR CODE: InternalServerError; detail message [clusterServiceClusterStatus] <no_message>; provider Microsoft.RedHatOpenShift Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:109]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
<*fmt.wrapError | 0xc000b1ede0>:
failed to create HCP cluster negative-tests-cluster: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-s9ztsrg6s8z8" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2/hcpOperationStatuses/c91435db-9a94-4c69-97ad-29629546f565
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2/hcpOperationStatuses/c91435db-9a94-4c69-97ad-29629546f565",
"name": "c91435db-9a94-4c69-97ad-29629546f565",
"status": "Failed",
"startTime": "2026-07-30T04:53:57.85626036Z",
"endTime": "2026-07-30T05:13:12.75339723Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:109]: failed to create HCP cluster negative-tests-cluster
Unexpected error:
<*fmt.wrapError | 0xc000b1ede0>:
failed to create HCP cluster negative-tests-cluster: failed waiting for cluster="negative-tests-cluster" in resourcegroup="rg-negative-tests-s9ztsrg6s8z8" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2/hcpOperationStatuses/c91435db-9a94-4c69-97ad-29629546f565
--------------------------------------------------------------------------------
RESPONSE 200: 200 OK
ERROR CODE: InternalServerError
--------------------------------------------------------------------------------
{
"id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/eastus2/hcpOperationStatuses/c91435db-9a94-4c69-97ad-29629546f565",
"name": "c91435db-9a94-4c69-97ad-29629546f565",
"status": "Failed",
"startTime": "2026-07-30T04:53:57.85626036Z",
"endTime": "2026-07-30T05:13:12.75339723Z",
"error": {
"code": "InternalServerError",
"message": "[clusterServiceClusterStatus] \u003cno_message\u003e"
}
}
--------------------------------------------------------------------------------
...
occurred |
|
| periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel post-goodmerged PR |
e2e | failed | n/a | 2 | e2e (2)failed to create service principal: create service principal: error status code received from the API Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:264]: failed to create app registration with service principal
Unexpected error:
<*fmt.wrapError | 0xc000e79e40>:
failed to create service principal: create service principal: error status code received from the API
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:264]: failed to create app registration with service principal
Unexpected error:
<*fmt.wrapError | 0xc000e79e40>:
failed to create service principal: create service principal: error status code received from the API
...
occurredfailed to create service principal: create service principal: error status code received from the API Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:127]: failed to create app registration with service principal
Unexpected error:
<*fmt.wrapError | 0xc000ca1f40>:
failed to create service principal: create service principal: error status code received from the API
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:127]: failed to create app registration with service principal
Unexpected error:
<*fmt.wrapError | 0xc000ca1f40>:
failed to create service principal: create service principal: error status code received from the API
...
occurred |
|
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
e2e | failed | n/a | 1 | e2e (1)tls: failed to verify certificate: x509: certificate signed by unknown authority Show raw failurefail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:186]: failed to verify simple web app runs on cluster "cluster-candidate-4-21-49z6mq"
Unexpected error:
<*fmt.wrapError | 0xc0004ae280>:
[strict TLS verification] route was never reachable: Get "https://agnhost-e2e-sample-app-sncqc.apps.aro.b8c0k3m1i2y1q5p.hsnv.eastus2.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
...
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:186]: failed to verify simple web app runs on cluster "cluster-candidate-4-21-49z6mq"
Unexpected error:
<*fmt.wrapError | 0xc0004ae280>:
[strict TLS verification] route was never reachable: Get "https://agnhost-e2e-sample-app-sncqc.apps.aro.b8c0k3m1i2y1q5p.hsnv.eastus2.aroapp-hcp.io": tls: failed to verify certificate: x509: certificate signed by unknown authority
...
occurred |
|
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a | |
| branch-ci-Azure-ARO-HCP-main-e2e-prod-e2e-parallel post-goodmerged PR |
n/a | passed | n/a | 0 | n/a |