CIHealth Run Log

Environment: STG

Time (UTC)	Runtime	Job	Region	Failed at	Result	PR	Failed tests	Details
23:34:29	37m 35s	branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	uksouth	e2e	failed	n/a	58	e2e (58) ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:82]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0012078e0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cluster-np-labels-taints-lsql8k" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-np-labels-taints-lsql8k/operationStatuses/08584113986461824979 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-9lbzntwzvchs/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-r6cuakilyx67k\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-14/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:82]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0012078e0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cluster-np-labels-taints-lsql8k" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-np-labels-taints-lsql8k/operationStatuses/08584113986461824979 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-9lbzntwzvchs/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-r6cuakilyx67k\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-14/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc0006ead40>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-g6c2l8pqzc65": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-g6c2l8pqzc65/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc0006ead40>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-g6c2l8pqzc65": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-g6c2l8pqzc65/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-22-b77rqs" with version 4.22.14 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000b2a3c0>: failed to create HCP cluster cluster-zstream-4-22-b77rqs: failed starting cluster creation "cluster-zstream-4-22-b77rqs" in resourcegroup="rg-zstream-upgrade-4-22-x86pcxvscv78": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-22-x86pcxvscv78/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-22-b77rqs -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-22-b77rqs" with version 4.22.14 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000b2a3c0>: failed to create HCP cluster cluster-zstream-4-22-b77rqs: failed starting cluster creation "cluster-zstream-4-22-b77rqs" in resourcegroup="rg-zstream-upgrade-4-22-x86pcxvscv78": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-22-x86pcxvscv78/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-22-b77rqs -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc000f1a280>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-zsl2zqg8d25s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-zsl2zqg8d25s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc000f1a280>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-zsl2zqg8d25s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-zsl2zqg8d25s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:107]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc000fa20e0>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-ng56lz7dl9cb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-ng56lz7dl9cb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:107]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc000fa20e0>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-ng56lz7dl9cb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-ng56lz7dl9cb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling and update the autoscaling configuration · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc000f8c120>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-qx726fw4j5rl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-qx726fw4j5rl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc000f8c120>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-qx726fw4j5rl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-qx726fw4j5rl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-20-wc8jdx" with version 4.20.38 on candidate channel Unexpected error: <fmt.wrapError \| 0xc0009e0640>: failed to create HCP cluster cluster-zstream-4-20-wc8jdx: failed starting cluster creation "cluster-zstream-4-20-wc8jdx" in resourcegroup="rg-zstream-upgrade-4-20-9dr7b9qsqclg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-9dr7b9qsqclg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-wc8jdx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-20-wc8jdx" with version 4.20.38 on candidate channel Unexpected error: <fmt.wrapError \| 0xc0009e0640>: failed to create HCP cluster cluster-zstream-4-20-wc8jdx: failed starting cluster creation "cluster-zstream-4-20-wc8jdx" in resourcegroup="rg-zstream-upgrade-4-20-9dr7b9qsqclg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-9dr7b9qsqclg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-wc8jdx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:78]: failed to create customer resources for external auth list test Unexpected error: <fmt.wrapError \| 0xc000a092e0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-ea-listxdjmk6-rp7t27" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-ea-listxdjmk6-rp7t27/operationStatuses/08584113987138459688 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-g8gfj6vr8skb/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-rlufqgosrjhbk\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-07/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:78]: failed to create customer resources for external auth list test Unexpected error: <fmt.wrapError \| 0xc000a092e0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-ea-listxdjmk6-rp7t27" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-ea-listxdjmk6-rp7t27/operationStatuses/08584113987138459688 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-g8gfj6vr8skb/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-rlufqgosrjhbk\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-07/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:283]: failed to create cluster customer resources for node-limit test Unexpected error: <fmt.wrapError \| 0xc000619cc0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-node-limit-cluster-fzl4fk" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-node-limit-cluster-fzl4fk/operationStatuses/08584113987139523817 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-23/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-brhj6q4dslz6/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-j6nw3ohx7bzo4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:283]: failed to create cluster customer resources for node-limit test Unexpected error: <fmt.wrapError \| 0xc000619cc0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-node-limit-cluster-fzl4fk" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-node-limit-cluster-fzl4fk/operationStatuses/08584113987139523817 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-23/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-brhj6q4dslz6/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-j6nw3ohx7bzo4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-21-97lxrpzvwp8t/cluster-candidate-4-21-mq5ksz should provision Unexpected error: <fmt.wrapError \| 0xc000982100>: failed to create HCP cluster cluster-candidate-4-21-mq5ksz: failed starting cluster creation "cluster-candidate-4-21-mq5ksz" in resourcegroup="rg-candidate-4-21-97lxrpzvwp8t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-21-97lxrpzvwp8t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-21-mq5ksz -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-21-97lxrpzvwp8t/cluster-candidate-4-21-mq5ksz should provision Unexpected error: <fmt.wrapError \| 0xc000982100>: failed to create HCP cluster cluster-candidate-4-21-mq5ksz: failed starting cluster creation "cluster-candidate-4-21-mq5ksz" in resourcegroup="rg-candidate-4-21-97lxrpzvwp8t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-21-97lxrpzvwp8t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-21-mq5ksz -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc0007d6fa0>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-n662f9vjlzcr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-n662f9vjlzcr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc0007d6fa0>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-n662f9vjlzcr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-n662f9vjlzcr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:136]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0001e4b80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-version-upgrade-cluster-42bbcr-vkf8rz" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-version-upgrade-cluster-42bbcr-vkf8rz/operationStatuses/08584113986227757596 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-42bbcr-2rk6t6mlf2lm/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-pgend26hbad42\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-02/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:136]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0001e4b80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-version-upgrade-cluster-42bbcr-vkf8rz" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-version-upgrade-cluster-42bbcr-vkf8rz/operationStatuses/08584113986227757596 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-42bbcr-2rk6t6mlf2lm/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-pgend26hbad42\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-02/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-22-hlvkx99zwmlc/cluster-candidate-4-22-wjv59w should provision Unexpected error: <fmt.wrapError \| 0xc00101a580>: failed to create HCP cluster cluster-candidate-4-22-wjv59w: failed starting cluster creation "cluster-candidate-4-22-wjv59w" in resourcegroup="rg-candidate-4-22-hlvkx99zwmlc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-22-hlvkx99zwmlc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-22-wjv59w -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-22-hlvkx99zwmlc/cluster-candidate-4-22-wjv59w should provision Unexpected error: <fmt.wrapError \| 0xc00101a580>: failed to create HCP cluster cluster-candidate-4-22-wjv59w: failed starting cluster creation "cluster-candidate-4-22-wjv59w" in resourcegroup="rg-candidate-4-22-hlvkx99zwmlc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-22-hlvkx99zwmlc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-22-wjv59w -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create a cluster and node pools with aggregated advanced features · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:208]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc000c94ac0>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-gtn8glz92n2v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-gtn8glz92n2v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:208]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc000c94ac0>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-gtn8glz92n2v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-gtn8glz92n2v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-23-sjhtzvzlt9l4/cluster-candidate-4-23-5ld87l should provision Unexpected error: <fmt.wrapError \| 0xc000f02240>: failed to create HCP cluster cluster-candidate-4-23-5ld87l: failed starting cluster creation "cluster-candidate-4-23-5ld87l" in resourcegroup="rg-candidate-4-23-sjhtzvzlt9l4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-23-sjhtzvzlt9l4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-23-5ld87l -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-23-sjhtzvzlt9l4/cluster-candidate-4-23-5ld87l should provision Unexpected error: <fmt.wrapError \| 0xc000f02240>: failed to create HCP cluster cluster-candidate-4-23-5ld87l: failed starting cluster creation "cluster-candidate-4-23-5ld87l" in resourcegroup="rg-candidate-4-23-sjhtzvzlt9l4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-23-sjhtzvzlt9l4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-23-5ld87l -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:85]: failed to create customer resources for external auth cluster Unexpected error: <fmt.wrapError \| 0xc000c1e3a0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-ea-cluster-66dgzj" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-ea-cluster-66dgzj/operationStatuses/08584113987138933581 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-kvx8wtp49bjz/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-ltdphft7fgrwg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-03/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:85]: failed to create customer resources for external auth cluster Unexpected error: <fmt.wrapError \| 0xc000c1e3a0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-ea-cluster-66dgzj" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-ea-cluster-66dgzj/operationStatuses/08584113987138933581 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-kvx8wtp49bjz/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-ltdphft7fgrwg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-03/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000d80380>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-fxmxrgw75sbn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-fxmxrgw75sbn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000d80380>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-fxmxrgw75sbn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-fxmxrgw75sbn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to delete an HCP cluster whose managed identities were deleted first · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000c825a0>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-xxnn2gk7lrb2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-xxnn2gk7lrb2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000c825a0>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-xxnn2gk7lrb2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-xxnn2gk7lrb2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:106]: failed to create customer resources for z-stream cluster "cluster-zstream-4-21-xcgpz6" Unexpected error: <fmt.wrapError \| 0xc000f00c80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cluster-zstream-4-21-xcgpz6-4zrvmh" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-21-xcgpz6-4zrvmh/operationStatuses/08584113987705963996 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-02/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:106]: failed to create customer resources for z-stream cluster "cluster-zstream-4-21-xcgpz6" Unexpected error: <fmt.wrapError \| 0xc000f00c80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cluster-zstream-4-21-xcgpz6-4zrvmh" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cluster-zstream-4-21-xcgpz6-4zrvmh/operationStatuses/08584113987705963996 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-02/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000712140>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-cl52xgnhc4wx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-cl52xgnhc4wx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000712140>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-cl52xgnhc4wx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-cl52xgnhc4wx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-5-0-dm79nndfl6r5/cluster-candidate-5-0-x7bgf9 should provision Unexpected error: <fmt.wrapError \| 0xc00184e0e0>: failed to create HCP cluster cluster-candidate-5-0-x7bgf9: failed starting cluster creation "cluster-candidate-5-0-x7bgf9" in resourcegroup="rg-candidate-5-0-dm79nndfl6r5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-dm79nndfl6r5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-5-0-x7bgf9 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-5-0-dm79nndfl6r5/cluster-candidate-5-0-x7bgf9 should provision Unexpected error: <fmt.wrapError \| 0xc00184e0e0>: failed to create HCP cluster cluster-candidate-5-0-x7bgf9: failed starting cluster creation "cluster-candidate-5-0-x7bgf9" in resourcegroup="rg-candidate-5-0-dm79nndfl6r5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-dm79nndfl6r5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-5-0-x7bgf9 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.20 minor to 4.21 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-4-21-jrrftk" Unexpected error: <fmt.wrapError \| 0xc000da6360>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-4-21-jrrftk-g7vqn6" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-4-21-jrrftk-g7vqn6/operationStatuses/08584113987434500608 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-l442rxkb7vdp/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-mpj57e7od7fwq\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-13/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-4-21-jrrftk" Unexpected error: <fmt.wrapError \| 0xc000da6360>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-4-21-jrrftk-g7vqn6" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-4-21-jrrftk-g7vqn6/operationStatuses/08584113987434500608 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-l442rxkb7vdp/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-mpj57e7od7fwq\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-13/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.21 minor to 4.22 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-4-22-vvgtcx" Unexpected error: <fmt.wrapError \| 0xc000d7cb00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-4-22-vvgtcx-tmrhxj" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-4-22-vvgtcx-tmrhxj/operationStatuses/08584113987427336698 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-18/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-dpmbrwp9fml7/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-mem35qo2kwqbg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-4-22-vvgtcx" Unexpected error: <fmt.wrapError \| 0xc000d7cb00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-4-22-vvgtcx-tmrhxj" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-4-22-vvgtcx-tmrhxj/operationStatuses/08584113987427336698 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-18/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-dpmbrwp9fml7/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-mem35qo2kwqbg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:136]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc001120500>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-version-upgrade-cluster-swjhtx-jx27v7" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-version-upgrade-cluster-swjhtx-jx27v7/operationStatuses/08584113986224996378 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-04/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-swjhtx-nll5kh9rqz25/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-sfpatc6wjwnlg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:136]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc001120500>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-version-upgrade-cluster-swjhtx-jx27v7" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-version-upgrade-cluster-swjhtx-jx27v7/operationStatuses/08584113986224996378 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-04/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-swjhtx-nll5kh9rqz25/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-sfpatc6wjwnlg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:91]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc000fec1e0>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-t4c48wqpwt72": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-t4c48wqpwt72/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:91]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc000fec1e0>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-t4c48wqpwt72": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-t4c48wqpwt72/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:101]: failed to begin creating HCP cluster "admin-cred-lifecycle-v7kjhv" Unexpected error: <fmt.wrapError \| 0xc000d905c0>: failed starting cluster creation "admin-cred-lifecycle-v7kjhv" in resourcegroup="admin-credential-lifecycle-test-qws7j9zzgwzk": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-qws7j9zzgwzk/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-v7kjhv -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:101]: failed to begin creating HCP cluster "admin-cred-lifecycle-v7kjhv" Unexpected error: <fmt.wrapError \| 0xc000d905c0>: failed starting cluster creation "admin-cred-lifecycle-v7kjhv" in resourcegroup="admin-credential-lifecycle-test-qws7j9zzgwzk": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-qws7j9zzgwzk/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-v7kjhv -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:90]: failed to create customer resources for IDMS cluster Unexpected error: <fmt.wrapError \| 0xc000f8ef20>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-idms-e2e-hcp-cluster-f4gj82" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-idms-e2e-hcp-cluster-f4gj82/operationStatuses/08584113987063020089 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-08/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-j8rcf7j8sc84/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-lv7dvzspd2e5i\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:90]: failed to create customer resources for IDMS cluster Unexpected error: <fmt.wrapError \| 0xc000f8ef20>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-idms-e2e-hcp-cluster-f4gj82" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-idms-e2e-hcp-cluster-f4gj82/operationStatuses/08584113987063020089 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-08/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-j8rcf7j8sc84/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-lv7dvzspd2e5i\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:291]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc00101b980>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-noedge-6qq489-c5jsdg" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-noedge-6qq489-c5jsdg/operationStatuses/08584113985901622419 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-19/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-noedge-6qq489-tpss6kb9nfnv/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-yslh3n7rfjni4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:291]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc00101b980>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-noedge-6qq489-c5jsdg" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-noedge-6qq489-c5jsdg/operationStatuses/08584113985901622419 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-19/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-noedge-6qq489-tpss6kb9nfnv/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-yslh3n7rfjni4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc000c9a2e0>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-pptmdm5h47tr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-pptmdm5h47tr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc000c9a2e0>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-pptmdm5h47tr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-pptmdm5h47tr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc000e923f0>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-z5x8hr8lv45s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc000e923f0>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-z5x8hr8lv45s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:79]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0007876a0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-disabled-image-registry-hcp-cluster-lrqgv6" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-disabled-image-registry-hcp-cluster-lrqgv6/operationStatuses/08584113987055376578 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-09/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-xh4nq445fjw9/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-qmh74zogaodhg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:79]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0007876a0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-disabled-image-registry-hcp-cluster-lrqgv6" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-disabled-image-registry-hcp-cluster-lrqgv6/operationStatuses/08584113987055376578 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-09/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-xh4nq445fjw9/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-qmh74zogaodhg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to cordon, drain, and uncordon a node in an HCP cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:80]: failed to create cluster customer resources for cordon test Unexpected error: <fmt.wrapError \| 0xc00032e320>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cordon-hcp-cluster-rnbmsq" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cordon-hcp-cluster-rnbmsq/operationStatuses/08584113987137499225 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-24/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-wcgtvsqfsxxx/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-3wbuyr3ac6kzo\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:80]: failed to create cluster customer resources for cordon test Unexpected error: <fmt.wrapError \| 0xc00032e320>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cordon-hcp-cluster-rnbmsq" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cordon-hcp-cluster-rnbmsq/operationStatuses/08584113987137499225 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-24/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-wcgtvsqfsxxx/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-3wbuyr3ac6kzo\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc00180e180>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-47vf99jdbhj4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-47vf99jdbhj4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc00180e180>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-47vf99jdbhj4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-47vf99jdbhj4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc00051f700>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-mf589sk4rj9r": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-mf589sk4rj9r/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc00051f700>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-mf589sk4rj9r": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-mf589sk4rj9r/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:570]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc001026280>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-downgrade-shn7fn-zvxvfc" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-downgrade-shn7fn-zvxvfc/operationStatuses/08584113985869276090 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-shn7fn-psrg7w9f9xgl/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-ev3yo2onirsd6\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:570]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc001026280>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-downgrade-shn7fn-zvxvfc" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-downgrade-shn7fn-zvxvfc/operationStatuses/08584113985869276090 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-shn7fn-psrg7w9f9xgl/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-ev3yo2onirsd6\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc000c18180>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-bwh9fhw68vj7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-bwh9fhw68vj7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc000c18180>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-bwh9fhw68vj7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-bwh9fhw68vj7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to issue the default ingress serving certificate from Let's Encrypt using cert-manager with ACME DNS-01 challenges · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000e04180>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-zwxh6x2kssck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-zwxh6x2kssck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000e04180>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-zwxh6x2kssck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-zwxh6x2kssck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc0005d3560>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-d7mvztslkt8z": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-d7mvztslkt8z/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc0005d3560>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-d7mvztslkt8z": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-d7mvztslkt8z/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc001092280>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-f5hpwzxskrlb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-f5hpwzxskrlb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc001092280>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-f5hpwzxskrlb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-f5hpwzxskrlb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:268]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000c1cc00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-shoebox-hcp-cluster-w9k5pm" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-shoebox-hcp-cluster-w9k5pm/operationStatuses/08584113985685912165 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-v8ln66whgcfk/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-22eudp3sazqeq\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-08/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:268]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000c1cc00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-shoebox-hcp-cluster-w9k5pm" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-shoebox-hcp-cluster-w9k5pm/operationStatuses/08584113985685912165 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-v8ln66whgcfk/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-22eudp3sazqeq\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-08/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to list available HCP OpenShift versions and validate response content · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc000e81a40>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc000e81a40>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:99]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc00098eaa0>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-9fk2x7xsncqp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-9fk2x7xsncqp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:99]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc00098eaa0>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-9fk2x7xsncqp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-9fk2x7xsncqp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:83]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000bfaac0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-negative-tests-cluster-t75xkk" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-negative-tests-cluster-t75xkk/operationStatuses/08584113985598746400 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-xrwtbrzrms4p/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-oeayaalhj7wjy\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-03/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:83]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000bfaac0>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-negative-tests-cluster-t75xkk" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-negative-tests-cluster-t75xkk/operationStatuses/08584113985598746400 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-xrwtbrzrms4p/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-oeayaalhj7wjy\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-03/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test FIPS Mode Support with v2026-09-01 API should create an HCP cluster with FIPS mode enabled via cryptoRestrictions property · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc000984920>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-zmq2fmksvd6w": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-zmq2fmksvd6w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc000984920>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-zmq2fmksvd6w": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-zmq2fmksvd6w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:93]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000c0ae00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-autoscale-cluster-djz46v" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-autoscale-cluster-djz46v/operationStatuses/08584113987138680420 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-wpsbhgpdgqb8/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-ssrwqrnhyyabs\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-22/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:93]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000c0ae00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-autoscale-cluster-djz46v" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-autoscale-cluster-djz46v/operationStatuses/08584113987138680420 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-wpsbhgpdgqb8/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-ssrwqrnhyyabs\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-22/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:75]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000ba8c00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-ephemeral-disk-5x6zpb" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-ephemeral-disk-5x6zpb/operationStatuses/08584113986762247712 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-cplcmv2sq2w7/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-6xts4ycasve7q\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-06/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:75]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000ba8c00>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-ephemeral-disk-5x6zpb" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-ephemeral-disk-5x6zpb/operationStatuses/08584113986762247712 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-cplcmv2sq2w7/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-6xts4ycasve7q\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-06/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.22 minor to 5.0 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-5-0-nmd797" Unexpected error: <fmt.wrapError \| 0xc001752920>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-5-0-nmd797-bjjz9t" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-5-0-nmd797-bjjz9t/operationStatuses/08584113987415585751 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-20/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-qtbdqjphjldj/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-xfkchgv3ef7bk\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-5-0-nmd797" Unexpected error: <fmt.wrapError \| 0xc001752920>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-5-0-nmd797-bjjz9t" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-5-0-nmd797-bjjz9t/operationStatuses/08584113987415585751 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-20/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-qtbdqjphjldj/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-xfkchgv3ef7bk\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-45rstd with version 4.20.39 Unexpected error: <fmt.wrapError \| 0xc000902360>: failed to create HCP cluster np-version-upgrade-cluster-45rstd: failed starting cluster creation "np-version-upgrade-cluster-45rstd" in resourcegroup="rg-np-version-upgrade-45rstd-nh6m8src8lfr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-45rstd-nh6m8src8lfr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-45rstd -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-45rstd with version 4.20.39 Unexpected error: <fmt.wrapError \| 0xc000902360>: failed to create HCP cluster np-version-upgrade-cluster-45rstd: failed starting cluster creation "np-version-upgrade-cluster-45rstd" in resourcegroup="rg-np-version-upgrade-45rstd-nh6m8src8lfr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-45rstd-nh6m8src8lfr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-45rstd -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should create a cluster with private ingress using v20260901preview and verify the ingress is internal · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc0012820e0>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-nbwkpxzhms7s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-nbwkpxzhms7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc0012820e0>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-nbwkpxzhms7s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-nbwkpxzhms7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-5-0-ntq4zw" with version 5.0.0-rc.2 on candidate channel Unexpected error: <fmt.wrapError \| 0xc0011ce260>: failed to create HCP cluster cluster-zstream-5-0-ntq4zw: failed starting cluster creation "cluster-zstream-5-0-ntq4zw" in resourcegroup="rg-zstream-upgrade-5-0-hqk75qtw9hlt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-5-0-hqk75qtw9hlt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-5-0-ntq4zw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-5-0-ntq4zw" with version 5.0.0-rc.2 on candidate channel Unexpected error: <fmt.wrapError \| 0xc0011ce260>: failed to create HCP cluster cluster-zstream-5-0-ntq4zw: failed starting cluster creation "cluster-zstream-5-0-ntq4zw" in resourcegroup="rg-zstream-upgrade-5-0-hqk75qtw9hlt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-5-0-hqk75qtw9hlt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-5-0-ntq4zw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:218]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000b04c80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-oidc-wi-cluster-2jwn4b" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-oidc-wi-cluster-2jwn4b/operationStatuses/08584113985700308617 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-23/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-rczl9wf28lwt/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-s6kwp7xg43dbi\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:218]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000b04c80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-oidc-wi-cluster-2jwn4b" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-oidc-wi-cluster-2jwn4b/operationStatuses/08584113985700308617 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-23/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-rczl9wf28lwt/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-s6kwp7xg43dbi\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000d10500>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-l44lntsvmpb8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-l44lntsvmpb8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000d10500>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-l44lntsvmpb8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-l44lntsvmpb8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test Customer should create a cluster using v20260901preview API and verify cluster health · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc00111e320>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-4bqqhnwdh8r5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-4bqqhnwdh8r5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc00111e320>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-4bqqhnwdh8r5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-4bqqhnwdh8r5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:431]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000408980>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-skip-minor-z8pbtk-44k8bq" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-skip-minor-z8pbtk-44k8bq/operationStatuses/08584113985924298427 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-z8pbtk-p9lrjqz5xlmf/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-a44nzwnsonewu\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-18/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:431]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc000408980>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-skip-minor-z8pbtk-44k8bq" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-skip-minor-z8pbtk-44k8bq/operationStatuses/08584113985924298427 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-z8pbtk-p9lrjqz5xlmf/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-a44nzwnsonewu\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-18/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to delete a nodepool · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:71]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc001180e80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-delete-hcp-cluster-rdm6f7" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-delete-hcp-cluster-rdm6f7/operationStatuses/08584113987041544035 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-05/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-pxh9tsgnpxwk/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-rcpnvqrcxdqmo\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:71]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc001180e80>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-delete-hcp-cluster-rdm6f7" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-delete-hcp-cluster-rdm6f7/operationStatuses/08584113987041544035 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-05/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-pxh9tsgnpxwk/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-rcpnvqrcxdqmo\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:34:29 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-20-6sv9qtzkp7p5/cluster-candidate-4-20-k9rjvx should provision Unexpected error: <fmt.wrapError \| 0xc000d46cc0>: failed to create HCP cluster cluster-candidate-4-20-k9rjvx: failed starting cluster creation "cluster-candidate-4-20-k9rjvx" in resourcegroup="rg-candidate-4-20-6sv9qtzkp7p5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-6sv9qtzkp7p5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-20-k9rjvx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-20-6sv9qtzkp7p5/cluster-candidate-4-20-k9rjvx should provision Unexpected error: <fmt.wrapError \| 0xc000d46cc0>: failed to create HCP cluster cluster-candidate-4-20-k9rjvx: failed starting cluster creation "cluster-candidate-4-20-k9rjvx" in resourcegroup="rg-candidate-4-20-6sv9qtzkp7p5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-6sv9qtzkp7p5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-20-k9rjvx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.22.zLatest to 4.20.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:710]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0006d0900>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-dg-minor-z4tc6h-tk4t87" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-dg-minor-z4tc6h-tk4t87/operationStatuses/08584113985739549250 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-24/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-z4tc6h-rxbv2s7dz2bg/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-h2mxcxvipvybg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:710]: failed to create cluster customer resources Unexpected error: <fmt.wrapError \| 0xc0006d0900>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-np-dg-minor-z4tc6h-tk4t87" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-np-dg-minor-z4tc6h-tk4t87/operationStatuses/08584113985739549250 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-24/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-z4tc6h-rxbv2s7dz2bg/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-h2mxcxvipvybg\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: DeploymentFailed; detail code RoleAssignmentLimitExceeded; detail message No more role assignments can be created. 23:34:29 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.22 minor to 4.23 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-4-23-t78srk" Unexpected error: <fmt.wrapError \| 0xc0015fbe20>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-4-23-t78srk-ftnpvj" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-4-23-t78srk-ftnpvj/operationStatuses/08584113987507742946 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-19/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-23-v9krnbjlzvgl/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-gdp5fqxbc7uf4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:123]: failed to create customer resources for y-stream upgrade cluster "cp-ystream-upgrade-4-23-t78srk" Unexpected error: <fmt.wrapError \| 0xc0015fbe20>: failed to create managed identities: failed to create managed identities: failed waiting for deployment "mi-cp-ystream-upgrade-4-23-t78srk-ftnpvj" at subscription scope to finish: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Resources/deployments/mi-cp-ystream-upgrade-4-23-t78srk-ftnpvj/operationStatuses/08584113987507742946 -------------------------------------------------------------------------------- RESPONSE 200: 200 OK ERROR CODE: DeploymentFailed -------------------------------------------------------------------------------- { "status": "Failed", "error": { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.", "details": [ { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-msi-container-stg-shard0-00-19/providers/Microsoft.Resources/deployments/pooledMsiScopedAssignments\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" }, { "code": "Conflict", "message": "{\r\n \"status\": \"Failed\",\r\n \"error\": {\r\n \"code\": \"ResourceDeploymentFailure\",\r\n \"message\": \"The resource write operation failed to complete successfully, because it reached terminal provisioning state 'Failed'.\",\r\n \"details\": [\r\n {\r\n \"code\": \"DeploymentFailed\",\r\n \"target\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-23-v9krnbjlzvgl/providers/Microsoft.Resources/deployments/pooledNonMsiScopedAssignments-gdp5fqxbc7uf4\",\r\n \"message\": \"At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.\",\r\n \"details\": [\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n },\r\n {\r\n \"code\": \"RoleAssignmentLimitExceeded\",\r\n \"message\": \"No more role assignments can be created.\"\r\n }\r\n ]\r\n }\r\n ]\r\n }\r\n}" } ] } } -------------------------------------------------------------------------------- ... occurred
23:00:13	15m 1s	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel-ocp-nightly post-goodmerged PR No additional run metadata captured	uksouth	e2e	failed	n/a	52	e2e (52) ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapError \| 0xc00039efc0>: failed to create HCP cluster negative-tests-cluster: failed starting cluster creation "negative-tests-cluster" in resourcegroup="rg-negative-tests-t9ljlvhpqrl2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-t9ljlvhpqrl2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapError \| 0xc00039efc0>: failed to create HCP cluster negative-tests-cluster: failed starting cluster creation "negative-tests-cluster" in resourcegroup="rg-negative-tests-t9ljlvhpqrl2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-t9ljlvhpqrl2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc000f4a300>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-wk479hrrr6dd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-wk479hrrr6dd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc000f4a300>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-wk479hrrr6dd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-wk479hrrr6dd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:107]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc000a0c280>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-n2mwb88rc2kc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-n2mwb88rc2kc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:107]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc000a0c280>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-n2mwb88rc2kc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-n2mwb88rc2kc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:99]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc0004d5960>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-z4z66hnzq25r": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-z4z66hnzq25r/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:99]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc0004d5960>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-z4z66hnzq25r": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-z4z66hnzq25r/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to list available HCP OpenShift versions and validate response content · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc0015bb5f0>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc0015bb5f0>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.22 minor to 5.0 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-0-gvq7bc" at install version 4.22.0-0.nightly-multi-2026-09-23-151735 Unexpected error: <fmt.wrapError \| 0xc000c2e580>: failed to create HCP cluster cp-ystream-upgrade-5-0-gvq7bc: failed starting cluster creation "cp-ystream-upgrade-5-0-gvq7bc" in resourcegroup="rg-cp-ystream-upgrade-5-0-5gq89l7l9zj4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-5gq89l7l9zj4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-0-gvq7bc -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-0-gvq7bc" at install version 4.22.0-0.nightly-multi-2026-09-23-151735 Unexpected error: <fmt.wrapError \| 0xc000c2e580>: failed to create HCP cluster cp-ystream-upgrade-5-0-gvq7bc: failed starting cluster creation "cp-ystream-upgrade-5-0-gvq7bc" in resourcegroup="rg-cp-ystream-upgrade-5-0-5gq89l7l9zj4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-5gq89l7l9zj4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-0-gvq7bc -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000b582e0>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-blllqrwdhwg2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-blllqrwdhwg2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000b582e0>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-blllqrwdhwg2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-blllqrwdhwg2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000f10140>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-jrntrv2b4mzw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-jrntrv2b4mzw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000f10140>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-jrntrv2b4mzw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-jrntrv2b4mzw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should create a cluster with private ingress using v20260901preview and verify the ingress is internal · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc000f12180>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-j75pdr9hg97t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-j75pdr9hg97t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc000f12180>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-j75pdr9hg97t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-j75pdr9hg97t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc001072140>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-5v7nmx4glfms": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-5v7nmx4glfms/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc001072140>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-5v7nmx4glfms": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-5v7nmx4glfms/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:87]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapError \| 0xc000f14640>: failed to create HCP cluster ea-list9flw4f: failed starting cluster creation "ea-list9flw4f" in resourcegroup="ea-list-89wl2cn26v96": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-89wl2cn26v96/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-list9flw4f -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:87]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapError \| 0xc000f14640>: failed to create HCP cluster ea-list9flw4f: failed starting cluster creation "ea-list9flw4f" in resourcegroup="ea-list-89wl2cn26v96": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-89wl2cn26v96/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-list9flw4f -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.21 minor to 4.22 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-rckglw" at install version 4.21.0-0.nightly-multi-2026-09-23-170748 Unexpected error: <fmt.wrapError \| 0xc00069a7a0>: failed to create HCP cluster cp-ystream-upgrade-4-22-rckglw: failed starting cluster creation "cp-ystream-upgrade-4-22-rckglw" in resourcegroup="rg-cp-ystream-upgrade-4-22-7mwhqknsl2vx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-7mwhqknsl2vx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-22-rckglw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-rckglw" at install version 4.21.0-0.nightly-multi-2026-09-23-170748 Unexpected error: <fmt.wrapError \| 0xc00069a7a0>: failed to create HCP cluster cp-ystream-upgrade-4-22-rckglw: failed starting cluster creation "cp-ystream-upgrade-4-22-rckglw" in resourcegroup="rg-cp-ystream-upgrade-4-22-7mwhqknsl2vx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-7mwhqknsl2vx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-22-rckglw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc000f166c0>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-fzxrb9z9hsxg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-fzxrb9z9hsxg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc000f166c0>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-fzxrb9z9hsxg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-fzxrb9z9hsxg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 5.0 minor to 5.1 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-1-92b6l7" at install version 5.0.0-0.nightly-multi-2026-09-23-031212 Unexpected error: <fmt.wrapError \| 0xc000e642c0>: failed to create HCP cluster cp-ystream-upgrade-5-1-92b6l7: failed starting cluster creation "cp-ystream-upgrade-5-1-92b6l7" in resourcegroup="rg-cp-ystream-upgrade-5-1-8pm7wghtpk6v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-1-8pm7wghtpk6v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-1-92b6l7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-1-92b6l7" at install version 5.0.0-0.nightly-multi-2026-09-23-031212 Unexpected error: <fmt.wrapError \| 0xc000e642c0>: failed to create HCP cluster cp-ystream-upgrade-5-1-92b6l7: failed starting cluster creation "cp-ystream-upgrade-5-1-92b6l7" in resourcegroup="rg-cp-ystream-upgrade-5-1-8pm7wghtpk6v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-1-8pm7wghtpk6v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-1-92b6l7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:441]: failed to create HCP cluster np-skip-minor-fqch49 at version 4.22.0-0.nightly-multi-2026-09-23-151735 Unexpected error: <fmt.wrapError \| 0xc000d9c380>: failed to create HCP cluster np-skip-minor-fqch49: failed starting cluster creation "np-skip-minor-fqch49" in resourcegroup="rg-np-skip-minor-fqch49-rrvslkw6xp2h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-fqch49-rrvslkw6xp2h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-fqch49 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:441]: failed to create HCP cluster np-skip-minor-fqch49 at version 4.22.0-0.nightly-multi-2026-09-23-151735 Unexpected error: <fmt.wrapError \| 0xc000d9c380>: failed to create HCP cluster np-skip-minor-fqch49: failed starting cluster creation "np-skip-minor-fqch49" in resourcegroup="rg-np-skip-minor-fqch49-rrvslkw6xp2h": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-fqch49-rrvslkw6xp2h/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-fqch49 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc000b5a2a0>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-gfwfk6s8b9j2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-gfwfk6s8b9j2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc000b5a2a0>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-gfwfk6s8b9j2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-gfwfk6s8b9j2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapError \| 0xc000912300>: failed to create HCP cluster disabled-image-registry-hcp-cluster: failed starting cluster creation "disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-nmfgpbvxrwtl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-nmfgpbvxrwtl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapError \| 0xc000912300>: failed to create HCP cluster disabled-image-registry-hcp-cluster: failed starting cluster creation "disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-nmfgpbvxrwtl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-nmfgpbvxrwtl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc0010d8200>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-fs6xcx4wqfx6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-fs6xcx4wqfx6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc0010d8200>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-fs6xcx4wqfx6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-fs6xcx4wqfx6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:227]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapError \| 0xc000f16180>: failed to create HCP cluster oidc-wi-cluster: failed starting cluster creation "oidc-wi-cluster" in resourcegroup="oidc-wi-p4696z94nm5m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-p4696z94nm5m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:227]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapError \| 0xc000f16180>: failed to create HCP cluster oidc-wi-cluster: failed starting cluster creation "oidc-wi-cluster" in resourcegroup="oidc-wi-p4696z94nm5m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-p4696z94nm5m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:84]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapError \| 0xc001522260>: failed to create HCP cluster ephemeral-disk: failed starting cluster creation "ephemeral-disk" in resourcegroup="ephemeral-osdisk-97cn59jkhhl4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-97cn59jkhhl4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:84]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapError \| 0xc001522260>: failed to create HCP cluster ephemeral-disk: failed starting cluster creation "ephemeral-disk" in resourcegroup="ephemeral-osdisk-97cn59jkhhl4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-97cn59jkhhl4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create a cluster and node pools with aggregated advanced features · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:208]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc0008d7280>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-v6cldcx5jl9f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-v6cldcx5jl9f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:208]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc0008d7280>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-v6cldcx5jl9f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-v6cldcx5jl9f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc000fe2120>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-tq7lzxq6ld4m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-tq7lzxq6ld4m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc000fe2120>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-tq7lzxq6ld4m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-tq7lzxq6ld4m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to cordon, drain, and uncordon a node in an HCP cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:90]: failed to create HCP cluster cordon-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000f9c2a0>: failed to create HCP cluster cordon-hcp-cluster: failed starting cluster creation "cordon-hcp-cluster" in resourcegroup="rg-cordon-test-xq29bq2p4r67": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-xq29bq2p4r67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cordon-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:90]: failed to create HCP cluster cordon-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000f9c2a0>: failed to create HCP cluster cordon-hcp-cluster: failed starting cluster creation "cordon-hcp-cluster" in resourcegroup="rg-cordon-test-xq29bq2p4r67": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-xq29bq2p4r67/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cordon-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.23 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-23-t2bxq8nv5246/cluster-nightly-4-23-p9fb96 should provision Unexpected error: <fmt.wrapError \| 0xc000b28880>: failed to create HCP cluster cluster-nightly-4-23-p9fb96: failed starting cluster creation "cluster-nightly-4-23-p9fb96" in resourcegroup="rg-nightly-4-23-t2bxq8nv5246": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-23-t2bxq8nv5246/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-23-p9fb96 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-23-t2bxq8nv5246/cluster-nightly-4-23-p9fb96 should provision Unexpected error: <fmt.wrapError \| 0xc000b28880>: failed to create HCP cluster cluster-nightly-4-23-p9fb96: failed starting cluster creation "cluster-nightly-4-23-p9fb96" in resourcegroup="rg-nightly-4-23-t2bxq8nv5246": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-23-t2bxq8nv5246/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-23-p9fb96 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:92]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapError \| 0xc0008843e0>: failed to create HCP cluster cluster-np-labels-taints: failed starting cluster creation "cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-74cvpvwnrmg8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-74cvpvwnrmg8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:92]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapError \| 0xc0008843e0>: failed to create HCP cluster cluster-np-labels-taints: failed starting cluster creation "cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-74cvpvwnrmg8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-74cvpvwnrmg8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:91]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc000d265e0>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-jwdzg46qwq7w": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwdzg46qwq7w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:91]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc000d265e0>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-jwdzg46qwq7w": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-jwdzg46qwq7w/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling and update the autoscaling configuration · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc000457f20>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-dbdgjlmvwgtx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-dbdgjlmvwgtx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc000457f20>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-dbdgjlmvwgtx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-dbdgjlmvwgtx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-0-npwjgprz6msl/cluster-nightly-5-0-hfdrrw should provision Unexpected error: <fmt.wrapError \| 0xc00108e140>: failed to create HCP cluster cluster-nightly-5-0-hfdrrw: failed starting cluster creation "cluster-nightly-5-0-hfdrrw" in resourcegroup="rg-nightly-5-0-npwjgprz6msl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-5-0-npwjgprz6msl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-5-0-hfdrrw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-0-npwjgprz6msl/cluster-nightly-5-0-hfdrrw should provision Unexpected error: <fmt.wrapError \| 0xc00108e140>: failed to create HCP cluster cluster-nightly-5-0-hfdrrw: failed starting cluster creation "cluster-nightly-5-0-hfdrrw" in resourcegroup="rg-nightly-5-0-npwjgprz6msl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-5-0-npwjgprz6msl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-5-0-hfdrrw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:94]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapError \| 0xc000736180>: failed to create HCP cluster ea-cluster: failed starting cluster creation "ea-cluster" in resourcegroup="external-auth-cluster-kszfsz4kjdp5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-kszfsz4kjdp5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:94]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapError \| 0xc000736180>: failed to create HCP cluster ea-cluster: failed starting cluster creation "ea-cluster" in resourcegroup="external-auth-cluster-kszfsz4kjdp5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-kszfsz4kjdp5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapError \| 0xc0009c0160>: failed to create HCP cluster idms-e2e-hcp-cluster: failed starting cluster creation "idms-e2e-hcp-cluster" in resourcegroup="idms-khv8dvr7ks7m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-khv8dvr7ks7m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapError \| 0xc0009c0160>: failed to create HCP cluster idms-e2e-hcp-cluster: failed starting cluster creation "idms-e2e-hcp-cluster" in resourcegroup="idms-khv8dvr7ks7m": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-khv8dvr7ks7m/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-21-9xw8wplswg6p/cluster-nightly-4-21-4bm8nq should provision Unexpected error: <fmt.wrapError \| 0xc000a941c0>: failed to create HCP cluster cluster-nightly-4-21-4bm8nq: failed starting cluster creation "cluster-nightly-4-21-4bm8nq" in resourcegroup="rg-nightly-4-21-9xw8wplswg6p": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-21-9xw8wplswg6p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-21-4bm8nq -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-21-9xw8wplswg6p/cluster-nightly-4-21-4bm8nq should provision Unexpected error: <fmt.wrapError \| 0xc000a941c0>: failed to create HCP cluster cluster-nightly-4-21-4bm8nq: failed starting cluster creation "cluster-nightly-4-21-4bm8nq" in resourcegroup="rg-nightly-4-21-9xw8wplswg6p": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-21-9xw8wplswg6p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-21-4bm8nq -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.22 minor to 4.23 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-23-c65rwd" at install version 4.22.0-0.nightly-multi-2026-09-23-151735 Unexpected error: <fmt.wrapError \| 0xc000e162c0>: failed to create HCP cluster cp-ystream-upgrade-4-23-c65rwd: failed starting cluster creation "cp-ystream-upgrade-4-23-c65rwd" in resourcegroup="rg-cp-ystream-upgrade-4-23-xc5ljtzh9ws2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-23-xc5ljtzh9ws2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-23-c65rwd -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-23-c65rwd" at install version 4.22.0-0.nightly-multi-2026-09-23-151735 Unexpected error: <fmt.wrapError \| 0xc000e162c0>: failed to create HCP cluster cp-ystream-upgrade-4-23-c65rwd: failed starting cluster creation "cp-ystream-upgrade-4-23-c65rwd" in resourcegroup="rg-cp-ystream-upgrade-4-23-xc5ljtzh9ws2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-23-xc5ljtzh9ws2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-23-c65rwd -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 5.1 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-1-vdm9fjw2dttb/cluster-nightly-5-1-v74km7 should provision Unexpected error: <fmt.wrapError \| 0xc000c25980>: failed to create HCP cluster cluster-nightly-5-1-v74km7: failed starting cluster creation "cluster-nightly-5-1-v74km7" in resourcegroup="rg-nightly-5-1-vdm9fjw2dttb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-5-1-vdm9fjw2dttb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-5-1-v74km7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-5-1-vdm9fjw2dttb/cluster-nightly-5-1-v74km7 should provision Unexpected error: <fmt.wrapError \| 0xc000c25980>: failed to create HCP cluster cluster-nightly-5-1-v74km7: failed starting cluster creation "cluster-nightly-5-1-v74km7" in resourcegroup="rg-nightly-5-1-vdm9fjw2dttb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-5-1-vdm9fjw2dttb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-5-1-v74km7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:272]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000b182c0>: failed to create HCP cluster shoebox-hcp-cluster: failed starting cluster creation "shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-p2sz9v5k8jtd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-p2sz9v5k8jtd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/shoebox-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:272]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000b182c0>: failed to create HCP cluster shoebox-hcp-cluster: failed starting cluster creation "shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-p2sz9v5k8jtd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-p2sz9v5k8jtd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/shoebox-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-22-bgpnp8wsw6xn/cluster-nightly-4-22-ld22vq should provision Unexpected error: <fmt.wrapError \| 0xc000f241c0>: failed to create HCP cluster cluster-nightly-4-22-ld22vq: failed starting cluster creation "cluster-nightly-4-22-ld22vq" in resourcegroup="rg-nightly-4-22-bgpnp8wsw6xn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-22-bgpnp8wsw6xn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-22-ld22vq -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-22-bgpnp8wsw6xn/cluster-nightly-4-22-ld22vq should provision Unexpected error: <fmt.wrapError \| 0xc000f241c0>: failed to create HCP cluster cluster-nightly-4-22-ld22vq: failed starting cluster creation "cluster-nightly-4-22-ld22vq" in resourcegroup="rg-nightly-4-22-bgpnp8wsw6xn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-22-bgpnp8wsw6xn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-22-ld22vq -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.20 minor to 4.21 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-21-4zq985" at install version 4.20.0-0.nightly-multi-2026-09-23-090319 Unexpected error: <fmt.wrapError \| 0xc00150e0e0>: failed to create HCP cluster cp-ystream-upgrade-4-21-4zq985: failed starting cluster creation "cp-ystream-upgrade-4-21-4zq985" in resourcegroup="rg-cp-ystream-upgrade-4-21-2t5stzd262x4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-2t5stzd262x4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-21-4zq985 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-21-4zq985" at install version 4.20.0-0.nightly-multi-2026-09-23-090319 Unexpected error: <fmt.wrapError \| 0xc00150e0e0>: failed to create HCP cluster cp-ystream-upgrade-4-21-4zq985: failed starting cluster creation "cp-ystream-upgrade-4-21-4zq985" in resourcegroup="rg-cp-ystream-upgrade-4-21-2t5stzd262x4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-2t5stzd262x4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-21-4zq985 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to issue the default ingress serving certificate from Let's Encrypt using cert-manager with ACME DNS-01 challenges · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc0010c8360>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-g7klgrs9fgjl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-g7klgrs9fgjl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc0010c8360>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-g7klgrs9fgjl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-g7klgrs9fgjl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc001360160>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-zht9gtvbf76b": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-zht9gtvbf76b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc001360160>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-zht9gtvbf76b": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-zht9gtvbf76b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000980380>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-xw7mgxvr7szh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-xw7mgxvr7szh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000980380>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-xw7mgxvr7szh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-xw7mgxvr7szh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapError \| 0xc0023de0e0>: failed to create HCP cluster np-autoscale-cluster: failed starting cluster creation "np-autoscale-cluster" in resourcegroup="np-autoscaling-295h87tpx2wb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-295h87tpx2wb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapError \| 0xc0023de0e0>: failed to create HCP cluster np-autoscale-cluster: failed starting cluster creation "np-autoscale-cluster" in resourcegroup="np-autoscaling-295h87tpx2wb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-295h87tpx2wb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to delete a nodepool · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:81]: failed to create HCP cluster np-delete-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000e5d140>: failed to create HCP cluster np-delete-hcp-cluster: failed starting cluster creation "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-ljcwvrrqzgb6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ljcwvrrqzgb6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-delete-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:81]: failed to create HCP cluster np-delete-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000e5d140>: failed to create HCP cluster np-delete-hcp-cluster: failed starting cluster creation "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-ljcwvrrqzgb6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-ljcwvrrqzgb6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-delete-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:291]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapError \| 0xc000f64220>: failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-nj4mbs7m2xnq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-nj4mbs7m2xnq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:291]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapError \| 0xc000f64220>: failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-nj4mbs7m2xnq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-nj4mbs7m2xnq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc00101a240>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-tzwdzblv4lfz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-tzwdzblv4lfz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc00101a240>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-tzwdzblv4lfz": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-tzwdzblv4lfz/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should create a cluster using v20260901preview API and verify cluster health · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc000ab6240>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-s72gl49bdlhm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-s72gl49bdlhm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc000ab6240>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-s72gl49bdlhm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-s72gl49bdlhm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc0010ac320>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-d2dfnkr542l8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-d2dfnkr542l8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc0010ac320>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-d2dfnkr542l8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-d2dfnkr542l8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc000c46330>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-b62sjvpqvlrq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc000c46330>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-b62sjvpqvlrq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to delete an HCP cluster whose managed identities were deleted first · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00016cbc0>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-57hgcc4bw6nt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-57hgcc4bw6nt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00016cbc0>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-57hgcc4bw6nt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-57hgcc4bw6nt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-skk87w with version 4.21.0-0.nightly-multi-2026-09-23-170748 Unexpected error: <fmt.wrapError \| 0xc000e62b20>: failed to create HCP cluster np-version-upgrade-cluster-skk87w: failed starting cluster creation "np-version-upgrade-cluster-skk87w" in resourcegroup="rg-np-version-upgrade-skk87w-cq5mh9x4f6m8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-skk87w-cq5mh9x4f6m8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-skk87w -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-skk87w with version 4.21.0-0.nightly-multi-2026-09-23-170748 Unexpected error: <fmt.wrapError \| 0xc000e62b20>: failed to create HCP cluster np-version-upgrade-cluster-skk87w: failed starting cluster creation "np-version-upgrade-cluster-skk87w" in resourcegroup="rg-np-version-upgrade-skk87w-cq5mh9x4f6m8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-skk87w-cq5mh9x4f6m8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-skk87w -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test FIPS Mode Support with v2026-09-01 API should create an HCP cluster with FIPS mode enabled via cryptoRestrictions property · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc000bfc0e0>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-6klmwqw9sdwc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-6klmwqw9sdwc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc000bfc0e0>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-6klmwqw9sdwc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-6klmwqw9sdwc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:101]: failed to begin creating HCP cluster "admin-cred-lifecycle-jjzc8b" Unexpected error: <fmt.wrapError \| 0xc000761f00>: failed starting cluster creation "admin-cred-lifecycle-jjzc8b" in resourcegroup="admin-credential-lifecycle-test-hb7c2sfbh46t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hb7c2sfbh46t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-jjzc8b -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:101]: failed to begin creating HCP cluster "admin-cred-lifecycle-jjzc8b" Unexpected error: <fmt.wrapError \| 0xc000761f00>: failed starting cluster creation "admin-cred-lifecycle-jjzc8b" in resourcegroup="admin-credential-lifecycle-test-hb7c2sfbh46t": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-hb7c2sfbh46t/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-jjzc8b -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.22.zLatest to 4.20.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:720]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000df0260>: failed to create HCP cluster np-dg-minor-jcknfn: failed starting cluster creation "np-dg-minor-jcknfn" in resourcegroup="rg-np-dg-minor-jcknfn-jp7kllql2h9n": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-jcknfn-jp7kllql2h9n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-jcknfn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:720]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000df0260>: failed to create HCP cluster np-dg-minor-jcknfn: failed starting cluster creation "np-dg-minor-jcknfn" in resourcegroup="rg-np-dg-minor-jcknfn-jp7kllql2h9n": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-jcknfn-jp7kllql2h9n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-jcknfn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 23:00:13 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP nightly channel for 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-20-xflblvj4b79l/cluster-nightly-4-20-hp5qw6 should provision Unexpected error: <fmt.wrapError \| 0xc000c8a340>: failed to create HCP cluster cluster-nightly-4-20-hp5qw6: failed starting cluster creation "cluster-nightly-4-20-hp5qw6" in resourcegroup="rg-nightly-4-20-xflblvj4b79l": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-20-xflblvj4b79l/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-20-hp5qw6 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-nightly-4-20-xflblvj4b79l/cluster-nightly-4-20-hp5qw6 should provision Unexpected error: <fmt.wrapError \| 0xc000c8a340>: failed to create HCP cluster cluster-nightly-4-20-hp5qw6: failed starting cluster creation "cluster-nightly-4-20-hp5qw6" in resourcegroup="rg-nightly-4-20-xflblvj4b79l": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-nightly-4-20-xflblvj4b79l/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-nightly-4-20-hp5qw6 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred
17:20:30	38m 30s	branch-ci-Azure-ARO-HCP-main-e2e-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	uksouth	e2e	failed	n/a	58	e2e (58) ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc000ea63a0>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-md9bxlt4h2bl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-md9bxlt4h2bl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc000ea63a0>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-md9bxlt4h2bl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-md9bxlt4h2bl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:94]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapError \| 0xc000ac62a0>: failed to create HCP cluster ea-cluster: failed starting cluster creation "ea-cluster" in resourcegroup="external-auth-cluster-kr4qllwsq4zw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-kr4qllwsq4zw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:94]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapError \| 0xc000ac62a0>: failed to create HCP cluster ea-cluster: failed starting cluster creation "ea-cluster" in resourcegroup="external-auth-cluster-kr4qllwsq4zw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-kr4qllwsq4zw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create a cluster and node pools with aggregated advanced features · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:207]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc0008a26c0>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-gwq5rnfvqbmj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-gwq5rnfvqbmj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:207]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc0008a26c0>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-gwq5rnfvqbmj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-gwq5rnfvqbmj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:105]: failed to begin creating HCP cluster "admin-cred-lifecycle-f9mwlb" Unexpected error: <fmt.wrapError \| 0xc00014aa00>: failed starting cluster creation "admin-cred-lifecycle-f9mwlb" in resourcegroup="admin-credential-lifecycle-test-jnk69g62fsqq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-jnk69g62fsqq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-f9mwlb -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:105]: failed to begin creating HCP cluster "admin-cred-lifecycle-f9mwlb" Unexpected error: <fmt.wrapError \| 0xc00014aa00>: failed starting cluster creation "admin-cred-lifecycle-f9mwlb" in resourcegroup="admin-credential-lifecycle-test-jnk69g62fsqq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-jnk69g62fsqq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-f9mwlb -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-rdjnfw with version 4.20.39 Unexpected error: <fmt.wrapError \| 0xc0009944c0>: failed to create HCP cluster np-version-upgrade-cluster-rdjnfw: failed starting cluster creation "np-version-upgrade-cluster-rdjnfw" in resourcegroup="rg-np-version-upgrade-rdjnfw-5m2htlhcktvw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-rdjnfw-5m2htlhcktvw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-rdjnfw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-rdjnfw with version 4.20.39 Unexpected error: <fmt.wrapError \| 0xc0009944c0>: failed to create HCP cluster np-version-upgrade-cluster-rdjnfw: failed starting cluster creation "np-version-upgrade-cluster-rdjnfw" in resourcegroup="rg-np-version-upgrade-rdjnfw-5m2htlhcktvw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-rdjnfw-5m2htlhcktvw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-rdjnfw -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-5-0-mr648lrwtr8j/cluster-candidate-5-0-jdjc8h should provision Unexpected error: <fmt.wrapError \| 0xc001926140>: failed to create HCP cluster cluster-candidate-5-0-jdjc8h: failed starting cluster creation "cluster-candidate-5-0-jdjc8h" in resourcegroup="rg-candidate-5-0-mr648lrwtr8j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-mr648lrwtr8j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-5-0-jdjc8h -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-5-0-mr648lrwtr8j/cluster-candidate-5-0-jdjc8h should provision Unexpected error: <fmt.wrapError \| 0xc001926140>: failed to create HCP cluster cluster-candidate-5-0-jdjc8h: failed starting cluster creation "cluster-candidate-5-0-jdjc8h" in resourcegroup="rg-candidate-5-0-mr648lrwtr8j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-mr648lrwtr8j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-5-0-jdjc8h -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:87]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapError \| 0xc000a7a320>: failed to create HCP cluster ea-listdnmz6c: failed starting cluster creation "ea-listdnmz6c" in resourcegroup="ea-list-2tprnprxzp8c": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-2tprnprxzp8c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listdnmz6c -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:87]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapError \| 0xc000a7a320>: failed to create HCP cluster ea-listdnmz6c: failed starting cluster creation "ea-listdnmz6c" in resourcegroup="ea-list-2tprnprxzp8c": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-2tprnprxzp8c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listdnmz6c -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc000c34180>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-c2vqb28n2z6s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-c2vqb28n2z6s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc000c34180>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-c2vqb28n2z6s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-c2vqb28n2z6s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc000a982d0>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-gwwmf6gjgf55/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc000a982d0>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-gwwmf6gjgf55/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-22-lmjw65" with version 4.22.14 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000fa6a20>: failed to create HCP cluster cluster-zstream-4-22-lmjw65: failed starting cluster creation "cluster-zstream-4-22-lmjw65" in resourcegroup="rg-zstream-upgrade-4-22-79tsm6r6kxcv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-22-79tsm6r6kxcv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-22-lmjw65 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-22-lmjw65" with version 4.22.14 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000fa6a20>: failed to create HCP cluster cluster-zstream-4-22-lmjw65: failed starting cluster creation "cluster-zstream-4-22-lmjw65" in resourcegroup="rg-zstream-upgrade-4-22-79tsm6r6kxcv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-22-79tsm6r6kxcv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-22-lmjw65 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc0010ea200>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-wc9p6hpc29b6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-wc9p6hpc29b6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc0010ea200>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-wc9p6hpc29b6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-wc9p6hpc29b6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00062c3e0>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-9j5894xv2nfk": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-9j5894xv2nfk/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00062c3e0>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-9j5894xv2nfk": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-9j5894xv2nfk/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc000992780>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-qq5gvs64ckln": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-qq5gvs64ckln/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:90]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc000992780>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-qq5gvs64ckln": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-qq5gvs64ckln/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapError \| 0xc00081aa20>: failed to create HCP cluster disabled-image-registry-hcp-cluster: failed starting cluster creation "disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-w2klxbbvrh6r": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-w2klxbbvrh6r/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapError \| 0xc00081aa20>: failed to create HCP cluster disabled-image-registry-hcp-cluster: failed starting cluster creation "disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-w2klxbbvrh6r": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-w2klxbbvrh6r/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to cordon, drain, and uncordon a node in an HCP cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:90]: failed to create HCP cluster cordon-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000ba4240>: failed to create HCP cluster cordon-hcp-cluster: failed starting cluster creation "cordon-hcp-cluster" in resourcegroup="rg-cordon-test-49bvw77ddhd7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-49bvw77ddhd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cordon-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:90]: failed to create HCP cluster cordon-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000ba4240>: failed to create HCP cluster cordon-hcp-cluster: failed starting cluster creation "cordon-hcp-cluster" in resourcegroup="rg-cordon-test-49bvw77ddhd7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-49bvw77ddhd7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cordon-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:106]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc001310120>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-nwsnnfvwzdrd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-nwsnnfvwzdrd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:106]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc001310120>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-nwsnnfvwzdrd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-nwsnnfvwzdrd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-t6w7kn with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc001586240>: failed to create HCP cluster np-version-upgrade-cluster-t6w7kn: failed starting cluster creation "np-version-upgrade-cluster-t6w7kn" in resourcegroup="rg-np-version-upgrade-t6w7kn-n527hph4clhc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-t6w7kn-n527hph4clhc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-t6w7kn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-t6w7kn with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc001586240>: failed to create HCP cluster np-version-upgrade-cluster-t6w7kn: failed starting cluster creation "np-version-upgrade-cluster-t6w7kn" in resourcegroup="rg-np-version-upgrade-t6w7kn-n527hph4clhc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-t6w7kn-n527hph4clhc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-t6w7kn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.22 minor to 4.23 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-23-zprvbm" at install version 4.22 Unexpected error: <fmt.wrapError \| 0xc0004d2fa0>: failed to create HCP cluster cp-ystream-upgrade-4-23-zprvbm: failed starting cluster creation "cp-ystream-upgrade-4-23-zprvbm" in resourcegroup="rg-cp-ystream-upgrade-4-23-nc75hl29zdtj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-23-nc75hl29zdtj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-23-zprvbm -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-23-zprvbm" at install version 4.22 Unexpected error: <fmt.wrapError \| 0xc0004d2fa0>: failed to create HCP cluster cp-ystream-upgrade-4-23-zprvbm: failed starting cluster creation "cp-ystream-upgrade-4-23-zprvbm" in resourcegroup="rg-cp-ystream-upgrade-4-23-nc75hl29zdtj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-23-nc75hl29zdtj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-23-zprvbm -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should create a cluster with private ingress using v20260901preview and verify the ingress is internal · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc000d385c0>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-b2v8h4lk7mr9": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-b2v8h4lk7mr9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc000d385c0>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-b2v8h4lk7mr9": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-b2v8h4lk7mr9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to delete a nodepool · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:80]: failed to create HCP cluster np-delete-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc00143a1e0>: failed to create HCP cluster np-delete-hcp-cluster: failed starting cluster creation "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-m7td24fcmrl7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-m7td24fcmrl7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-delete-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:80]: failed to create HCP cluster np-delete-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc00143a1e0>: failed to create HCP cluster np-delete-hcp-cluster: failed starting cluster creation "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-m7td24fcmrl7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-m7td24fcmrl7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-delete-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:291]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapError \| 0xc000506300>: failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-8dfwnhhtxdp6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-8dfwnhhtxdp6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:291]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapError \| 0xc000506300>: failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-8dfwnhhtxdp6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-8dfwnhhtxdp6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-22-6tlfjxd6xqc6/cluster-candidate-4-22-xvfpvx should provision Unexpected error: <fmt.wrapError \| 0xc000fba3a0>: failed to create HCP cluster cluster-candidate-4-22-xvfpvx: failed starting cluster creation "cluster-candidate-4-22-xvfpvx" in resourcegroup="rg-candidate-4-22-6tlfjxd6xqc6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-22-6tlfjxd6xqc6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-22-xvfpvx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-22-6tlfjxd6xqc6/cluster-candidate-4-22-xvfpvx should provision Unexpected error: <fmt.wrapError \| 0xc000fba3a0>: failed to create HCP cluster cluster-candidate-4-22-xvfpvx: failed starting cluster creation "cluster-candidate-4-22-xvfpvx" in resourcegroup="rg-candidate-4-22-6tlfjxd6xqc6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-22-6tlfjxd6xqc6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-22-xvfpvx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00123c100>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-zhdp8544srss": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-zhdp8544srss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00123c100>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-zhdp8544srss": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-zhdp8544srss/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.20 minor to 4.21 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-21-66tjf2" at install version 4.20 Unexpected error: <fmt.wrapError \| 0xc0011c0240>: failed to create HCP cluster cp-ystream-upgrade-4-21-66tjf2: failed starting cluster creation "cp-ystream-upgrade-4-21-66tjf2" in resourcegroup="rg-cp-ystream-upgrade-4-21-fp5kzmg9k2qb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-fp5kzmg9k2qb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-21-66tjf2 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-21-66tjf2" at install version 4.20 Unexpected error: <fmt.wrapError \| 0xc0011c0240>: failed to create HCP cluster cp-ystream-upgrade-4-21-66tjf2: failed starting cluster creation "cp-ystream-upgrade-4-21-66tjf2" in resourcegroup="rg-cp-ystream-upgrade-4-21-fp5kzmg9k2qb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-fp5kzmg9k2qb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-21-66tjf2 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.22 minor to 5.0 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-0-f8mhn9" at install version 4.22 Unexpected error: <fmt.wrapError \| 0xc000f900e0>: failed to create HCP cluster cp-ystream-upgrade-5-0-f8mhn9: failed starting cluster creation "cp-ystream-upgrade-5-0-f8mhn9" in resourcegroup="rg-cp-ystream-upgrade-5-0-mf5jqrbn6srb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-mf5jqrbn6srb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-0-f8mhn9 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-0-f8mhn9" at install version 4.22 Unexpected error: <fmt.wrapError \| 0xc000f900e0>: failed to create HCP cluster cp-ystream-upgrade-5-0-f8mhn9: failed starting cluster creation "cp-ystream-upgrade-5-0-f8mhn9" in resourcegroup="rg-cp-ystream-upgrade-5-0-mf5jqrbn6srb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-mf5jqrbn6srb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-0-f8mhn9 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-20-kf4fc8" with version 4.20.38 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000e3e620>: failed to create HCP cluster cluster-zstream-4-20-kf4fc8: failed starting cluster creation "cluster-zstream-4-20-kf4fc8" in resourcegroup="rg-zstream-upgrade-4-20-24x8x7qddc4f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-24x8x7qddc4f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-kf4fc8 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-20-kf4fc8" with version 4.20.38 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000e3e620>: failed to create HCP cluster cluster-zstream-4-20-kf4fc8: failed starting cluster creation "cluster-zstream-4-20-kf4fc8" in resourcegroup="rg-zstream-upgrade-4-20-24x8x7qddc4f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-24x8x7qddc4f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-kf4fc8 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.23 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-23-hqj25xm5xjpp/cluster-candidate-4-23-x87dzg should provision Unexpected error: <fmt.wrapError \| 0xc001010300>: failed to create HCP cluster cluster-candidate-4-23-x87dzg: failed starting cluster creation "cluster-candidate-4-23-x87dzg" in resourcegroup="rg-candidate-4-23-hqj25xm5xjpp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-23-hqj25xm5xjpp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-23-x87dzg -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-23-hqj25xm5xjpp/cluster-candidate-4-23-x87dzg should provision Unexpected error: <fmt.wrapError \| 0xc001010300>: failed to create HCP cluster cluster-candidate-4-23-x87dzg: failed starting cluster creation "cluster-candidate-4-23-x87dzg" in resourcegroup="rg-candidate-4-23-hqj25xm5xjpp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-23-hqj25xm5xjpp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-23-x87dzg -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test FIPS Mode Support with v2026-09-01 API should create an HCP cluster with FIPS mode enabled via cryptoRestrictions property · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc0008123c0>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-49kfk2h5cd4x": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-49kfk2h5cd4x/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc0008123c0>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-49kfk2h5cd4x": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-49kfk2h5cd4x/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapError \| 0xc000f42380>: failed to create HCP cluster idms-e2e-hcp-cluster: failed starting cluster creation "idms-e2e-hcp-cluster" in resourcegroup="idms-744mhb4wmcsp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-744mhb4wmcsp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapError \| 0xc000f42380>: failed to create HCP cluster idms-e2e-hcp-cluster: failed starting cluster creation "idms-e2e-hcp-cluster" in resourcegroup="idms-744mhb4wmcsp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-744mhb4wmcsp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.22.zLatest to 4.20.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:720]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000ea2120>: failed to create HCP cluster np-dg-minor-5xtqzm: failed starting cluster creation "np-dg-minor-5xtqzm" in resourcegroup="rg-np-dg-minor-5xtqzm-28nz5th2j6m7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-5xtqzm-28nz5th2j6m7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-5xtqzm -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:720]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000ea2120>: failed to create HCP cluster np-dg-minor-5xtqzm: failed starting cluster creation "np-dg-minor-5xtqzm" in resourcegroup="rg-np-dg-minor-5xtqzm-28nz5th2j6m7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-5xtqzm-28nz5th2j6m7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-5xtqzm -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:272]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000b9c260>: failed to create HCP cluster shoebox-hcp-cluster: failed starting cluster creation "shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-wftkcwprcffb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-wftkcwprcffb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/shoebox-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:272]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000b9c260>: failed to create HCP cluster shoebox-hcp-cluster: failed starting cluster creation "shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-wftkcwprcffb": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-wftkcwprcffb/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/shoebox-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to issue the default ingress serving certificate from Let's Encrypt using cert-manager with ACME DNS-01 challenges · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000aa6340>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-89xxsz542trh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-89xxsz542trh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000aa6340>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-89xxsz542trh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-89xxsz542trh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:92]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapError \| 0xc000788a60>: failed to create HCP cluster cluster-np-labels-taints: failed starting cluster creation "cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-skgrd5ch2wdr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-skgrd5ch2wdr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:92]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapError \| 0xc000788a60>: failed to create HCP cluster cluster-np-labels-taints: failed starting cluster creation "cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-skgrd5ch2wdr": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-skgrd5ch2wdr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:441]: failed to create HCP cluster np-skip-minor-jcpfwd at version 4.22.15 Unexpected error: <fmt.wrapError \| 0xc001808280>: failed to create HCP cluster np-skip-minor-jcpfwd: failed starting cluster creation "np-skip-minor-jcpfwd" in resourcegroup="rg-np-skip-minor-jcpfwd-gvqsdxzjh8vp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-jcpfwd-gvqsdxzjh8vp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-jcpfwd -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:441]: failed to create HCP cluster np-skip-minor-jcpfwd at version 4.22.15 Unexpected error: <fmt.wrapError \| 0xc001808280>: failed to create HCP cluster np-skip-minor-jcpfwd: failed starting cluster creation "np-skip-minor-jcpfwd" in resourcegroup="rg-np-skip-minor-jcpfwd-gvqsdxzjh8vp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-jcpfwd-gvqsdxzjh8vp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-jcpfwd -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to list available HCP OpenShift versions and validate response content · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc00154a810>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc00154a810>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc0014940e0>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-2pqz77p5k645": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-2pqz77p5k645/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc0014940e0>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-2pqz77p5k645": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-2pqz77p5k645/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc000614500>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-hwvkqfn2c69n": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-hwvkqfn2c69n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc000614500>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-hwvkqfn2c69n": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-hwvkqfn2c69n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should create a cluster using v20260901preview API and verify cluster health · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc001002280>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-sp7x4pd4zkrt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-sp7x4pd4zkrt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc001002280>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-sp7x4pd4zkrt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-sp7x4pd4zkrt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-7pqfcm with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc00134e120>: failed to create HCP cluster np-version-upgrade-cluster-7pqfcm: failed starting cluster creation "np-version-upgrade-cluster-7pqfcm" in resourcegroup="rg-np-version-upgrade-7pqfcm-2zqnz4g9wfx5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-7pqfcm-2zqnz4g9wfx5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-7pqfcm -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-7pqfcm with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc00134e120>: failed to create HCP cluster np-version-upgrade-cluster-7pqfcm: failed starting cluster creation "np-version-upgrade-cluster-7pqfcm" in resourcegroup="rg-np-version-upgrade-7pqfcm-2zqnz4g9wfx5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-7pqfcm-2zqnz4g9wfx5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-7pqfcm -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-21-nr97qpqbnq89/cluster-candidate-4-21-vbtv2b should provision Unexpected error: <fmt.wrapError \| 0xc000914640>: failed to create HCP cluster cluster-candidate-4-21-vbtv2b: failed starting cluster creation "cluster-candidate-4-21-vbtv2b" in resourcegroup="rg-candidate-4-21-nr97qpqbnq89": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-21-nr97qpqbnq89/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-21-vbtv2b -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-21-nr97qpqbnq89/cluster-candidate-4-21-vbtv2b should provision Unexpected error: <fmt.wrapError \| 0xc000914640>: failed to create HCP cluster cluster-candidate-4-21-vbtv2b: failed starting cluster creation "cluster-candidate-4-21-vbtv2b" in resourcegroup="rg-candidate-4-21-nr97qpqbnq89": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-21-nr97qpqbnq89/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-21-vbtv2b -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000a49080>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-grmp56x8mfgq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-grmp56x8mfgq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000a49080>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-grmp56x8mfgq": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-grmp56x8mfgq/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000ca01e0>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-lzr7ggchsgl8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-lzr7ggchsgl8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000ca01e0>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-lzr7ggchsgl8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-lzr7ggchsgl8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc00098c6c0>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-dzql26rplxsd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-dzql26rplxsd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc00098c6c0>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-dzql26rplxsd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-dzql26rplxsd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to delete an HCP cluster whose managed identities were deleted first · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc001048260>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-n85wjx2ql25d": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-n85wjx2ql25d/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc001048260>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-n85wjx2ql25d": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-n85wjx2ql25d/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-5-0-7pqq8c" with version 5.0.0-rc.2 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000a2cd60>: failed to create HCP cluster cluster-zstream-5-0-7pqq8c: failed starting cluster creation "cluster-zstream-5-0-7pqq8c" in resourcegroup="rg-zstream-upgrade-5-0-psl5tsd9krt8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-5-0-psl5tsd9krt8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-5-0-7pqq8c -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-5-0-7pqq8c" with version 5.0.0-rc.2 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000a2cd60>: failed to create HCP cluster cluster-zstream-5-0-7pqq8c: failed starting cluster creation "cluster-zstream-5-0-7pqq8c" in resourcegroup="rg-zstream-upgrade-5-0-psl5tsd9krt8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-5-0-psl5tsd9krt8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-5-0-7pqq8c -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc0006871a0>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-npl4lqlc2j28": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-npl4lqlc2j28/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc0006871a0>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-npl4lqlc2j28": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-npl4lqlc2j28/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:98]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc000fe01e0>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-k5wx2hsgkgzp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-k5wx2hsgkgzp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:98]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc000fe01e0>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-k5wx2hsgkgzp": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-k5wx2hsgkgzp/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.21 minor to 4.22 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-24kkdn" at install version 4.21 Unexpected error: <fmt.wrapError \| 0xc000789c60>: failed to create HCP cluster cp-ystream-upgrade-4-22-24kkdn: failed starting cluster creation "cp-ystream-upgrade-4-22-24kkdn" in resourcegroup="rg-cp-ystream-upgrade-4-22-jchspf48txds": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-jchspf48txds/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-22-24kkdn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-24kkdn" at install version 4.21 Unexpected error: <fmt.wrapError \| 0xc000789c60>: failed to create HCP cluster cp-ystream-upgrade-4-22-24kkdn: failed starting cluster creation "cp-ystream-upgrade-4-22-24kkdn" in resourcegroup="rg-cp-ystream-upgrade-4-22-jchspf48txds": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-jchspf48txds/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-22-24kkdn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-20-rfcvwdhs2s8z/cluster-candidate-4-20-fb65qk should provision Unexpected error: <fmt.wrapError \| 0xc000911220>: failed to create HCP cluster cluster-candidate-4-20-fb65qk: failed starting cluster creation "cluster-candidate-4-20-fb65qk" in resourcegroup="rg-candidate-4-20-rfcvwdhs2s8z": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-rfcvwdhs2s8z/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-20-fb65qk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:122]: HCP cluster rg-candidate-4-20-rfcvwdhs2s8z/cluster-candidate-4-20-fb65qk should provision Unexpected error: <fmt.wrapError \| 0xc000911220>: failed to create HCP cluster cluster-candidate-4-20-fb65qk: failed starting cluster creation "cluster-candidate-4-20-fb65qk" in resourcegroup="rg-candidate-4-20-rfcvwdhs2s8z": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-rfcvwdhs2s8z/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-20-fb65qk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-21-5m6fvn" with version 4.21.33 on candidate channel Unexpected error: <fmt.wrapError \| 0xc00106c220>: failed to create HCP cluster cluster-zstream-4-21-5m6fvn: failed starting cluster creation "cluster-zstream-4-21-5m6fvn" in resourcegroup="rg-zstream-upgrade-4-21-585ggz8lqzc9": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-21-585ggz8lqzc9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-21-5m6fvn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-21-5m6fvn" with version 4.21.33 on candidate channel Unexpected error: <fmt.wrapError \| 0xc00106c220>: failed to create HCP cluster cluster-zstream-4-21-5m6fvn: failed starting cluster creation "cluster-zstream-4-21-5m6fvn" in resourcegroup="rg-zstream-upgrade-4-21-585ggz8lqzc9": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-21-585ggz8lqzc9/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-21-5m6fvn -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:580]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000bd01a0>: failed to create HCP cluster np-downgrade-j4m7th: failed starting cluster creation "np-downgrade-j4m7th" in resourcegroup="rg-np-downgrade-j4m7th-k6x7c5vhdzqw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-j4m7th-k6x7c5vhdzqw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-j4m7th -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:580]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000bd01a0>: failed to create HCP cluster np-downgrade-j4m7th: failed starting cluster creation "np-downgrade-j4m7th" in resourcegroup="rg-np-downgrade-j4m7th-k6x7c5vhdzqw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-j4m7th-k6x7c5vhdzqw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-j4m7th -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapError \| 0xc001690100>: failed to create HCP cluster np-autoscale-cluster: failed starting cluster creation "np-autoscale-cluster" in resourcegroup="np-autoscaling-mxsb4d4dcndm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-mxsb4d4dcndm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapError \| 0xc001690100>: failed to create HCP cluster np-autoscale-cluster: failed starting cluster creation "np-autoscale-cluster" in resourcegroup="np-autoscaling-mxsb4d4dcndm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-mxsb4d4dcndm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapError \| 0xc000946140>: failed to create HCP cluster negative-tests-cluster: failed starting cluster creation "negative-tests-cluster" in resourcegroup="rg-negative-tests-gxzd4bqsq7ff": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-gxzd4bqsq7ff/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapError \| 0xc000946140>: failed to create HCP cluster negative-tests-cluster: failed starting cluster creation "negative-tests-cluster" in resourcegroup="rg-negative-tests-gxzd4bqsq7ff": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-gxzd4bqsq7ff/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc001044400>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-8g9xp5jpnqwl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8g9xp5jpnqwl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc001044400>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-8g9xp5jpnqwl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-8g9xp5jpnqwl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling and update the autoscaling configuration · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc000cde9a0>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-7gkqvtjn5hrh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-7gkqvtjn5hrh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc000cde9a0>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-7gkqvtjn5hrh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-7gkqvtjn5hrh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:301]: failed to create HCP cluster np-noedge-qd9tq7 Unexpected error: <fmt.wrapError \| 0xc000d82360>: failed to create HCP cluster np-noedge-qd9tq7: failed starting cluster creation "np-noedge-qd9tq7" in resourcegroup="rg-np-noedge-qd9tq7-j6nd68sppgnf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-noedge-qd9tq7-j6nd68sppgnf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-noedge-qd9tq7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:301]: failed to create HCP cluster np-noedge-qd9tq7 Unexpected error: <fmt.wrapError \| 0xc000d82360>: failed to create HCP cluster np-noedge-qd9tq7: failed starting cluster creation "np-noedge-qd9tq7" in resourcegroup="rg-np-noedge-qd9tq7-j6nd68sppgnf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-noedge-qd9tq7-j6nd68sppgnf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-noedge-qd9tq7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:84]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapError \| 0xc000a92300>: failed to create HCP cluster ephemeral-disk: failed starting cluster creation "ephemeral-disk" in resourcegroup="ephemeral-osdisk-zn5n8g9qjq6p": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-zn5n8g9qjq6p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:84]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapError \| 0xc000a92300>: failed to create HCP cluster ephemeral-disk: failed starting cluster creation "ephemeral-disk" in resourcegroup="ephemeral-osdisk-zn5n8g9qjq6p": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-zn5n8g9qjq6p/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 17:20:30 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:227]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapError \| 0xc0009582a0>: failed to create HCP cluster oidc-wi-cluster: failed starting cluster creation "oidc-wi-cluster" in resourcegroup="oidc-wi-gggk2qcjxcn8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-gggk2qcjxcn8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:227]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapError \| 0xc0009582a0>: failed to create HCP cluster oidc-wi-cluster: failed starting cluster creation "oidc-wi-cluster" in resourcegroup="oidc-wi-gggk2qcjxcn8": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-gggk2qcjxcn8/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred
02:00:41	19m 22s	periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel post-goodmerged PR No additional run metadata captured	uksouth	e2e	failed	n/a	56	e2e (56) ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Update HCPOpenShiftCluster Positive creates a cluster and updates tags with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000d57840>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-j4n5xfxkstwg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-j4n5xfxkstwg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:161]: failed to create HCP cluster for patch-tags test Unexpected error: <fmt.wrapError \| 0xc000d57840>: failed to create HCP cluster patch-tags-cluster: failed starting cluster creation "patch-tags-cluster" in resourcegroup="patch-tags-j4n5xfxkstwg": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-tags-j4n5xfxkstwg/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-tags-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create a HCP cluster and use cilium CNI plugin · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc0005dc160>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-22256vxjwxzv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-22256vxjwxzv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cni_cilium.go:88]: failed to create HCP cluster "cilium-cl" without CNI Unexpected error: <fmt.wrapError \| 0xc0005dc160>: failed to create HCP cluster cilium-cl: failed starting cluster creation "cilium-cl" in resourcegroup="cni-cilium-22256vxjwxzv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cni-cilium-22256vxjwxzv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:94]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapError \| 0xc0005a4440>: failed to create HCP cluster ea-cluster: failed starting cluster creation "ea-cluster" in resourcegroup="external-auth-cluster-g2r7df4nbvtl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-g2r7df4nbvtl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:94]: failed to create HCP cluster for external auth test Unexpected error: <fmt.wrapError \| 0xc0005a4440>: failed to create HCP cluster ea-cluster: failed starting cluster creation "ea-cluster" in resourcegroup="external-auth-cluster-g2r7df4nbvtl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/external-auth-cluster-g2r7df4nbvtl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create an HCP cluster with custom autoscaling and update the autoscaling configuration · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc0005886e0>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-tnkkshhqpgpc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-tnkkshhqpgpc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_autoscaling.go:108]: failed to create HCP cluster "autoscaling-hcp-cluster" with custom autoscaling Unexpected error: <fmt.wrapError \| 0xc0005886e0>: failed to create HCP cluster autoscaling-hcp-cluster: failed starting cluster creation "autoscaling-hcp-cluster" in resourcegroup="autoscaling-cluster-tnkkshhqpgpc": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/autoscaling-cluster-tnkkshhqpgpc/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/autoscaling-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to lifecycle and confirm external auth on a cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:87]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapError \| 0xc0007ef1a0>: failed to create HCP cluster ea-listmfk6rl: failed starting cluster creation "ea-listmfk6rl" in resourcegroup="ea-list-bkxpqlfv4c6z": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-bkxpqlfv4c6z/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listmfk6rl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_list_and_verify.go:87]: failed to create HCP cluster for external auth list test Unexpected error: <fmt.wrapError \| 0xc0007ef1a0>: failed to create HCP cluster ea-listmfk6rl: failed starting cluster creation "ea-listmfk6rl" in resourcegroup="ea-list-bkxpqlfv4c6z": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ea-list-bkxpqlfv4c6z/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ea-listmfk6rl -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should respect cluster-wide node limits with nodepool autoscaling · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:291]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapError \| 0xc0001a2500>: failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-fwgpzzwmqdsk": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-fwgpzzwmqdsk/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:291]: failed to create HCP cluster node-limit-cluster with MaxNodesTotal limit Unexpected error: <fmt.wrapError \| 0xc0001a2500>: failed to create HCP cluster node-limit-cluster: failed starting cluster creation "node-limit-cluster" in resourcegroup="node-limit-test-fwgpzzwmqdsk": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/node-limit-test-fwgpzzwmqdsk/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/node-limit-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Update HCPOpenShiftCluster Negative creates a cluster and fails to update its name with a PATCH request · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc00067a300>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-rsb2d87wnkmj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-rsb2d87wnkmj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_update.go:84]: failed to create HCP cluster for patch-name test Unexpected error: <fmt.wrapError \| 0xc00067a300>: failed to create HCP cluster patch-name-cluster: failed starting cluster creation "patch-name-cluster" in resourcegroup="patch-name-rsb2d87wnkmj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/patch-name-rsb2d87wnkmj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/patch-name-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.20.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-wcfsw2 with version 4.20.39 Unexpected error: <fmt.wrapError \| 0xc00184a100>: failed to create HCP cluster np-version-upgrade-cluster-wcfsw2: failed starting cluster creation "np-version-upgrade-cluster-wcfsw2" in resourcegroup="rg-np-version-upgrade-wcfsw2-tgvfvwtvq9vl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-wcfsw2-tgvfvwtvq9vl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-wcfsw2 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-wcfsw2 with version 4.20.39 Unexpected error: <fmt.wrapError \| 0xc00184a100>: failed to create HCP cluster np-version-upgrade-cluster-wcfsw2: failed starting cluster creation "np-version-upgrade-cluster-wcfsw2" in resourcegroup="rg-np-version-upgrade-wcfsw2-tgvfvwtvq9vl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-wcfsw2-tgvfvwtvq9vl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-wcfsw2 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create an HCP cluster and custom node pool osDisk size · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc000ec4100>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-5zhpbqbl9m9q": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-5zhpbqbl9m9q/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_nodepool_osdisk.go:80]: failed to create HCP cluster "hcp-cluster-np-128" Unexpected error: <fmt.wrapError \| 0xc000ec4100>: failed to create HCP cluster hcp-cluster-np-128: failed starting cluster creation "hcp-cluster-np-128" in resourcegroup="clusternp128-5zhpbqbl9m9q": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/clusternp128-5zhpbqbl9m9q/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/hcp-cluster-np-128 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-22-h89dm9lhsl2f/cluster-candidate-4-22-w9djqt should provision Unexpected error: <fmt.wrapError \| 0xc00110a1a0>: failed to create HCP cluster cluster-candidate-4-22-w9djqt: failed starting cluster creation "cluster-candidate-4-22-w9djqt" in resourcegroup="rg-candidate-4-22-h89dm9lhsl2f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-22-h89dm9lhsl2f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-22-w9djqt -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-22-h89dm9lhsl2f/cluster-candidate-4-22-w9djqt should provision Unexpected error: <fmt.wrapError \| 0xc00110a1a0>: failed to create HCP cluster cluster-candidate-4-22-w9djqt: failed starting cluster creation "cluster-candidate-4-22-w9djqt" in resourcegroup="rg-candidate-4-22-h89dm9lhsl2f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-22-h89dm9lhsl2f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-22-w9djqt -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.22 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-22-95hssq" with version 4.22.14 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000b24480>: failed to create HCP cluster cluster-zstream-4-22-95hssq: failed starting cluster creation "cluster-zstream-4-22-95hssq" in resourcegroup="rg-zstream-upgrade-4-22-mw82tvb5wt8f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-22-mw82tvb5wt8f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-22-95hssq -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-22-95hssq" with version 4.22.14 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000b24480>: failed to create HCP cluster cluster-zstream-4-22-95hssq: failed starting cluster creation "cluster-zstream-4-22-95hssq" in resourcegroup="rg-zstream-upgrade-4-22-mw82tvb5wt8f": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-22-mw82tvb5wt8f/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-22-95hssq -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to delete an HCP cluster whose managed identities were deleted first · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000e12740>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-fnhqkgb28q5j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-fnhqkgb28q5j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_missing_identities.go:113]: failed to create HCP cluster "missing-mi-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000e12740>: failed to create HCP cluster missing-mi-hcp-cluster: failed starting cluster creation "missing-mi-hcp-cluster" in resourcegroup="delete-mi-rg-fnhqkgb28q5j": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delete-mi-rg-fnhqkgb28q5j/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/missing-mi-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to update node pool labels and taints · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:92]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapError \| 0xc000a841e0>: failed to create HCP cluster cluster-np-labels-taints: failed starting cluster creation "cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-2pscx6lt6hbw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-2pscx6lt6hbw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_labels_taints.go:92]: failed to create HCP cluster cluster-np-labels-taints Unexpected error: <fmt.wrapError \| 0xc000a841e0>: failed to create HCP cluster cluster-np-labels-taints: failed starting cluster creation "cluster-np-labels-taints" in resourcegroup="rg-np-labels-taints-2pscx6lt6hbw": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-labels-taints-2pscx6lt6hbw/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-np-labels-taints -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should not be able to perform various invalid operations on cluster resources · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapError \| 0xc000c94200>: failed to create HCP cluster negative-tests-cluster: failed starting cluster creation "negative-tests-cluster" in resourcegroup="rg-negative-tests-qhgbvbhnhp7c": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-qhgbvbhnhp7c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/simple_negative_cases.go:110]: failed to create HCP cluster negative-tests-cluster Unexpected error: <fmt.wrapError \| 0xc000c94200>: failed to create HCP cluster negative-tests-cluster: failed starting cluster creation "negative-tests-cluster" in resourcegroup="rg-negative-tests-qhgbvbhnhp7c": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-negative-tests-qhgbvbhnhp7c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/negative-tests-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage pull secrets · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc000c00780>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-7q6zb9qhrlww": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-7q6zb9qhrlww/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_pullsecret.go:113]: failed to create HCP cluster for pull secret test Unexpected error: <fmt.wrapError \| 0xc000c00780>: failed to create HCP cluster pullsecret-hcp-cluster: failed starting cluster creation "pullsecret-hcp-cluster" in resourcegroup="pullsecret-test-7q6zb9qhrlww": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/pullsecret-test-7q6zb9qhrlww/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/pullsecret-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Nodepool Ephemeral OS Disk should create a nodepool with ephemeral OS disk when autoRepair is enabled · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:84]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapError \| 0xc001026160>: failed to create HCP cluster ephemeral-disk: failed starting cluster creation "ephemeral-disk" in resourcegroup="ephemeral-osdisk-s8j9mmmntb7s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-s8j9mmmntb7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_ephemeral_osdisk.go:84]: failed to create HCP cluster ephemeral-disk Unexpected error: <fmt.wrapError \| 0xc001026160>: failed to create HCP cluster ephemeral-disk: failed starting cluster creation "ephemeral-disk" in resourcegroup="ephemeral-osdisk-s8j9mmmntb7s": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ephemeral-osdisk-s8j9mmmntb7s/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ephemeral-disk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create several HCP clusters in their customer resource group, but not in the same managed resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00084b4c0>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-vjfmvmg6928d": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-vjfmvmg6928d/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/clusters_sharing_resgroup.go:111]: failed to begin creation of first cluster "basic-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc00084b4c0>: failed starting cluster creation "basic-hcp-cluster" in resourcegroup="customer-rg-vjfmvmg6928d": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/customer-rg-vjfmvmg6928d/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to delete a nodepool · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:81]: failed to create HCP cluster np-delete-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc001012280>: failed to create HCP cluster np-delete-hcp-cluster: failed starting cluster creation "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-4lj84nw2x245": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-4lj84nw2x245/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-delete-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_delete.go:81]: failed to create HCP cluster np-delete-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc001012280>: failed to create HCP cluster np-delete-hcp-cluster: failed starting cluster creation "np-delete-hcp-cluster" in resourcegroup="nodepool-delete-4lj84nw2x245": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/nodepool-delete-4lj84nw2x245/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-delete-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test FIPS Mode Support with v2026-09-01 API should create an HCP cluster with FIPS mode enabled via cryptoRestrictions property · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc001380240>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-8xv96lzbm5cx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-8xv96lzbm5cx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_fips_mode.go:87]: failed to create HCP cluster "fips-enabled-cluster" with cryptoRestrictions set to FIPS Unexpected error: <fmt.wrapError \| 0xc001380240>: failed starting cluster creation "fips-enabled-cluster" in resourcegroup="fips-enabled-8xv96lzbm5cx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/fips-enabled-8xv96lzbm5cx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/fips-enabled-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc00090d780>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-4znnjj2bvmhl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-4znnjj2bvmhl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:111]: failed to create HCP cluster "cidr-connectivity-test" with authorized CIDRs Unexpected error: <fmt.wrapError \| 0xc00090d780>: failed to create HCP cluster cidr-connectivity-test: failed starting cluster creation "cidr-connectivity-test" in resourcegroup="e2e-cidr-connectivity-4znnjj2bvmhl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-4znnjj2bvmhl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapError \| 0xc00079e0e0>: failed to create HCP cluster idms-e2e-hcp-cluster: failed starting cluster creation "idms-e2e-hcp-cluster" in resourcegroup="idms-lpzbtxsqnsjm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-lpzbtxsqnsjm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:113]: failed to create HCP cluster with ImageDigestMirrors Unexpected error: <fmt.wrapError \| 0xc00079e0e0>: failed to create HCP cluster idms-e2e-hcp-cluster: failed starting cluster creation "idms-e2e-hcp-cluster" in resourcegroup="idms-lpzbtxsqnsjm": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/idms-lpzbtxsqnsjm/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/idms-e2e-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create node pools with ARM64-based VMs · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc0012a2120>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-fpsrssl7cjkj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-fpsrssl7cjkj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:88]: failed to create HCP cluster "arm64-vm-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc0012a2120>: failed to create HCP cluster arm64-vm-hcp-cluster: failed starting cluster creation "arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-fpsrssl7cjkj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/arm64-vm-cluster-fpsrssl7cjkj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/arm64-vm-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to cordon, drain, and uncordon a node in an HCP cluster · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:90]: failed to create HCP cluster cordon-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000f02640>: failed to create HCP cluster cordon-hcp-cluster: failed starting cluster creation "cordon-hcp-cluster" in resourcegroup="rg-cordon-test-svfw267gk9r2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-svfw267gk9r2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cordon-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_cordon.go:90]: failed to create HCP cluster cordon-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000f02640>: failed to create HCP cluster cordon-hcp-cluster: failed starting cluster creation "cordon-hcp-cluster" in resourcegroup="rg-cordon-test-svfw267gk9r2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cordon-test-svfw267gk9r2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cordon-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should create a cluster with private ingress using v20260901preview and verify the ingress is internal · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc000b66340>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-q4smrwpc7lth": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-q4smrwpc7lth/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_ingress.go:87]: failed to create HCP cluster "private-ingress" with private ingress Unexpected error: <fmt.wrapError \| 0xc000b66340>: failed to create HCP cluster private-ingress: failed starting cluster creation "private-ingress" in resourcegroup="private-ingress-q4smrwpc7lth": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-ingress-q4smrwpc7lth/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-ingress -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-20-6zw86fclhnhh/cluster-candidate-4-20-7rdtb7 should provision Unexpected error: <fmt.wrapError \| 0xc000ff62a0>: failed to create HCP cluster cluster-candidate-4-20-7rdtb7: failed starting cluster creation "cluster-candidate-4-20-7rdtb7" in resourcegroup="rg-candidate-4-20-6zw86fclhnhh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-6zw86fclhnhh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-20-7rdtb7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-20-6zw86fclhnhh/cluster-candidate-4-20-7rdtb7 should provision Unexpected error: <fmt.wrapError \| 0xc000ff62a0>: failed to create HCP cluster cluster-candidate-4-20-7rdtb7: failed starting cluster creation "cluster-candidate-4-20-7rdtb7" in resourcegroup="rg-candidate-4-20-6zw86fclhnhh": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-20-6zw86fclhnhh/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-20-7rdtb7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-21-gk8mbp" with version 4.21.33 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000d5e380>: failed to create HCP cluster cluster-zstream-4-21-gk8mbp: failed starting cluster creation "cluster-zstream-4-21-gk8mbp" in resourcegroup="rg-zstream-upgrade-4-21-k25gftsdpj5n": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-21-k25gftsdpj5n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-21-gk8mbp -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-21-gk8mbp" with version 4.21.33 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000d5e380>: failed to create HCP cluster cluster-zstream-4-21-gk8mbp: failed starting cluster creation "cluster-zstream-4-21-gk8mbp" in resourcegroup="rg-zstream-upgrade-4-21-k25gftsdpj5n": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-21-k25gftsdpj5n/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-21-gk8mbp -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should downgrade a nodepool to a lower minor version from 4.22.zLatest to 4.20.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:720]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000d32140>: failed to create HCP cluster np-dg-minor-89j949: failed starting cluster creation "np-dg-minor-89j949" in resourcegroup="rg-np-dg-minor-89j949-ftfm8c66f846": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-89j949-ftfm8c66f846/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-89j949 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:720]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc000d32140>: failed to create HCP cluster np-dg-minor-89j949: failed starting cluster creation "np-dg-minor-89j949" in resourcegroup="rg-np-dg-minor-89j949-ftfm8c66f846": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-dg-minor-89j949-ftfm8c66f846/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-dg-minor-89j949 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create a cluster with default autoscaling and a nodepool with autoscaling enabled up to replica limits · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapError \| 0xc0028ba100>: failed to create HCP cluster np-autoscale-cluster: failed starting cluster creation "np-autoscale-cluster" in resourcegroup="np-autoscaling-np755vjcrftf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-np755vjcrftf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_autoscaling.go:102]: failed to create HCP cluster np-autoscale-cluster Unexpected error: <fmt.wrapError \| 0xc0028ba100>: failed to create HCP cluster np-autoscale-cluster: failed starting cluster creation "np-autoscale-cluster" in resourcegroup="np-autoscaling-np755vjcrftf": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/np-autoscaling-np755vjcrftf/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-autoscale-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create a cluster and node pools with aggregated advanced features · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:208]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc0028b02a0>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-rrgpx55nq5gt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-rrgpx55nq5gt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_feature_aggregation.go:208]: failed to create HCP cluster "agg-cluster" with aggregated settings Unexpected error: <fmt.wrapError \| 0xc0028b02a0>: failed starting cluster creation "agg-cluster" in resourcegroup="feature-aggregation-rrgpx55nq5gt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/feature-aggregation-rrgpx55nq5gt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/agg-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create an HCP cluster then delete it by deleting the customer resource group · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000e5e360>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-79r5dzshjfjd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-79r5dzshjfjd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delete_cx_rg.go:90]: failed to create HCP cluster "cx-rg-hcp-cluster" Unexpected error: <fmt.wrapError \| 0xc000e5e360>: failed to create HCP cluster cx-rg-hcp-cluster: failed starting cluster creation "cx-rg-hcp-cluster" in resourcegroup="cx-rg-cluster-79r5dzshjfjd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/cx-rg-cluster-79r5dzshjfjd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cx-rg-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to issue the default ingress serving certificate from Let's Encrypt using cert-manager with ACME DNS-01 challenges · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc001526320>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-xwmd8q84hgkl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-xwmd8q84hgkl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_ingress_cert_letsencrypt.go:124]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc001526320>: failed to create HCP cluster ingress-cert-le: failed starting cluster creation "ingress-cert-le" in resourcegroup="ingress-cert-le-xwmd8q84hgkl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/ingress-cert-le-xwmd8q84hgkl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/ingress-cert-le -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should upgrade a nodepool to a version without Cincinnati upgrade edge z-stream upgrade without Cincinnati edge in 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:301]: failed to create HCP cluster np-noedge-bnwsnt Unexpected error: <fmt.wrapError \| 0xc0015e3040>: failed to create HCP cluster np-noedge-bnwsnt: failed starting cluster creation "np-noedge-bnwsnt" in resourcegroup="rg-np-noedge-bnwsnt-dgc7qmfcddg5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-noedge-bnwsnt-dgc7qmfcddg5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-noedge-bnwsnt -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:301]: failed to create HCP cluster np-noedge-bnwsnt Unexpected error: <fmt.wrapError \| 0xc0015e3040>: failed to create HCP cluster np-noedge-bnwsnt: failed starting cluster creation "np-noedge-bnwsnt" in resourcegroup="rg-np-noedge-bnwsnt-dgc7qmfcddg5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-noedge-bnwsnt-dgc7qmfcddg5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-noedge-bnwsnt -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-20-9s6lkg" with version 4.20.38 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000ef5020>: failed to create HCP cluster cluster-zstream-4-20-9s6lkg: failed starting cluster creation "cluster-zstream-4-20-9s6lkg" in resourcegroup="rg-zstream-upgrade-4-20-42cxz7mjjbj2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-42cxz7mjjbj2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-9s6lkg -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-4-20-9s6lkg" with version 4.20.38 on candidate channel Unexpected error: <fmt.wrapError \| 0xc000ef5020>: failed to create HCP cluster cluster-zstream-4-20-9s6lkg: failed starting cluster creation "cluster-zstream-4-20-9s6lkg" in resourcegroup="rg-zstream-upgrade-4-20-42cxz7mjjbj2": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-4-20-42cxz7mjjbj2/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-4-20-9s6lkg -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Service Provider should upgrade the control plane z-stream automatically on behalf of the customer for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-5-0-tjdjx7" with version 5.0.0-rc.2 on candidate channel Unexpected error: <fmt.wrapError \| 0xc0008c4440>: failed to create HCP cluster cluster-zstream-5-0-tjdjx7: failed starting cluster creation "cluster-zstream-5-0-tjdjx7" in resourcegroup="rg-zstream-upgrade-5-0-vzh67fzgfvck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-5-0-vzh67fzgfvck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-5-0-tjdjx7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_automated_z_stream_upgrade.go:123]: failed to create HCP cluster "cluster-zstream-5-0-tjdjx7" with version 5.0.0-rc.2 on candidate channel Unexpected error: <fmt.wrapError \| 0xc0008c4440>: failed to create HCP cluster cluster-zstream-5-0-tjdjx7: failed starting cluster creation "cluster-zstream-5-0-tjdjx7" in resourcegroup="rg-zstream-upgrade-5-0-vzh67fzgfvck": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-zstream-upgrade-5-0-vzh67fzgfvck/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-zstream-5-0-tjdjx7 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:99]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc000df82e0>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-6b525qt6f6jj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-6b525qt6f6jj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:99]: failed to create HCP cluster "private-kv-cluster" with private keyvault Unexpected error: <fmt.wrapError \| 0xc000df82e0>: failed starting cluster creation "private-kv-cluster" in resourcegroup="private-keyvault-6b525qt6f6jj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-keyvault-6b525qt6f6jj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kv-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should not be able to reuse subnets and NSGs between clusters · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc0014e6140>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-mgsrktnswwmv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-mgsrktnswwmv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_nsg_subnet_reuse.go:107]: failed to create seed HCP cluster basic-cluster Unexpected error: <fmt.wrapError \| 0xc0014e6140>: failed to create HCP cluster basic-cluster: failed starting cluster creation "basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-mgsrktnswwmv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-nsg-subnet-reuse-mgsrktnswwmv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/basic-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.21.z to 4.21.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-nqjgxv with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc0008d8220>: failed to create HCP cluster np-version-upgrade-cluster-nqjgxv: failed starting cluster creation "np-version-upgrade-cluster-nqjgxv" in resourcegroup="rg-np-version-upgrade-nqjgxv-f2wzh798npkj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-nqjgxv-f2wzh798npkj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-nqjgxv -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-nqjgxv with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc0008d8220>: failed to create HCP cluster np-version-upgrade-cluster-nqjgxv: failed starting cluster creation "np-version-upgrade-cluster-nqjgxv" in resourcegroup="rg-np-version-upgrade-nqjgxv-f2wzh798npkj": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-nqjgxv-f2wzh798npkj/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-nqjgxv -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should downgrade a nodepool version z-stream downgrade from 4.21.zLatest to 4.21.zPrevious · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:580]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc001b19a80>: failed to create HCP cluster np-downgrade-ppzl59: failed starting cluster creation "np-downgrade-ppzl59" in resourcegroup="rg-np-downgrade-ppzl59-6bp5w8kqrdc5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-ppzl59-6bp5w8kqrdc5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-ppzl59 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:580]: failed to create HCP cluster Unexpected error: <fmt.wrapError \| 0xc001b19a80>: failed to create HCP cluster np-downgrade-ppzl59: failed starting cluster creation "np-downgrade-ppzl59" in resourcegroup="rg-np-downgrade-ppzl59-6bp5w8kqrdc5": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-downgrade-ppzl59-6bp5w8kqrdc5/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-downgrade-ppzl59 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should upgrade and update a nodepool from 4.20.z to 4.21.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-w95bj9 with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc000d0c0e0>: failed to create HCP cluster np-version-upgrade-cluster-w95bj9: failed starting cluster creation "np-version-upgrade-cluster-w95bj9" in resourcegroup="rg-np-version-upgrade-w95bj9-bzlsbjrftkk4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-w95bj9-bzlsbjrftkk4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-w95bj9 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:146]: failed to create HCP cluster np-version-upgrade-cluster-w95bj9 with version 4.21.34 Unexpected error: <fmt.wrapError \| 0xc000d0c0e0>: failed to create HCP cluster np-version-upgrade-cluster-w95bj9: failed starting cluster creation "np-version-upgrade-cluster-w95bj9" in resourcegroup="rg-np-version-upgrade-w95bj9-bzlsbjrftkk4": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-version-upgrade-w95bj9-bzlsbjrftkk4/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-version-upgrade-cluster-w95bj9 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 4.21 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-21-9rlflwwnznkv/cluster-candidate-4-21-xhlsgk should provision Unexpected error: <fmt.wrapError \| 0xc000a52440>: failed to create HCP cluster cluster-candidate-4-21-xhlsgk: failed starting cluster creation "cluster-candidate-4-21-xhlsgk" in resourcegroup="rg-candidate-4-21-9rlflwwnznkv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-21-9rlflwwnznkv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-21-xhlsgk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-4-21-9rlflwwnznkv/cluster-candidate-4-21-xhlsgk should provision Unexpected error: <fmt.wrapError \| 0xc000a52440>: failed to create HCP cluster cluster-candidate-4-21-xhlsgk: failed starting cluster creation "cluster-candidate-4-21-xhlsgk" in resourcegroup="rg-candidate-4-21-9rlflwwnznkv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-4-21-9rlflwwnznkv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-4-21-xhlsgk -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should upgrade a nodepool skipping one minor version (+2) from 4.20.z to 4.22.zLatest · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:441]: failed to create HCP cluster np-skip-minor-vsjwr4 at version 4.22.15 Unexpected error: <fmt.wrapError \| 0xc000a2c700>: failed to create HCP cluster np-skip-minor-vsjwr4: failed starting cluster creation "np-skip-minor-vsjwr4" in resourcegroup="rg-np-skip-minor-vsjwr4-bsn56prrsfv6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-vsjwr4-bsn56prrsfv6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-vsjwr4 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/nodepool_version_upgrade.go:441]: failed to create HCP cluster np-skip-minor-vsjwr4 at version 4.22.15 Unexpected error: <fmt.wrapError \| 0xc000a2c700>: failed to create HCP cluster np-skip-minor-vsjwr4: failed starting cluster creation "np-skip-minor-vsjwr4" in resourcegroup="rg-np-skip-minor-vsjwr4-bsn56prrsfv6": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-np-skip-minor-vsjwr4-bsn56prrsfv6/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/np-skip-minor-vsjwr4 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should create a cluster with private KAS and verify API server is only reachable from VNet while ingress remains public · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:91]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc0010f2180>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-hxl9zp97mlgn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-hxl9zp97mlgn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kas.go:91]: failed to create HCP cluster "private-kas" with private KAS Unexpected error: <fmt.wrapError \| 0xc0010f2180>: failed to create HCP cluster private-kas: failed starting cluster creation "private-kas" in resourcegroup="private-kas-hxl9zp97mlgn": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/private-kas-hxl9zp97mlgn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/private-kas -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should create a cluster using v20260901preview API and verify cluster health · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc001040140>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-t4djcjjxltjt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-t4djcjjxltjt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_v20260901preview.go:86]: failed to create HCP cluster "v20260901" via v20260901preview Unexpected error: <fmt.wrapError \| 0xc001040140>: failed to create HCP cluster v20260901: failed starting cluster creation "v20260901" in resourcegroup="v20260901preview-t4djcjjxltjt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/v20260901preview-t4djcjjxltjt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/v20260901 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.22 minor to 5.0 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-0-tgns2n" at install version 4.22 Unexpected error: <fmt.wrapError \| 0xc0015630c0>: failed to create HCP cluster cp-ystream-upgrade-5-0-tgns2n: failed starting cluster creation "cp-ystream-upgrade-5-0-tgns2n" in resourcegroup="rg-cp-ystream-upgrade-5-0-rxzl7kxnnt9c": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-rxzl7kxnnt9c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-0-tgns2n -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-5-0-tgns2n" at install version 4.22 Unexpected error: <fmt.wrapError \| 0xc0015630c0>: failed to create HCP cluster cp-ystream-upgrade-5-0-tgns2n: failed starting cluster creation "cp-ystream-upgrade-5-0-tgns2n" in resourcegroup="rg-cp-ystream-upgrade-5-0-rxzl7kxnnt9c": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-5-0-rxzl7kxnnt9c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-5-0-tgns2n -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create an HCP cluster with Image Registry not present · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapError \| 0xc000a38260>: failed to create HCP cluster disabled-image-registry-hcp-cluster: failed starting cluster creation "disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-cqdlgmxn4w4v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-cqdlgmxn4w4v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/image_registry_cluster_create.go:89]: failed to create HCP cluster with image registry disabled Unexpected error: <fmt.wrapError \| 0xc000a38260>: failed to create HCP cluster disabled-image-registry-hcp-cluster: failed starting cluster creation "disabled-image-registry-hcp-cluster" in resourcegroup="disabled-image-registry-cqdlgmxn4w4v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/disabled-image-registry-cqdlgmxn4w4v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/disabled-image-registry-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create an HCP cluster with back-level version 4.20 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc000564120>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-z7q4w677jrcv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-z7q4w677jrcv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_version_backlevel.go:152]: failed to create HCP cluster version 4.20 Unexpected error: <fmt.wrapError \| 0xc000564120>: failed starting cluster creation "cluster-ver-4-20" in resourcegroup="rg-cluster-back-version-z7q4w677jrcv": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cluster-back-version-z7q4w677jrcv/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-ver-4-20 -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to use workload identity via the cluster OIDC issuer URL · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:227]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapError \| 0xc001002280>: failed to create HCP cluster oidc-wi-cluster: failed starting cluster creation "oidc-wi-cluster" in resourcegroup="oidc-wi-9zmvzjspzdbt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-9zmvzjspzdbt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/oidc_issuer_workload_identity.go:227]: failed to create HCP cluster oidc-wi-cluster Unexpected error: <fmt.wrapError \| 0xc001002280>: failed to create HCP cluster oidc-wi-cluster: failed starting cluster creation "oidc-wi-cluster" in resourcegroup="oidc-wi-9zmvzjspzdbt": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/oidc-wi-9zmvzjspzdbt/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/oidc-wi-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.21 minor to 4.22 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-tpgm4r" at install version 4.21 Unexpected error: <fmt.wrapError \| 0xc0018b0120>: failed to create HCP cluster cp-ystream-upgrade-4-22-tpgm4r: failed starting cluster creation "cp-ystream-upgrade-4-22-tpgm4r" in resourcegroup="rg-cp-ystream-upgrade-4-22-mgqcx8h7xftx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-mgqcx8h7xftx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-22-tpgm4r -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-22-tpgm4r" at install version 4.21 Unexpected error: <fmt.wrapError \| 0xc0018b0120>: failed to create HCP cluster cp-ystream-upgrade-4-22-tpgm4r: failed starting cluster creation "cp-ystream-upgrade-4-22-tpgm4r" in resourcegroup="rg-cp-ystream-upgrade-4-22-mgqcx8h7xftx": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-22-mgqcx8h7xftx/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-22-tpgm4r -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test ARO HCP Service should successfully provision cluster when MI role assignments are added after cluster creation · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc0018261e0>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-qh5rmkcjlrnr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_delayed_role_assignments.go:140]: failed to start cluster creation Unexpected error: <exported.ResponseError \| 0xc0018261e0>: PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/delayed-rbac-qh5rmkcjlrnr/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/delayed-rbac-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to list available HCP OpenShift versions and validate response content · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc00156e5a0>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_versions.go:43]: failed to list HCP OpenShift versions Unexpected error: <exported.ResponseError \| 0xc00156e5a0>: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOpenShiftVersions -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:107]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc000700140>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-nqkrft7rwghd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-nqkrft7rwghd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_complex_cilium_kv.go:107]: failed to create HCP cluster "cilium-cluster" with no CNI and private etcd Unexpected error: <fmt.wrapError \| 0xc000700140>: failed starting cluster creation "cilium-cluster" in resourcegroup="complex-cilium-kv-nqkrft7rwghd": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/complex-cilium-kv-nqkrft7rwghd/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cilium-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to test admin credentials before cluster ready, then full admin credential lifecycle · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:103]: failed to begin creating HCP cluster "admin-cred-lifecycle-962qjz" Unexpected error: <fmt.wrapError \| 0xc0010fa1e0>: failed starting cluster creation "admin-cred-lifecycle-962qjz" in resourcegroup="admin-credential-lifecycle-test-7znlrnsb4d2v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-7znlrnsb4d2v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-962qjz -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:103]: failed to begin creating HCP cluster "admin-cred-lifecycle-962qjz" Unexpected error: <fmt.wrapError \| 0xc0010fa1e0>: failed starting cluster creation "admin-cred-lifecycle-962qjz" in resourcegroup="admin-credential-lifecycle-test-7znlrnsb4d2v": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/admin-credential-lifecycle-test-7znlrnsb4d2v/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/admin-cred-lifecycle-962qjz -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should create an HCP cluster and validate TLS certificates · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc001010120>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-qgdl4c87lvcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-qgdl4c87lvcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:96]: failed to create HCP cluster for TLS endpoint test Unexpected error: <fmt.wrapError \| 0xc001010120>: failed to create HCP cluster tls-endpoint-hcp-cluster: failed starting cluster creation "tls-endpoint-hcp-cluster" in resourcegroup="tls-endpoint-cluster-qgdl4c87lvcl": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/tls-endpoint-cluster-qgdl4c87lvcl/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/tls-endpoint-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to forward control plane logs to a storage account and Event Hub via shoebox diagnostic settings · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:272]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000d823c0>: failed to create HCP cluster shoebox-hcp-cluster: failed starting cluster creation "shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-gf5rj7zc4bks": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-gf5rj7zc4bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/shoebox-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/shoebox_logs.go:272]: failed to create HCP cluster shoebox-hcp-cluster Unexpected error: <fmt.wrapError \| 0xc000d823c0>: failed to create HCP cluster shoebox-hcp-cluster: failed starting cluster creation "shoebox-hcp-cluster" in resourcegroup="shoebox-cluster-gf5rj7zc4bks": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/shoebox-cluster-gf5rj7zc4bks/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/shoebox-hcp-cluster -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test Customer should be able to successfully upgrade control plane minor version from 4.20 minor to 4.21 minor · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-21-bv2pbs" at install version 4.20 Unexpected error: <fmt.wrapError \| 0xc000a3e1c0>: failed to create HCP cluster cp-ystream-upgrade-4-21-bv2pbs: failed starting cluster creation "cp-ystream-upgrade-4-21-bv2pbs" in resourcegroup="rg-cp-ystream-upgrade-4-21-x9l8w25mj4c7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-x9l8w25mj4c7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-21-bv2pbs -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/control_plane_minor_upgrade.go:133]: failed to create HCP cluster "cp-ystream-upgrade-4-21-bv2pbs" at install version 4.20 Unexpected error: <fmt.wrapError \| 0xc000a3e1c0>: failed to create HCP cluster cp-ystream-upgrade-4-21-bv2pbs: failed starting cluster creation "cp-ystream-upgrade-4-21-bv2pbs" in resourcegroup="rg-cp-ystream-upgrade-4-21-x9l8w25mj4c7": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-cp-ystream-upgrade-4-21-x9l8w25mj4c7/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cp-ystream-upgrade-4-21-bv2pbs -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred ERROR CODE: BadGatewayConnection; detail message The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request.; provider Microsoft.RedHatOpenShift 02:00:41 UTC · failed at e2e · test ARO-HCP should be able to perform a control plane and node pool install with OCP candidate channel for 5.0 · suite stage/parallel Show raw failure fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-5-0-zf2lwttkqm8b/cluster-candidate-5-0-sfstjx should provision Unexpected error: <fmt.wrapError \| 0xc000aa2160>: failed to create HCP cluster cluster-candidate-5-0-sfstjx: failed starting cluster creation "cluster-candidate-5-0-sfstjx" in resourcegroup="rg-candidate-5-0-zf2lwttkqm8b": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-zf2lwttkqm8b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-5-0-sfstjx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred fail [github.com/Azure/ARO-HCP/test/e2e/complete_cluster_create_multiversion.go:123]: HCP cluster rg-candidate-5-0-zf2lwttkqm8b/cluster-candidate-5-0-sfstjx should provision Unexpected error: <fmt.wrapError \| 0xc000aa2160>: failed to create HCP cluster cluster-candidate-5-0-sfstjx: failed starting cluster creation "cluster-candidate-5-0-sfstjx" in resourcegroup="rg-candidate-5-0-zf2lwttkqm8b": PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/rg-candidate-5-0-zf2lwttkqm8b/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cluster-candidate-5-0-sfstjx -------------------------------------------------------------------------------- RESPONSE 502: 502 Bad Gateway ERROR CODE: BadGatewayConnection -------------------------------------------------------------------------------- { "error": { "code": "BadGatewayConnection", "message": "The network connectivity issue encountered for 'Microsoft.RedHatOpenShift'; cannot fulfill the request." } } -------------------------------------------------------------------------------- ... occurred