CIHealth
<
Single Day: Mar 11▾
Last 7 Days Weekly: Mar 9 - Mar 15 Sprint: Mar 2 - Mar 15 Single Day: Mar 11
Custom time window
> Reset
View JSON API

Environment: INT

Failure patterns: 7 · Failures matched: 15 · Total runs: 9 · Runs affected: 7

Failure patternThe canonical description of a recurring CI failure, extracted and normalized from raw logs.Failed atThe stage of the job run where this failure occurred: 'provision' (environment setup, DEV only), 'e2e' (test suite execution), or 'other' (CI infrastructure issues that did not produce a failure pattern).Number of distinct job runs where this failure pattern was detected.Percentage of all job runs in this environment affected by this failure pattern during the selected window.Classification of this failure pattern: Regression (likely caused by a specific PR), Flake (intermittent failure spread across days), Noise (low-quality or generic pattern), or Indeterminate.TrendShows daily activity for this failure pattern in a trailing window anchored to the selected end date. The sparkline covers at least 7 days and at most 14 days, depending on the current window size.Also inOther environments where the same failure pattern was also detected during the selected window.
ERROR CODE: InvalidIdentityValues; provider Microsoft.ManagedIdentity
full failure pattern:
ERROR CODE: InvalidIdentityValues; provider Microsoft.ManagedIdentity
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e444.44%4 of 9 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsMar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 4none
Full failure examples (3)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
    <*exported.ResponseError | 0xc000f97890>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-zpzk8c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidIdentityValues
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidIdentityValues",
        "message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        ErrorCode: "InvalidIdentityValues",
        StatusCode: 400,
        RawResponse: {
            Status: "400 Bad Request",
            StatusCode: 400,
            Proto: "HTTP/2.0",
            ProtoMajor: 2,
            ProtoMinor: 0,
            Header: {
                "X-Ms-Routing-Request-Id": [
                    "UKSOUTH:20260311T151231Z:9c11778c-ff60-487b-a423-651593da8efe",
                ],
                "Strict-Transport-Security": [
                    "max-age=31536000; includeSubDomains",
                ],
                "X-Msedge-Ref": [
                    "Ref A: 4505E2BF16A0421FA071A149B08EF585 Ref B: CHI261140504060 Ref C: 2026-03-11T15:12:31Z",
                ],
                "Cache-Control": ["no-cache"],
                "Content-Type": [
                    "application/json; charset=utf-8",
                ],
                "X-Ms-Failure-Cause": ["gateway"],
                "X-Content-Type-Options": ["nosniff"],
                "X-Cache": ["CONFIG_NOCACHE"],
                "Date": [
                    "Wed, 11 Mar 2026 15:12:31 GMT",
                ],
                "Pragma": ["no-cache"],
                "Content-Length": ["1927"],
                "Expires": ["-1"],
                "X-Ms-Request-Id": [
                    "9c11778c-ff60-487b-a423-651593da8efe",
                ],
                "X-Ms-Correlation-Request-Id": [
                    "9c11778c-ff60-487b-a423-651593da8efe",
                ],
            },
            Body: <*exported.nopClosingBytesReader | 0xc001100fc0>{
                s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
                i: 0,
            },
            ContentLength: 1927,
            TransferEncoding: nil,
            Close: false,
            Uncompressed: false,
            Trailer: nil,
            Request: {
                Method: "PUT",
                URL: {
                    Scheme: "https",
                    Opaque: "",
                    User: nil,
                    Host: "management.azure.com",
                    Path: "/subscriptions/64f0619f-ebc2-4156-...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
    <*exported.ResponseError | 0xc000f97890>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-zpzk8c/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidIdentityValues
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidIdentityValues",
        "message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        ErrorCode: "InvalidIdentityValues",
        StatusCode: 400,
        RawResponse: {
            Status: "400 Bad Request",
            StatusCode: 400,
            Proto: "HTTP/2.0",
            ProtoMajor: 2,
            ProtoMinor: 0,
            Header: {
                "X-Ms-Routing-Request-Id": [
                    "UKSOUTH:20260311T151231Z:9c11778c-ff60-487b-a423-651593da8efe",
                ],
                "Strict-Transport-Security": [
                    "max-age=31536000; includeSubDomains",
                ],
                "X-Msedge-Ref": [
                    "Ref A: 4505E2BF16A0421FA071A149B08EF585 Ref B: CHI261140504060 Ref C: 2026-03-11T15:12:31Z",
                ],
                "Cache-Control": ["no-cache"],
                "Content-Type": [
                    "application/json; charset=utf-8",
                ],
                "X-Ms-Failure-Cause": ["gateway"],
                "X-Content-Type-Options": ["nosniff"],
                "X-Cache": ["CONFIG_NOCACHE"],
                "Date": [
                    "Wed, 11 Mar 2026 15:12:31 GMT",
                ],
                "Pragma": ["no-cache"],
                "Content-Length": ["1927"],
                "Expires": ["-1"],
                "X-Ms-Request-Id": [
                    "9c11778c-ff60-487b-a423-651593da8efe",
                ],
                "X-Ms-Correlation-Request-Id": [
                    "9c11778c-ff60-487b-a423-651593da8efe",
                ],
            },
            Body: <*exported.nopClosingBytesReader | 0xc001100fc0>{
                s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-8/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
                i: 0,
            },
            ContentLength: 1927,
            TransferEncoding: nil,
            Close: false,
            Uncompressed: false,
            Trailer: nil,
            Request: {
                Method: "PUT",
                URL: {
                    Scheme: "https",
                    Opaque: "",
                    User: nil,
                    Host: "management.azure.com",
                    Path: "/subscriptions/64f0619f-ebc2-4156-...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
    <*exported.ResponseError | 0xc0009bd380>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nld688/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidIdentityValues
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidIdentityValues",
        "message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        ErrorCode: "InvalidIdentityValues",
        StatusCode: 400,
        RawResponse: {
            Status: "400 Bad Request",
            StatusCode: 400,
            Proto: "HTTP/2.0",
            ProtoMajor: 2,
            ProtoMinor: 0,
            Header: {
                "Cache-Control": ["no-cache"],
                "Pragma": ["no-cache"],
                "Content-Type": [
                    "application/json; charset=utf-8",
                ],
                "Expires": ["-1"],
                "X-Ms-Routing-Request-Id": [
                    "UKSOUTH:20260311T130855Z:1f5ad0e5-72af-4f34-87a3-cbd696db9711",
                ],
                "Strict-Transport-Security": [
                    "max-age=31536000; includeSubDomains",
                ],
                "X-Content-Type-Options": ["nosniff"],
                "X-Cache": ["CONFIG_NOCACHE"],
                "Content-Length": ["1937"],
                "X-Ms-Failure-Cause": ["gateway"],
                "X-Ms-Request-Id": [
                    "1f5ad0e5-72af-4f34-87a3-cbd696db9711",
                ],
                "X-Ms-Correlation-Request-Id": [
                    "1f5ad0e5-72af-4f34-87a3-cbd696db9711",
                ],
                "X-Msedge-Ref": [
                    "Ref A: 79888FDC7E984BA8A98CF39D24F6722A Ref B: CH1AA2020610011 Ref C: 2026-03-11T13:08:55Z",
                ],
                "Date": [
                    "Wed, 11 Mar 2026 13:08:54 GMT",
                ],
            },
            Body: <*exported.nopClosingBytesReader | 0xc000d91100>{
                s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
                i: 0,
            },
            ContentLength: 1937,
            TransferEncoding: nil,
            Close: false,
            Uncompressed: false,
            Trailer: nil,
            Request: {
                Method: "PUT",
                URL: {
                    Scheme: "https",
                    Opaque: "",
                    User: nil,
                    Host: "management.azure.com",
                    Path: "/subscriptions/64f0619f-...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
    <*exported.ResponseError | 0xc0009bd380>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-nld688/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidIdentityValues
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidIdentityValues",
        "message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        ErrorCode: "InvalidIdentityValues",
        StatusCode: 400,
        RawResponse: {
            Status: "400 Bad Request",
            StatusCode: 400,
            Proto: "HTTP/2.0",
            ProtoMajor: 2,
            ProtoMinor: 0,
            Header: {
                "Cache-Control": ["no-cache"],
                "Pragma": ["no-cache"],
                "Content-Type": [
                    "application/json; charset=utf-8",
                ],
                "Expires": ["-1"],
                "X-Ms-Routing-Request-Id": [
                    "UKSOUTH:20260311T130855Z:1f5ad0e5-72af-4f34-87a3-cbd696db9711",
                ],
                "Strict-Transport-Security": [
                    "max-age=31536000; includeSubDomains",
                ],
                "X-Content-Type-Options": ["nosniff"],
                "X-Cache": ["CONFIG_NOCACHE"],
                "Content-Length": ["1937"],
                "X-Ms-Failure-Cause": ["gateway"],
                "X-Ms-Request-Id": [
                    "1f5ad0e5-72af-4f34-87a3-cbd696db9711",
                ],
                "X-Ms-Correlation-Request-Id": [
                    "1f5ad0e5-72af-4f34-87a3-cbd696db9711",
                ],
                "X-Msedge-Ref": [
                    "Ref A: 79888FDC7E984BA8A98CF39D24F6722A Ref B: CH1AA2020610011 Ref C: 2026-03-11T13:08:55Z",
                ],
                "Date": [
                    "Wed, 11 Mar 2026 13:08:54 GMT",
                ],
            },
            Body: <*exported.nopClosingBytesReader | 0xc000d91100>{
                s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-67/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
                i: 0,
            },
            ContentLength: 1937,
            TransferEncoding: nil,
            Close: false,
            Uncompressed: false,
            Trailer: nil,
            Request: {
                Method: "PUT",
                URL: {
                    Scheme: "https",
                    Opaque: "",
                    User: nil,
                    Host: "management.azure.com",
                    Path: "/subscriptions/64f0619f-...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
    <*exported.ResponseError | 0xc00087cb10>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-q89nkn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidIdentityValues
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidIdentityValues",
        "message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        ErrorCode: "InvalidIdentityValues",
        StatusCode: 400,
        RawResponse: {
            Status: "400 Bad Request",
            StatusCode: 400,
            Proto: "HTTP/2.0",
            ProtoMajor: 2,
            ProtoMinor: 0,
            Header: {
                "Expires": ["-1"],
                "X-Ms-Request-Id": [
                    "5d0f1a83-e9e3-4322-9402-079527a36e43",
                ],
                "X-Ms-Correlation-Request-Id": [
                    "5d0f1a83-e9e3-4322-9402-079527a36e43",
                ],
                "Strict-Transport-Security": [
                    "max-age=31536000; includeSubDomains",
                ],
                "X-Msedge-Ref": [
                    "Ref A: 7799C63EF4DB4BDE88CFAD7F106271DB Ref B: CHI261140512040 Ref C: 2026-03-11T06:03:42Z",
                ],
                "Pragma": ["no-cache"],
                "Content-Length": ["1947"],
                "X-Ms-Failure-Cause": ["gateway"],
                "X-Ms-Routing-Request-Id": [
                    "UKSOUTH:20260311T060342Z:5d0f1a83-e9e3-4322-9402-079527a36e43",
                ],
                "X-Content-Type-Options": ["nosniff"],
                "X-Cache": ["CONFIG_NOCACHE"],
                "Date": [
                    "Wed, 11 Mar 2026 06:03:41 GMT",
                ],
                "Cache-Control": ["no-cache"],
                "Content-Type": [
                    "application/json; charset=utf-8",
                ],
            },
            Body: <*exported.nopClosingBytesReader | 0xc00011d160>{
                s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
                i: 0,
            },
            ContentLength: 1947,
            TransferEncoding: nil,
            Close: false,
            Uncompressed: false,
            Trailer: nil,
            Request: {
                Method: "PUT",
                URL: {
                    Scheme: "https",
                    Opaque: "",
                    User: nil,
                    Host: "management.azure.com",
                    Path: "/subscriptions...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:415]: Unexpected error:
    <*exported.ResponseError | 0xc00087cb10>: 
    PUT https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/e2e-cidr-connectivity-q89nkn/providers/Microsoft.RedHatOpenShift/hcpOpenShiftClusters/cidr-connectivity-test
    --------------------------------------------------------------------------------
    RESPONSE 400: 400 Bad Request
    ERROR CODE: InvalidIdentityValues
    --------------------------------------------------------------------------------
    {
      "error": {
        "code": "InvalidIdentityValues",
        "message": "Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests."
      }
    }
    --------------------------------------------------------------------------------
    
    {
        ErrorCode: "InvalidIdentityValues",
        StatusCode: 400,
        RawResponse: {
            Status: "400 Bad Request",
            StatusCode: 400,
            Proto: "HTTP/2.0",
            ProtoMajor: 2,
            ProtoMinor: 0,
            Header: {
                "Expires": ["-1"],
                "X-Ms-Request-Id": [
                    "5d0f1a83-e9e3-4322-9402-079527a36e43",
                ],
                "X-Ms-Correlation-Request-Id": [
                    "5d0f1a83-e9e3-4322-9402-079527a36e43",
                ],
                "Strict-Transport-Security": [
                    "max-age=31536000; includeSubDomains",
                ],
                "X-Msedge-Ref": [
                    "Ref A: 7799C63EF4DB4BDE88CFAD7F106271DB Ref B: CHI261140512040 Ref C: 2026-03-11T06:03:42Z",
                ],
                "Pragma": ["no-cache"],
                "Content-Length": ["1947"],
                "X-Ms-Failure-Cause": ["gateway"],
                "X-Ms-Routing-Request-Id": [
                    "UKSOUTH:20260311T060342Z:5d0f1a83-e9e3-4322-9402-079527a36e43",
                ],
                "X-Content-Type-Options": ["nosniff"],
                "X-Cache": ["CONFIG_NOCACHE"],
                "Date": [
                    "Wed, 11 Mar 2026 06:03:41 GMT",
                ],
                "Cache-Control": ["no-cache"],
                "Content-Type": [
                    "application/json; charset=utf-8",
                ],
            },
            Body: <*exported.nopClosingBytesReader | 0xc00011d160>{
                s: "{\"error\":{\"code\":\"InvalidIdentityValues\",\"message\":\"Invalid value for the identities '/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-controller-manager,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cloud-network-config,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/cluster-api-azure,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/control-plane,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/disk-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/file-csi-driver,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/image-registry,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/ingress,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/kms,/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/resourceGroups/aro-hcp-test-msi-containers-int-143/providers/Microsoft.ManagedIdentity/userAssignedIdentities/service'. The 'UserAssignedIdentities' property keys should only be empty null during PATCH requests.\"}}",
                i: 0,
            },
            ContentLength: 1947,
            TransferEncoding: nil,
            Close: false,
            Uncompressed: false,
            Trailer: nil,
            Request: {
                Method: "PUT",
                URL: {
                    Scheme: "https",
                    Opaque: "",
                    User: nil,
                    Host: "management.azure.com",
                    Path: "/subscriptions...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
Contributing tests (1)
Failed AtJobTestSupport
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelAuthorized CIDRs Connectivity should allow API access only from authorized VM IP4
Affected runs (4)
Date (UTC)Associated PRProw job
n/a2031742424082026496
n/a2031711680643207168
n/a2031604521683128320
n/a2031571552545280000
not to be nil
full failure pattern:
not to be nil
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e333.33%3 of 9 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsMar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 5none
Full failure examples (2)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:91]: Expected
    <*string | 0x0>: nil
not to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_tls_endpoints.go:91]: Expected
    <*string | 0x0>: nil
not to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:145]: Expected
    <*string | 0x0>: nil
not to be nil
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:145]: Expected
    <*string | 0x0>: nil
not to be nil
Contributing tests (2)
Failed AtJobTestSupport
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelCustomer should create an HCP cluster and validate TLS certificates3
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelAuthorized CIDRs Connectivity should allow API access only from authorized VM IP2
Affected runs (3)
Date (UTC)Associated PRProw job
n/a2031775377503817728
n/a2031675611008733184
n/a2031571552545280000
ERROR CODE: InternalServerError; context ; provider Microsoft.Network
full failure pattern:
ERROR CODE: InternalServerError; context ; provider Microsoft.Network
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e111.11%1 of 9 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsMar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 2none
Full failure examples (2)
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapError | 0xc000c720a0>: 
    failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-qkwf4p" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619",
      "name": "0b05f658-bbb6-452d-b845-92443ec2c619",
      "status": "Failed",
      "startTime": "2026-03-11T03:36:35.705780329Z",
      "endTime": "2026-03-11T03:38:07.574131728Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"message\": \"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\",\n    \"details\": []\n  }\n}\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n  \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc000c72080>{
            msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n  \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc00144fd10>{
                ErrorCode: "InternalServerError",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:93]: Unexpected error:
    <*fmt.wrapError | 0xc000c720a0>: 
    failed to create HCP cluster ea-cluster: failed waiting for cluster="ea-cluster" in resourcegroup="external-auth-cluster-qkwf4p" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619",
      "name": "0b05f658-bbb6-452d-b845-92443ec2c619",
      "status": "Failed",
      "startTime": "2026-03-11T03:36:35.705780329Z",
      "endTime": "2026-03-11T03:38:07.574131728Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"message\": \"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\",\n    \"details\": []\n  }\n}\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster ea-cluster: failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n  \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc000c72080>{
            msg: "failed waiting for cluster=\"ea-cluster\" in resourcegroup=\"external-auth-cluster-qkwf4p\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"name\": \"0b05f658-bbb6-452d-b845-92443ec2c619\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:35.705780329Z\",\n  \"endTime\": \"2026-03-11T03:38:07.574131728Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation de3f3e34-ee55-4c5b-bdc7-7cbf3170faf2 not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc00144fd10>{
                ErrorCode: "InternalServerError",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Ratelimit-Remaining-Subscription-Reads": ["249"],
...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapError | 0xc0000d9940>: 
    failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-6h5tqt" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
      "name": "5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
      "status": "Failed",
      "startTime": "2026-03-11T03:36:37.014555279Z",
      "endTime": "2026-03-11T03:38:07.990052924Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"message\": \"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\",\n    \"details\": []\n  }\n}\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n  \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc0000d9900>{
            msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n  \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc000f006c0>{
                ErrorCode: "InternalServerError",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Routing-Request-Id": [
       ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
fail [github.com/Azure/ARO-HCP/test/e2e/arm64_nodepool.go:90]: Unexpected error:
    <*fmt.wrapError | 0xc0000d9940>: 
    failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster="arm64-vm-hcp-cluster" in resourcegroup="arm64-vm-cluster-6h5tqt" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb
    --------------------------------------------------------------------------------
    RESPONSE 200: 200 OK
    ERROR CODE: InternalServerError
    --------------------------------------------------------------------------------
    {
      "id": "/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
      "name": "5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb",
      "status": "Failed",
      "startTime": "2026-03-11T03:36:37.014555279Z",
      "endTime": "2026-03-11T03:38:07.990052924Z",
      "error": {
        "code": "InternalServerError",
        "message": "GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\n--------------------------------------------------------------------------------\nRESPONSE 404: 404 Not Found\nERROR CODE UNAVAILABLE\n--------------------------------------------------------------------------------\n{\n  \"error\": {\n    \"message\": \"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\",\n    \"details\": []\n  }\n}\n--------------------------------------------------------------------------------\n"
      }
    }
    --------------------------------------------------------------------------------
    
    {
        msg: "failed to create HCP cluster arm64-vm-hcp-cluster: failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n  \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
        err: <*fmt.wrapError | 0xc0000d9900>{
            msg: "failed waiting for cluster=\"arm64-vm-hcp-cluster\" in resourcegroup=\"arm64-vm-cluster-6h5tqt\" to finish creating: GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\n--------------------------------------------------------------------------------\nRESPONSE 200: 200 OK\nERROR CODE: InternalServerError\n--------------------------------------------------------------------------------\n{\n  \"id\": \"/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.RedHatOpenShift/locations/uksouth/hcpOperationStatuses/5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"name\": \"5c49f2a2-a1d3-45dc-b6e8-265bbbe3eadb\",\n  \"status\": \"Failed\",\n  \"startTime\": \"2026-03-11T03:36:37.014555279Z\",\n  \"endTime\": \"2026-03-11T03:38:07.990052924Z\",\n  \"error\": {\n    \"code\": \"InternalServerError\",\n    \"message\": \"GET https://management.azure.com/subscriptions/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX/providers/Microsoft.Network/locations/uksouth/operations/bcedbd48-06f7-4d82-a965-ffd4f43ad6ae\\n--------------------------------------------------------------------------------\\nRESPONSE 404: 404 Not Found\\nERROR CODE UNAVAILABLE\\n--------------------------------------------------------------------------------\\n{\\n  \\\"error\\\": {\\n    \\\"message\\\": \\\"Operation bcedbd48-06f7-4d82-a965-ffd4f43ad6ae not found.\\\",\\n    \\\"details\\\": []\\n  }\\n}\\n--------------------------------------------------------------------------------\\n\"\n  }\n}\n--------------------------------------------------------------------------------\n",
            err: <*exported.ResponseError | 0xc000f006c0>{
                ErrorCode: "InternalServerError",
                StatusCode: 200,
                RawResponse: {
                    Status: "200 OK",
                    StatusCode: 200,
                    Proto: "HTTP/2.0",
                    ProtoMajor: 2,
                    ProtoMinor: 0,
                    Header: {
                        "X-Ms-Routing-Request-Id": [
       ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

occurred
Contributing tests (2)
Failed AtJobTestSupport
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelCustomer should be able to create a cluster with an external auth config and get the external auth config1
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelCustomer should be able to create node pools with ARM64-based VMs1
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2031571552545280000
Interrupted by User
full failure pattern:
Interrupted by User
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)
e2e111.11%1 of 9 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)Show trend detailsMar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1none
Full failure examples (1)
fail [:0]: Interrupted by User
fail [:0]: Interrupted by User
Contributing tests (1)
Failed AtJobTestSupport
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelAuthorized CIDRs Connectivity should allow API access only from authorized VM IP1
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2031521952853659648
Cluster provisioning failed
full failure pattern:
Cluster provisioning failed
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e111.11%1 of 9 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsMar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:152]: Cluster provisioning failed
fail [github.com/Azure/ARO-HCP/test/e2e/admin_credential_lifecycle.go:152]: Cluster provisioning failed
Contributing tests (1)
Failed AtJobTestSupport
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelCustomer should be able to test admin credentials before cluster ready, then full admin credential lifecycle1
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2031571552545280000
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: c...
full failure pattern:
failed to cleanup resource group: at least one HCP cluster <cluster> to delete: failed waiting for hcpcluster="<cluster>" in resourcegroup="<resource-group>" to finish deleting: context canceled
Signal: IndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior history
e2e111.11%1 of 9 job runs affectedIndeterminateSignal: Indeterminate — no prior history; active 1 day(s) — New failure pattern — no prior historyShow trend detailsMar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000013548>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-wfxt59" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000c83c80>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-wfxt59\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000c83c60>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-wfxt59\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000c83c40>{
                        msg: "failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-wfxt59\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0xb0680c0>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
fail [github.com/Azure/ARO-HCP/test/util/framework/per_test_framework.go:243] A node timeout occurred and then the following failure was recorded in the timedout node before it exited:
Unexpected error:
    <*errors.joinError | 0xc000013548>: 
    failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster="basic-cluster" in resourcegroup="rg-cluster-nsg-subnet-reuse-wfxt59" to finish deleting: context canceled
    {
        errs: [
            <*fmt.wrapError | 0xc000c83c80>{
                msg: "failed to cleanup resource group: at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-wfxt59\" to finish deleting: context canceled",
                err: <*fmt.wrapError | 0xc000c83c60>{
                    msg: "at least one hcp cluster failed to delete: failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-wfxt59\" to finish deleting: context canceled",
                    err: <*fmt.wrapError | 0xc000c83c40>{
                        msg: "failed waiting for hcpCluster=\"basic-cluster\" in resourcegroup=\"rg-cluster-nsg-subnet-reuse-wfxt59\" to finish deleting: context canceled",
                        err: <*errors.errorString | 0xb0680c0>{
                            s: "context canceled",
                        },
                    },
                },
            },
        ],
    }
occurred  
fail [:0]: A node timeout occurred
Contributing tests (1)
Failed AtJobTestSupport
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelCustomer should not be able to reuse subnets and NSGs between clusters1
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2031742424082026496
timeout during CreateHCPClusterAndWait; context deadline exceeded
full failure pattern:
timeout during CreateHCPClusterAndWait; context deadline exceeded
Signal: IndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)
e2e111.11%1 of 9 job runs affectedIndeterminateSignal: Indeterminate — seen in 2 prior week(s); active 1 day(s)Show trend detailsMar 5: 0 · Mar 6: 0 · Mar 7: 0 · Mar 8: 0 · Mar 9: 0 · Mar 10: 0 · Mar 11: 1none
Full failure examples (1)
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010ea060>: 
    failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster="list-test-cluster-ccxwqz" in resourcegroup="cluster-listing-d94s94" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000a83a70>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
            },
            <*fmt.wrapErrors | 0xc0010ea030>{
                msg: "failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000a83a70>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_list_no_infra.go:86]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010ea060>: 
    failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster="list-test-cluster-ccxwqz" in resourcegroup="cluster-listing-d94s94" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster list-test-cluster-ccxwqz, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000a83a70>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
            },
            <*fmt.wrapErrors | 0xc0010ea030>{
                msg: "failed waiting for cluster=\"list-test-cluster-ccxwqz\" in resourcegroup=\"cluster-listing-d94s94\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000a83a70>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPClusterFromParam for cluster list-test-cluster-ccxwqz in resource group cluster-listing-d94s94",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
Contributing tests (1)
Failed AtJobTestSupport
e2eperiodic-ci-Azure-ARO-HCP-main-periodic-integration-e2e-parallelCustomer should be able to list HCP clusters without node pools at both subscription and resource group levels1
Affected runs (1)
Date (UTC)Associated PRProw job
n/a2031521952853659648