CIHealth
<
Single Day: Mar 31▾
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: STG

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 n/a passed n/a 0 n/a
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 1
e2e (1)
timeout during CreateHCPClusterAndWait; context deadline exceeded
13:36:01 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc000916240>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-pgdlrr" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-pgdlrr, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-pgdlrr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-pgdlrr, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010acbc0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-pgdlrr",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc000916240>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-pgdlrr" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-pgdlrr, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-pgdlrr\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-pgdlrr, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010acbc0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-pgdlrr",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
periodic-ci-Azure-ARO-HCP-main-periodic-stage-e2e-parallel
post-goodmerged PR
No additional run metadata captured
 e2e failed n/a 4
e2e (4)
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:39 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc000ab8570>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-vkzvvw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-vkzvvw, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-vkzvvw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-vkzvvw, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010f6130>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-vkzvvw",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc000ab8570>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-vkzvvw" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-vkzvvw, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-vkzvvw\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-vkzvvw, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0010f6130>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-vkzvvw",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:39 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:136]: Unexpected error:
    <*fmt.wrapErrors | 0xc001750cf0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-qdzg54" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-qdzg54\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000fe0f60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54",
            },
            <*fmt.wrapErrors | 0xc001750cc0>{
                msg: "failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-qdzg54\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000fe0f60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:136]: Unexpected error:
    <*fmt.wrapErrors | 0xc001750cf0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-qdzg54" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-qdzg54\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000fe0f60>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54",
            },
            <*fmt.wrapErrors | 0xc001750cc0>{
                msg: "failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-qdzg54\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000fe0f60>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-qdzg54",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:39 UTC · failed at e2e · test Customer should be able to create a no-CNI private cluster with a private key vault, a nodepool and install cilium CNI successfully · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc000aeac90>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="e2e-cilium-jd2jf7" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-jd2jf7, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cilium-cluster\" in resourcegroup=\"e2e-cilium-jd2jf7\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-jd2jf7, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00104d0f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-jd2jf7",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_cilium.go:141]: Unexpected error:
    <*fmt.wrapErrors | 0xc000aeac90>: 
    failed waiting for cluster="cilium-cluster" in resourcegroup="e2e-cilium-jd2jf7" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-jd2jf7, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"cilium-cluster\" in resourcegroup=\"e2e-cilium-jd2jf7\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-jd2jf7, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc00104d0f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster cilium-cluster in resource group e2e-cilium-jd2jf7",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
add password: error status code received from the API
02:00:39 UTC · failed at e2e · test Authorized CIDRs Connectivity should allow API access only from authorized VM IP · suite stage/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:252]: Unexpected error:
    <*fmt.wrapError | 0xc000517600>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc000b0ba40>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "client-request-id": {
                                "0c31e575-0500-4a44-aebc-155ee4c1eea2": {},
                            },
                            "content-type": {
                                "application/json": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Tue, 31 Mar 2026 02:30:32 GMT": {},
                            },
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                            "request-id": {
                                "0c31e575-0500-4a44-aebc-155ee4c1eea2": {},
                            },
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"Canada Central\",\"Slice\":\"E\",\"Ring\":\"3\",\"ScaleUnit\":\"001\",\"RoleInstance\":\"YT1PEPF00003E4B\"}}": {},
                            },
                            "cache-control": {"no-cache": {}},
                            "vary": {
                                "Accept-Encoding": {},
                            },
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000517540>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc000741cd0>{
                        backingStore: <*store.InMemoryBackingStore | 0xc000517580>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "innerError": <*odataerrors.InnerError | 0xc000741d30>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc0005175c0>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                                "code": <*string | 0xc000741a20>"Request_ResourceNotFound",
                                "message": <*string | 0xc000741a70>"Resource '9c86f191-fe0d-40fc-8883-79c3daf62dcd' does not exist or one of its queried reference-property objects are not present.",
                            },
                            subscribers: {},
                            changedValues: {"innerError": false, "code": false, "message": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_authorized_cidrs_connectivity.go:252]: Unexpected error:
    <*fmt.wrapError | 0xc000517600>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc000b0ba40>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "client-request-id": {
                                "0c31e575-0500-4a44-aebc-155ee4c1eea2": {},
                            },
                            "content-type": {
                                "application/json": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Tue, 31 Mar 2026 02:30:32 GMT": {},
                            },
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                            "request-id": {
                                "0c31e575-0500-4a44-aebc-155ee4c1eea2": {},
                            },
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"Canada Central\",\"Slice\":\"E\",\"Ring\":\"3\",\"ScaleUnit\":\"001\",\"RoleInstance\":\"YT1PEPF00003E4B\"}}": {},
                            },
                            "cache-control": {"no-cache": {}},
                            "vary": {
                                "Accept-Encoding": {},
                            },
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000517540>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc000741cd0>{
                        backingStore: <*store.InMemoryBackingStore | 0xc000517580>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "innerError": <*odataerrors.InnerError | 0xc000741d30>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc0005175c0>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                                "code": <*string | 0xc000741a20>"Request_ResourceNotFound",
                                "message": <*string | 0xc000741a70>"Resource '9c86f191-fe0d-40fc-8883-79c3daf62dcd' does not exist or one of its queried reference-property objects are not present.",
                            },
                            subscribers: {},
                            changedValues: {"innerError": false, "code": false, "message": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred