<
Single Day: Mar 31
Pick a day
>
View JSON API
↗ Open Failure patterns for this day

Environment: PROD

Time (UTC)JobFailed atResultPRFailed testsDetails
periodic-ci-Azure-ARO-HCP-main-periodic-prod-e2e-parallel
post-goodmerged PR
No additional run metadata captured
e2e failed n/a 3
e2e (3)
add password: error status code received from the API
02:00:39 UTC · failed at e2e · test Customer should be able to create a cluster with an external auth config and get the external auth config · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:130]: Unexpected error:
    <*fmt.wrapError | 0xc0008802e0>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc000b91aa0>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                            "client-request-id": {
                                "609e61cb-e058-40bf-954c-a040be046529": {},
                            },
                            "content-type": {
                                "application/json": {},
                            },
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"East US\",\"Slice\":\"E\",\"Ring\":\"5\",\"ScaleUnit\":\"001\",\"RoleInstance\":\"MN1PEPF00010855\"}}": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Tue, 31 Mar 2026 03:00:12 GMT": {},
                            },
                            "vary": {
                                "Accept-Encoding": {},
                            },
                            "request-id": {
                                "609e61cb-e058-40bf-954c-a040be046529": {},
                            },
                            "cache-control": {"no-cache": {}},
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000880280>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc0014a1650>{
                        backingStore: <*store.InMemoryBackingStore | 0xc0008802a0>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "code": <*string | 0xc0014a14d0>"Request_ResourceNotFound",
                                "message": <*string | 0xc0014a1520>"Resource 'b5d9870c-3832-4af0-9062-5ced2786c558' does not exist or one of its queried reference-property objects are not present.",
                                "innerError": <*odataerrors.InnerError | 0xc0014a16b0>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc0008802c0>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                            },
                            subscribers: {},
                            changedValues: {"code": false, "message": false, "innerError": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/external_auth_create.go:130]: Unexpected error:
    <*fmt.wrapError | 0xc0008802e0>: 
    add password: error status code received from the API
    {
        msg: "add password: error status code received from the API",
        err: <*odataerrors.ODataError | 0xc000b91aa0>{
            ApiError: {
                Message: "",
                ResponseStatusCode: 404,
                ResponseHeaders: {
                    header: {
                        headers: {
                            "strict-transport-security": {
                                "max-age=31536000": {},
                            },
                            "client-request-id": {
                                "609e61cb-e058-40bf-954c-a040be046529": {},
                            },
                            "content-type": {
                                "application/json": {},
                            },
                            "x-ms-ags-diagnostic": {
                                "{\"ServerInfo\":{\"DataCenter\":\"East US\",\"Slice\":\"E\",\"Ring\":\"5\",\"ScaleUnit\":\"001\",\"RoleInstance\":\"MN1PEPF00010855\"}}": {},
                            },
                            "x-ms-resource-unit": {"1": {}},
                            "date": {
                                "Tue, 31 Mar 2026 03:00:12 GMT": {},
                            },
                            "vary": {
                                "Accept-Encoding": {},
                            },
                            "request-id": {
                                "609e61cb-e058-40bf-954c-a040be046529": {},
                            },
                            "cache-control": {"no-cache": {}},
                        },
                    },
                },
            },
            backingStore: <*store.InMemoryBackingStore | 0xc000880280>{
                returnOnlyChangedValues: false,
                initializationCompleted: false,
                store: {
                    "errorEscaped": <*odataerrors.MainError | 0xc0014a1650>{
                        backingStore: <*store.InMemoryBackingStore | 0xc0008802a0>{
                            returnOnlyChangedValues: false,
                            initializationCompleted: false,
                            store: {
                                "code": <*string | 0xc0014a14d0>"Request_ResourceNotFound",
                                "message": <*string | 0xc0014a1520>"Resource 'b5d9870c-3832-4af0-9062-5ced2786c558' does not exist or one of its queried reference-property objects are not present.",
                                "innerError": <*odataerrors.InnerError | 0xc0014a16b0>{
                                    backingStore: <*store.InMemoryBackingStore | 0xc0008802c0>{
                                        returnOnlyChangedValues: false,
                                        initializationCompleted: false,
                                        store: {...: ..., ...: ...},
                                        subscribers: {},
                                        changedValues: {...: ..., ...: ...},
                                    },
                                },
                            },
                            subscribers: {},
                            changedValues: {"code": false, "message": false, "innerError": false},
                        },
                    },
                },
                subscribers: {},
                changedValues: {
                    "errorEscaped": false,
                },
            },
        },
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:39 UTC · failed at e2e · test Customer should be able to create an HCP cluster and manage ImageDigestMirrors · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:136]: Unexpected error:
    <*fmt.wrapErrors | 0xc00140c7b0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-k686r9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-k686r9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f718d0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9",
            },
            <*fmt.wrapErrors | 0xc00140c780>{
                msg: "failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-k686r9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f718d0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/idms_lifecycle.go:136]: Unexpected error:
    <*fmt.wrapErrors | 0xc00140c7b0>: 
    failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: failed waiting for cluster="idms-e2e-hcp-cluster" in resourcegroup="idms-k686r9" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: context deadline exceeded
    {
        msg: "failed to create HCP cluster idms-e2e-hcp-cluster, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-k686r9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc000f718d0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9",
            },
            <*fmt.wrapErrors | 0xc00140c780>{
                msg: "failed waiting for cluster=\"idms-e2e-hcp-cluster\" in resourcegroup=\"idms-k686r9\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9, error: context deadline exceeded",
                errs: [
                    <*errors.errorString | 0xc000f718d0>{
                        s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223FromParam for cluster idms-e2e-hcp-cluster in resource group idms-k686r9",
                    },
                    <context.deadlineExceededError>{},
                ],
            },
        ],
    }
occurred
timeout during CreateHCPClusterAndWait; context deadline exceeded
02:00:39 UTC · failed at e2e · test Create HCPOpenShiftCluster with Private KeyVault should create a cluster with private keyvault using v20251223preview API · suite prod/parallel
Show raw failure
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010a6060>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-gtwhlj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-gtwhlj, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-gtwhlj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-gtwhlj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0016896f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-gtwhlj",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred
fail [github.com/Azure/ARO-HCP/test/e2e/cluster_create_private_kv.go:135]: Unexpected error:
    <*fmt.wrapErrors | 0xc0010a6060>: 
    failed waiting for cluster="private-kv-cluster" in resourcegroup="private-keyvault-gtwhlj" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-gtwhlj, error: context deadline exceeded
    {
        msg: "failed waiting for cluster=\"private-kv-cluster\" in resourcegroup=\"private-keyvault-gtwhlj\" to finish creating, caused by: timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-gtwhlj, error: context deadline exceeded",
        errs: [
            <*errors.errorString | 0xc0016896f0>{
                s: "timeout '45.000000' minutes exceeded during CreateHCPCluster20251223AndWait for cluster private-kv-cluster in resource group private-keyvault-gtwhlj",
            },
            <context.deadlineExceededError>{},
        ],
    }
occurred