Env: ALL

Executive Status

EnvEnvironment partition: dev, int, stg, or prod.
GoalConfigured success target and run scope for this environment. INT/STG/PROD use all E2E job runs. DEV uses post-good runs plus Tide batches: runs on the final commit of a PR that later merged, or batch retests of PRs that passed their individual e2e-parallel checks.
RunsNumber of job runs in the selected goal definition for this environment.
SuccessSuccess rate on the selected goal definition: (runs - failed runs) / runs * 100.
Gap vs targetDifference in percentage points between current success and the configured target rate.
Change vs prevHow much the success rate changed compared with the immediately preceding equal-length window, using the same goal definition as this row.
Provision successProvisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step. DEV rows use post-good runs plus Tide batches. INT/STG/PROD show n/a because provisioning is not part of those environments.
Provision change vs prevChange in provision success, in percentage points, compared with the previous equal-length window. Uses the same provision-success definition as the Provision success column. DEV only; INT/STG/PROD show n/a.
E2E successAmong runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step. DEV rows use only runs after the final push to a PR that later merged. INT/STG/PROD use all E2E job runs.
E2E success vs prevChange in E2E success, in percentage points, compared with the previous equal-length window. Uses the same E2E-success definition as the E2E success column.
DEV95% - Post-good runs + Tide batches9055.56% (off track)-39.44pp+8.81pp82.02% (73/89)-9.54pp68.49% (50/73)+12.46pp
INT95% - All E2E job runs2176.19% (off track)-18.81pp+1.77ppn/an/a100.00% (16/16)+3.03pp
STG95% - All E2E job runs2281.82% (off track)-13.18pp+34.76ppn/an/a85.71% (18/21)+9.52pp
PROD95% - All E2E job runs8938.20% (off track)-56.80pp-21.52ppn/an/a38.20% (34/89)-30.05pp

Environment: DEV

E2E Jobs
225
Success Rate
48.89%
Provision success
Provisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step.
82.24% (176/214)
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.
62.50% (110/176)
E2E Jobs (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. This card shows the number of runs in that DEV-only goal basis.
90
Success Rate (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. This card shows the overall success rate for that DEV-only goal basis.
55.56%
Provision success (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. Provisioning here means infrastructure setup before E2E tests start. A run counts as provision-successful if it got past provisioning, even if it later failed during E2E. Runs that failed for 'Other' CI-infrastructure reasons are excluded because those runs never reached the provision step.
82.02% (73/89)
E2E success (post-good + batches)
These PR-regression-filtered DEV metrics include runs on the final commit of a PR that later merged, plus Tide batch retests of PRs that passed their individual e2e-parallel checks. Each run counts once. Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.
68.49% (50/73)

Daily Run Outcomes

Successful runs Provision failures E2E failures Other failures
68 runs
35%Successful runs: 24 of 68 runs (35.3%)
16%Provision failures: 11 of 68 runs (16.2%)
43%E2E failures: 29 of 68 runs (42.6%)
Other failures: 4 of 68 runs (5.9%)
3 runs
Successful runs: 1 of 3 runs (33.3%)
Provision failures: 1 of 3 runs (33.3%)
E2E failures: 1 of 3 runs (33.3%)
15 runs
Successful runs: 4 of 15 runs (26.7%)
Provision failures: 2 of 15 runs (13.3%)
53%E2E failures: 8 of 15 runs (53.3%)
Other failures: 1 of 15 runs (6.7%)
54 runs
57%Successful runs: 31 of 54 runs (57.4%)
20%Provision failures: 11 of 54 runs (20.4%)
22%E2E failures: 12 of 54 runs (22.2%)
45 runs
60%Successful runs: 27 of 45 runs (60.0%)
16%Provision failures: 7 of 45 runs (15.6%)
22%E2E failures: 10 of 45 runs (22.2%)
Other failures: 1 of 45 runs (2.2%)
40 runs
58%Successful runs: 23 of 40 runs (57.5%)
Provision failures: 6 of 40 runs (15.0%)
E2E failures: 6 of 40 runs (15.0%)
Other failures: 5 of 40 runs (12.5%)
0 runs
No runs

Daily Run Outcomes for DEV Goal Basis (post-good + batches)

Successful runs (post-good + batches) Provision failures E2E failures Other failures
29 runs
41%Successful runs (post-good + batches): 12 of 29 runs (41.4%)
24%Provision failures: 7 of 29 runs (24.1%)
31%E2E failures: 9 of 29 runs (31.0%)
Other failures: 1 of 29 runs (3.4%)
0 runs
No runs
6 runs
67%Successful runs (post-good + batches): 4 of 6 runs (66.7%)
E2E failures: 2 of 6 runs (33.3%)
28 runs
57%Successful runs (post-good + batches): 16 of 28 runs (57.1%)
14%Provision failures: 4 of 28 runs (14.3%)
29%E2E failures: 8 of 28 runs (28.6%)
17 runs
65%Successful runs (post-good + batches): 11 of 17 runs (64.7%)
18%Provision failures: 3 of 17 runs (17.6%)
18%E2E failures: 3 of 17 runs (17.6%)
10 runs
70%Successful runs (post-good + batches): 7 of 10 runs (70.0%)
Provision failures: 2 of 10 runs (20.0%)
E2E failures: 1 of 10 runs (10.0%)
0 runs
No runs

Environment: INT

E2E Jobs
21
Success Rate
76.19%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.
100.00% (16/16)

Daily Run Outcomes

Successful runs Provision failures E2E failures Other failures
6 runs
67%Successful runs: 4 of 6 runs (66.7%)
33%Other failures: 2 of 6 runs (33.3%)
0 runs
No runs
0 runs
No runs
3 runs
33%Successful runs: 1 of 3 runs (33.3%)
67%Other failures: 2 of 3 runs (66.7%)
6 runs
100%Successful runs: 6 of 6 runs (100.0%)
6 runs
83%Successful runs: 5 of 6 runs (83.3%)
17%Other failures: 1 of 6 runs (16.7%)
0 runs
No runs

Environment: STG

E2E Jobs
22
Success Rate
81.82%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.
85.71% (18/21)

Daily Run Outcomes

Successful runs Provision failures E2E failures Other failures
4 runs
75%Successful runs: 3 of 4 runs (75.0%)
25%E2E failures: 1 of 4 runs (25.0%)
2 runs
50%Successful runs: 1 of 2 runs (50.0%)
50%E2E failures: 1 of 2 runs (50.0%)
3 runs
67%Successful runs: 2 of 3 runs (66.7%)
33%Other failures: 1 of 3 runs (33.3%)
2 runs
50%Successful runs: 1 of 2 runs (50.0%)
50%E2E failures: 1 of 2 runs (50.0%)
5 runs
100%Successful runs: 5 of 5 runs (100.0%)
6 runs
100%Successful runs: 6 of 6 runs (100.0%)
0 runs
No runs

Environment: PROD

E2E Jobs
89
Success Rate
38.20%
E2E success
Among runs that reached E2E execution, this shows how many completed successfully. Provision failures and 'Other' CI-infrastructure failures are excluded because those runs never reached the E2E step.
38.20% (34/89)

Daily Run Outcomes

Successful runs Provision failures E2E failures Other failures
43 runs
Successful runs: 4 of 43 runs (9.3%)
91%E2E failures: 39 of 43 runs (90.7%)
6 runs
100%E2E failures: 6 of 6 runs (100.0%)
5 runs
Successful runs: 1 of 5 runs (20.0%)
E2E failures: 4 of 5 runs (80.0%)
9 runs
89%Successful runs: 8 of 9 runs (88.9%)
E2E failures: 1 of 9 runs (11.1%)
13 runs
77%Successful runs: 10 of 13 runs (76.9%)
E2E failures: 3 of 13 runs (23.1%)
13 runs
85%Successful runs: 11 of 13 runs (84.6%)
E2E failures: 2 of 13 runs (15.4%)
0 runs
No runs