18 trials · total cost $31.59 · not on this page: 3 attempts that ended on provider rate limits ($0.32, re-run in exp_led_wording_openai); they are in the dataset's episodes table · click a trial to step through it
| agent | task | trials | harness errors | submitted | all pass | mean end score | cost | cost / trial |
|---|---|---|---|---|---|---|---|---|
| argon | t4_takeover | 3 | — | 3 | 2 / 3 | 0.983 | $8.4903 | $2.8301 |
| astra | t4_takeover | 3 | — | 3 | 1 / 3 | 0.99 | $10.3995 | $3.4665 |
| opus | t4_takeover | 3 | — | 3 | 2 / 3 | 0.99 | $6.3211 | $2.1070 |
| sol | t4_takeover | 3 | — | 3 | 2 / 3 | 0.667 | $1.3720 | $0.4573 |
| sonnet | t4_takeover | 3 | — | 3 | 1 / 3 | 0.983 | $4.3463 | $1.4488 |
| terra | t4_takeover | 3 | — | 3 | 0 / 3 | 0.333 | $0.6638 | $0.2213 |
Each trial has one end grade, computed once after the run ends. Harness failures (the run stopped on a provider or harness error) are listed but have no score: they are left out of "all pass" and the means.
| headline | argon | t4_takeover | t_present_faults | trial 0 | submitted | 1 | pass | $3.1572 | 21 | 52 |
| headline | argon | t4_takeover | t_present_faults | trial 1 | submitted | 1 | pass | $2.9347 | 26 | 61 |
| headline | argon | t4_takeover | t_present_faults | trial 2 | submitted | 0.949 | fail | $2.3984 | 19 | 85 |
| headline | astra | t4_takeover | t_present_faults | trial 0 | submitted | 0.971 | fail | $3.7774 | 37 | 59 |
| headline | astra | t4_takeover | t_present_faults | trial 1 | submitted | 0.998 | fail | $3.9867 | 39 | 68 |
| headline | astra | t4_takeover | t_present_faults | trial 2 | submitted | 1 | pass | $2.6354 | 32 | 49 |
| headline | opus | t4_takeover | t_present_faults | trial 0 | submitted | 0.971 | fail | $2.1222 | 17 | 66 |
| headline | opus | t4_takeover | t_present_faults | trial 1 | submitted | 1 | pass | $2.0319 | 16 | 60 |
| headline | opus | t4_takeover | t_present_faults | trial 2 | submitted | 1 | pass | $2.1670 | 23 | 68 |
| headline | sol | t4_takeover | t_present_faults | trial 0 | submitted | 1 | pass | $0.4582 | 32 | 58 |
| headline | sol | t4_takeover | t_present_faults | trial 1 | submitted | 1 | pass | $0.4650 | 30 | 57 |
| headline | sol | t4_takeover | t_present_faults | trial 2 | submitted | 0 | fail | $0.4488 | 38 | 61 |
| headline | sonnet | t4_takeover | t_present_faults | trial 0 | submitted | 0.968 | fail | $1.5941 | 35 | 75 |
| headline | sonnet | t4_takeover | t_present_faults | trial 1 | submitted | 1 | pass | $1.4731 | 33 | 84 |
| headline | sonnet | t4_takeover | t_present_faults | trial 2 | submitted | 0.981 | fail | $1.2791 | 28 | 70 |
| headline | terra | t4_takeover | t_present_faults | trial 0 | submitted | 0 | fail | $0.1611 | 16 | 35 |
| headline | terra | t4_takeover | t_present_faults | trial 1 | submitted | 0.998 | fail | $0.2533 | 42 | 68 |
| headline | terra | t4_takeover | t_present_faults | trial 2 | submitted | 0 | fail | $0.2494 | 30 | 57 |