218 trials · 27 harness failures (no score) · total cost $42.61 · 14 more development records ($2.23: 10 Nemotron T1 sweep runs and 4 aborted checks) are in the dataset's episodes table only · click a trial to step through it
| agent | task | trials | harness errors | submitted | all pass | mean end score | cost | cost / trial |
|---|---|---|---|---|---|---|---|---|
| deepseek | t1_connectivity | 4 | — | 3 | 0 / 4 | 0.59 | $0.3543 | $0.0886 |
| deepseek | t2_setup | 4 | — | 4 | 0 / 4 | 0.954 | $0.2239 | $0.0560 |
| deepseek | t3_light | 4 | — | 3 | 0 / 4 | 0.26 | $0.3096 | $0.0774 |
| deepseek | t4_takeover | 4 | — | 2 | 0 / 4 | 0.224 | $0.3341 | $0.0835 |
| deepseek | t5_traces | 4 | — | 3 | 2 / 4 | 0.736 | $0.3856 | $0.0964 |
| deepseek | all tasks | 20 | — | 15 | 2 / 20 | 0.553 | $1.6075 | $0.0804 |
| flash | t1_connectivity | 4 | — | 4 | 2 / 4 | 0.948 | $3.8548 | $0.9637 |
| flash | t2_setup | 4 | — | 4 | 1 / 4 | 0.967 | $1.6205 | $0.4051 |
| flash | t3_light | 4 | — | 4 | 0 / 4 | 0.333 | $4.9567 | $1.2392 |
| flash | t4_takeover | 4 | — | 4 | 0 / 4 | 0.88 | $2.4937 | $0.6234 |
| flash | t5_traces | 4 | — | 4 | 1 / 4 | 0.96 | $6.0645 | $1.5161 |
| flash | all tasks | 20 | — | 20 | 4 / 20 | 0.818 | $18.9902 | $0.9495 |
| haiku | t1_connectivity | 10 | 6 | 4 | 1 / 4 | 0.724 | $0.4692 | $0.0469 |
| haiku | t2_setup | 10 | 6 | 4 | 0 / 4 | 0.846 | $0.1368 | $0.0137 |
| haiku | t3_light | 10 | 6 | 4 | 1 / 4 | 0.709 | $0.4444 | $0.0444 |
| haiku | t4_takeover | 10 | 6 | 4 | 0 / 4 | 0.718 | $0.6441 | $0.0644 |
| haiku | t5_traces | 8 | 3 | 5 | 1 / 5 | 0.923 | $0.3037 | $0.0380 |
| haiku | all tasks | 48 | 27 | 21 | 3 / 21 | 0.79 | $1.9982 | $0.0416 |
| luna | t1_connectivity | 4 | — | 4 | 0 / 4 | 0.438 | $0.2709 | $0.0677 |
| luna | t2_setup | 5 | — | 5 | 1 / 5 | 0.84 | $0.0715 | $0.0143 |
| luna | t3_light | 4 | — | 4 | 0 / 4 | 0.453 | $0.2119 | $0.0530 |
| luna | t4_takeover | 4 | — | 4 | 0 / 4 | 0.178 | $0.2703 | $0.0676 |
| luna | t5_traces | 5 | — | 5 | 0 / 5 | 0.931 | $0.0961 | $0.0192 |
| luna | all tasks | 22 | — | 22 | 1 / 22 | 0.597 | $0.9207 | $0.0418 |
| nemotron | t1_connectivity | 54 | — | 48 | 0 / 54 | 0.453 | $7.7823 | $0.1441 |
| nemotron | t2_setup | 17 | — | 15 | 2 / 17 | 0.751 | $2.3810 | $0.1401 |
| nemotron | t3_light | 15 | — | 15 | 2 / 15 | 0.498 | $3.7108 | $0.2474 |
| nemotron | t4_takeover | 12 | — | 12 | 0 / 12 | 0.385 | $2.5281 | $0.2107 |
| nemotron | t5_traces | 10 | — | 8 | 0 / 10 | 0.709 | $2.6932 | $0.2693 |
| nemotron | all tasks | 108 | — | 98 | 4 / 108 | 0.522 | $19.0953 | $0.1768 |
Each trial has one end grade, computed once after the run ends. Harness failures (the run stopped on a provider or harness error) are listed but have no score: they are left out of "all pass" and the means.
| headline | deepseek | t1_connectivity | stale_frames | trial 0 | no submission | 0 | fail | $0.0549 | 13 | 24 |
| headline | deepseek | t1_connectivity | stale_frames | trial 0 | submitted | 0.957 | fail | $0.0958 | 44 | 115 |
| headline | deepseek | t1_connectivity | trigger_cable | trial 0 | submitted | 0.646 | fail | $0.1062 | 42 | 94 |
| headline | deepseek | t1_connectivity | usb_loose | trial 0 | submitted | 0.758 | fail | $0.0975 | 34 | 91 |
| headline | flash | t1_connectivity | stale_frames | trial 0 | submitted | 1 | pass | $1.2679 | 30 | 98 |
| headline | flash | t1_connectivity | stale_frames | trial 0 | submitted | 0.957 | fail | $0.7633 | 26 | 79 |
| headline | flash | t1_connectivity | trigger_cable | trial 0 | submitted | 1 | pass | $0.8158 | 28 | 81 |
| headline | flash | t1_connectivity | usb_loose | trial 0 | submitted | 0.837 | fail | $1.0078 | 29 | 91 |
| headline | haiku | t1_connectivity | stale_frames | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t1_connectivity | stale_frames | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t1_connectivity | stale_frames | trial 0 | submitted | 1 | pass | $0.1393 | 46 | 98 |
| headline | haiku | t1_connectivity | stale_frames | trial 0 | submitted | 0.957 | fail | $0.0910 | 32 | 78 |
| headline | haiku | t1_connectivity | trigger_cable | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t1_connectivity | trigger_cable | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t1_connectivity | trigger_cable | trial 0 | submitted | 0.939 | fail | $0.1744 | 56 | 110 |
| headline | haiku | t1_connectivity | usb_loose | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t1_connectivity | usb_loose | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t1_connectivity | usb_loose | trial 0 | submitted | 0 | fail | $0.0644 | 20 | 50 |
| headline | luna | t1_connectivity | stale_frames | trial 0 | submitted | 0.927 | fail | $0.0964 | 49 | 94 |
| headline | luna | t1_connectivity | stale_frames | trial 0 | submitted | 0 | fail | $0.0699 | 38 | 69 |
| headline | luna | t1_connectivity | trigger_cable | trial 0 | submitted | 0.826 | fail | $0.0522 | 34 | 57 |
| headline | luna | t1_connectivity | usb_loose | trial 0 | submitted | 0 | fail | $0.0525 | 43 | 66 |
| headline | nemotron | t1_connectivity | dead_culture | trial 0 | submitted | 0.256 | fail | $0.2588 | 61 | 102 |
| headline | nemotron | t1_connectivity | dead_culture | trial 0 | submitted | 0.644 | fail | $0.2573 | 45 | 91 |
| headline | nemotron | t1_connectivity | dead_culture | trial 0 | submitted | 0.059 | fail | $0.1396 | 28 | 52 |
| headline | nemotron | t1_connectivity | dead_culture | trial 1 | submitted | 0.887 | fail | $0.1834 | 43 | 68 |
| headline | nemotron | t1_connectivity | dead_culture | trial 2 | no submission | 0 | fail | $0.1728 | 60 | 95 |
| headline | nemotron | t1_connectivity | hdmi_loose | trial 0 | submitted | 0.868 | fail | $0.1064 | 27 | 51 |
| headline | nemotron | t1_connectivity | hdmi_loose | trial 0 | submitted | 0.847 | fail | $0.1148 | 29 | 51 |
| headline | nemotron | t1_connectivity | hdmi_loose | trial 0 | submitted | 0.906 | fail | $0.0972 | 32 | 48 |
| headline | nemotron | t1_connectivity | hdmi_loose | trial 1 | submitted | 0.905 | fail | $0.1048 | 26 | 43 |
| headline | nemotron | t1_connectivity | hdmi_loose | trial 2 | submitted | 0.41 | fail | $0.1968 | 61 | 91 |
| headline | nemotron | t1_connectivity | loose_wire | trial 0 | submitted | 0.743 | fail | $0.1393 | 42 | 81 |
| headline | nemotron | t1_connectivity | loose_wire | trial 0 | no submission | 0 | fail | $0.1668 | 60 | 98 |
| headline | nemotron | t1_connectivity | loose_wire | trial 1 | submitted | 0.606 | fail | $0.1368 | 35 | 66 |
| headline | nemotron | t1_connectivity | loose_wire | trial 2 | submitted | 0.548 | fail | $0.2100 | 34 | 69 |
| headline | nemotron | t1_connectivity | low_disk | trial 0 | submitted | 0.755 | fail | $0.1017 | 30 | 53 |
| headline | nemotron | t1_connectivity | low_disk | trial 0 | submitted | 0.944 | fail | $0.0857 | 24 | 37 |
| headline | nemotron | t1_connectivity | low_disk | trial 1 | submitted | 0.732 | fail | $0.1281 | 41 | 65 |
| headline | nemotron | t1_connectivity | low_disk | trial 2 | submitted | 0.71 | fail | $0.1130 | 40 | 64 |
| headline | nemotron | t1_connectivity | mask_flip | trial 0 | submitted | 0 | fail | $0.2007 | 44 | 87 |
| headline | nemotron | t1_connectivity | mask_flip | trial 0 | no submission | 0 | fail | $0.1537 | 60 | 87 |
| headline | nemotron | t1_connectivity | mask_flip | trial 1 | submitted | 0.077 | fail | $0.1291 | 18 | 43 |
| headline | nemotron | t1_connectivity | mask_flip | trial 2 | submitted | 0.187 | fail | $0.1791 | 48 | 85 |
| headline | nemotron | t1_connectivity | none | trial 0 | submitted | 0.724 | fail | $0.0853 | 32 | 50 |
| headline | nemotron | t1_connectivity | none | trial 0 | submitted | 0.415 | fail | $0.1140 | 32 | 57 |
| headline | nemotron | t1_connectivity | none | trial 0 | submitted | 0.67 | fail | $0.1124 | 32 | 56 |
| headline | nemotron | t1_connectivity | none | trial 0 | submitted | 0.731 | fail | $0.0845 | 25 | 49 |
| headline | nemotron | t1_connectivity | none | trial 1 | submitted | 0.672 | fail | $0.0969 | 29 | 50 |
| headline | nemotron | t1_connectivity | none | trial 1 | submitted | 0.862 | fail | $0.0906 | 20 | 42 |
| headline | nemotron | t1_connectivity | none | trial 2 | submitted | 0.656 | fail | $0.1035 | 39 | 59 |
| headline | nemotron | t1_connectivity | operator_away | trial 0 | submitted | 0.86 | fail | $0.1356 | 30 | 55 |
| headline | nemotron | t1_connectivity | projector_standby | trial 0 | submitted | 0.919 | fail | $0.1011 | 29 | 55 |
| headline | nemotron | t1_connectivity | projector_standby | trial 0 | submitted | 0.518 | fail | $0.1360 | 58 | 91 |
| headline | nemotron | t1_connectivity | projector_standby | trial 1 | submitted | 0.641 | fail | $0.0904 | 26 | 51 |
| headline | nemotron | t1_connectivity | projector_standby | trial 2 | submitted | 0.724 | fail | $0.1106 | 37 | 63 |
| headline | nemotron | t1_connectivity | room_light | trial 0 | submitted | 0.262 | fail | $0.0732 | 28 | 48 |
| headline | nemotron | t1_connectivity | room_light | trial 0 | submitted | 0.17 | fail | $0.1030 | 26 | 48 |
| headline | nemotron | t1_connectivity | room_light | trial 1 | submitted | 0.224 | fail | $0.0869 | 32 | 52 |
| headline | nemotron | t1_connectivity | room_light | trial 2 | submitted | 0.306 | fail | $0.0803 | 20 | 38 |
| headline | nemotron | t1_connectivity | stale_frames | trial 0 | submitted | 0.753 | fail | $0.1364 | 37 | 71 |
| headline | nemotron | t1_connectivity | stale_frames | trial 0 | submitted | 0.059 | fail | $0.1826 | 47 | 93 |
| headline | nemotron | t1_connectivity | stale_frames | trial 0 | no submission | 0 | fail | $0.2282 | 60 | 93 |
| headline | nemotron | t1_connectivity | stale_frames | trial 0 | submitted | 0 | fail | $0.1238 | 32 | 68 |
| headline | nemotron | t1_connectivity | stale_frames | trial 0 | submitted | 0 | fail | $0.1421 | 38 | 67 |
| headline | nemotron | t1_connectivity | stale_frames | trial 1 | submitted | 0.887 | fail | $0.1130 | 29 | 50 |
| headline | nemotron | t1_connectivity | stale_frames | trial 2 | submitted | 0.742 | fail | $0.1603 | 50 | 84 |
| headline | nemotron | t1_connectivity | trigger_cable | trial 0 | no submission | 0 | fail | $0.1611 | 60 | 93 |
| headline | nemotron | t1_connectivity | trigger_cable | trial 0 | submitted | 0 | fail | $0.2094 | 43 | 77 |
| headline | nemotron | t1_connectivity | trigger_cable | trial 0 | submitted | 0.599 | fail | $0.1773 | 57 | 98 |
| headline | nemotron | t1_connectivity | trigger_cable | trial 0 | submitted | 0 | fail | $0.1630 | 35 | 58 |
| headline | nemotron | t1_connectivity | trigger_cable | trial 1 | submitted | 0.647 | fail | $0.1586 | 51 | 90 |
| headline | nemotron | t1_connectivity | trigger_cable | trial 1 | submitted | 0.183 | fail | $0.1429 | 61 | 87 |
| headline | nemotron | t1_connectivity | trigger_cable | trial 2 | submitted | 0.162 | fail | $0.1897 | 27 | 55 |
| headline | nemotron | t1_connectivity | usb_loose | trial 0 | no submission | 0 | fail | $0.3036 | 60 | 118 |
| headline | nemotron | t1_connectivity | usb_loose | trial 0 | submitted | 0 | fail | $0.2097 | 43 | 85 |
| headline | deepseek | t2_setup | distortion_dense | trial 0 | submitted | 0.973 | fail | $0.0392 | 21 | 57 |
| headline | deepseek | t2_setup | flip_stale | trial 0 | submitted | 0.956 | fail | $0.1139 | 17 | 49 |
| headline | deepseek | t2_setup | flip_stale | trial 0 | submitted | 0.933 | fail | $0.0232 | 16 | 35 |
| headline | deepseek | t2_setup | missing_uneven | trial 0 | submitted | 0.956 | fail | $0.0476 | 15 | 54 |
| headline | flash | t2_setup | distortion_dense | trial 0 | submitted | 1 | pass | $0.6719 | 23 | 68 |
| headline | flash | t2_setup | flip_stale | trial 0 | submitted | 0.956 | fail | $0.3238 | 15 | 44 |
| headline | flash | t2_setup | flip_stale | trial 0 | submitted | 0.956 | fail | $0.3429 | 17 | 43 |
| headline | flash | t2_setup | missing_uneven | trial 0 | submitted | 0.956 | fail | $0.2819 | 15 | 36 |
| headline | haiku | t2_setup | distortion_dense | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t2_setup | distortion_dense | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t2_setup | distortion_dense | trial 0 | submitted | 0.984 | fail | $0.0355 | 21 | 41 |
| headline | haiku | t2_setup | flip_stale | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t2_setup | flip_stale | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t2_setup | flip_stale | trial 0 | submitted | 0.867 | fail | $0.0274 | 19 | 34 |
| headline | haiku | t2_setup | flip_stale | trial 0 | submitted | 0.867 | fail | $0.0185 | 18 | 30 |
| headline | haiku | t2_setup | missing_uneven | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t2_setup | missing_uneven | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t2_setup | missing_uneven | trial 0 | submitted | 0.667 | fail | $0.0553 | 28 | 50 |
| headline | luna | t2_setup | distortion_dense | trial 0 | submitted | 0.867 | fail | $0.0109 | 19 | 26 |
| headline | luna | t2_setup | distortion_dense | trial 0 | submitted | 0.867 | fail | $0.0191 | 26 | 38 |
| headline | luna | t2_setup | flip_stale | trial 0 | submitted | 1 | pass | $0.0141 | 18 | 27 |
| headline | luna | t2_setup | flip_stale | trial 0 | submitted | 0.867 | fail | $0.0097 | 20 | 26 |
| headline | luna | t2_setup | missing_uneven | trial 0 | submitted | 0.598 | fail | $0.0176 | 25 | 38 |
| headline | nemotron | t2_setup | calibration_missing | trial 0 | no submission | 0 | fail | $0.4077 | 60 | 124 |
| headline | nemotron | t2_setup | calibration_stale | trial 0 | submitted | 0.996 | fail | $0.0628 | 15 | 29 |
| headline | nemotron | t2_setup | dense_culture | trial 0 | submitted | 1 | pass | $0.0788 | 15 | 34 |
| headline | nemotron | t2_setup | distortion_dense | trial 0 | submitted | 0.742 | fail | $0.0187 | 10 | 14 |
| headline | nemotron | t2_setup | few_markers | trial 0 | submitted | 0.667 | fail | $0.3329 | 54 | 100 |
| headline | nemotron | t2_setup | flip_stale | trial 0 | submitted | 0.862 | fail | $0.0241 | 12 | 16 |
| headline | nemotron | t2_setup | flip_stale | trial 0 | submitted | 0.867 | fail | $0.0375 | 14 | 22 |
| headline | nemotron | t2_setup | hdmi_loose | trial 0 | submitted | 1 | pass | $0.0600 | 17 | 29 |
| headline | nemotron | t2_setup | lens_distortion | trial 0 | submitted | 0.733 | fail | $0.0625 | 18 | 27 |
| headline | nemotron | t2_setup | loose_wire | trial 0 | submitted | 0.899 | fail | $0.1156 | 30 | 51 |
| headline | nemotron | t2_setup | mask_flip | trial 0 | submitted | 0.93 | fail | $0.1164 | 21 | 44 |
| headline | nemotron | t2_setup | missing_uneven | trial 0 | no submission | 0 | fail | $0.5419 | 60 | 151 |
| headline | nemotron | t2_setup | none | trial 0 | submitted | 0.816 | fail | $0.0865 | 16 | 27 |
| headline | nemotron | t2_setup | operator_away | trial 0 | submitted | 0.867 | fail | $0.1354 | 32 | 56 |
| headline | nemotron | t2_setup | projector_standby | trial 0 | submitted | 0.733 | fail | $0.1081 | 36 | 54 |
| headline | nemotron | t2_setup | room_light | trial 0 | submitted | 0.828 | fail | $0.1042 | 27 | 41 |
| headline | nemotron | t2_setup | uneven_illumination | trial 0 | submitted | 0.832 | fail | $0.0880 | 14 | 30 |
| headline | deepseek | t3_light | cluster_fast_bleach | trial 0 | submitted | 0.375 | fail | $0.0508 | 25 | 55 |
| headline | deepseek | t3_light | converging_led_low | trial 0 | no submission | 0 | fail | $0.0265 | 8 | 17 |
| headline | deepseek | t3_light | converging_led_low | trial 0 | submitted | 0.667 | fail | $0.0997 | 98 | 151 |
| headline | deepseek | t3_light | two_targets_room_light | trial 0 | submitted | 0 | fail | $0.1326 | 82 | 160 |
| headline | flash | t3_light | cluster_fast_bleach | trial 0 | submitted | 0.667 | fail | $0.8565 | 40 | 86 |
| headline | flash | t3_light | converging_led_low | trial 0 | submitted | 0.667 | fail | $1.1301 | 64 | 111 |
| headline | flash | t3_light | converging_led_low | trial 0 | submitted | 0 | fail | $1.1244 | 69 | 119 |
| headline | flash | t3_light | two_targets_room_light | trial 0 | submitted | 0 | fail | $1.8457 | 74 | 150 |
| headline | haiku | t3_light | cluster_fast_bleach | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t3_light | cluster_fast_bleach | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t3_light | cluster_fast_bleach | trial 0 | submitted | 0.946 | pass | $0.0579 | 25 | 60 |
| headline | haiku | t3_light | converging_led_low | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t3_light | converging_led_low | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t3_light | converging_led_low | trial 0 | submitted | 0.5 | fail | $0.1139 | 47 | 95 |
| headline | haiku | t3_light | converging_led_low | trial 0 | submitted | 0.667 | fail | $0.1426 | 58 | 118 |
| headline | haiku | t3_light | two_targets_room_light | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t3_light | two_targets_room_light | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t3_light | two_targets_room_light | trial 0 | submitted | 0.725 | fail | $0.1299 | 43 | 96 |
| headline | luna | t3_light | cluster_fast_bleach | trial 0 | submitted | 0.48 | fail | $0.0463 | 55 | 81 |
| headline | luna | t3_light | converging_led_low | trial 0 | submitted | 0.667 | fail | $0.0903 | 57 | 119 |
| headline | luna | t3_light | converging_led_low | trial 0 | submitted | 0.667 | fail | $0.0364 | 41 | 66 |
| headline | luna | t3_light | two_targets_room_light | trial 0 | submitted | 0 | fail | $0.0390 | 38 | 78 |
| headline | nemotron | t3_light | close_neighbours | trial 0 | submitted | 0.617 | fail | $0.2122 | 82 | 106 |
| headline | nemotron | t3_light | cluster_fast_bleach | trial 0 | submitted | 0.375 | fail | $0.1729 | 38 | 65 |
| headline | nemotron | t3_light | converging | trial 0 | submitted | 0.617 | fail | $0.3106 | 67 | 99 |
| headline | nemotron | t3_light | converging_led_low | trial 0 | submitted | 0 | fail | $0.2611 | 59 | 111 |
| headline | nemotron | t3_light | converging_led_low | trial 0 | submitted | 0 | fail | $0.1788 | 62 | 85 |
| headline | nemotron | t3_light | dead_culture | trial 0 | submitted | 0.35 | fail | $0.2104 | 60 | 84 |
| headline | nemotron | t3_light | fast_bleach | trial 0 | submitted | 0.35 | fail | $0.1733 | 46 | 67 |
| headline | nemotron | t3_light | led_low | trial 0 | submitted | 0.77 | fail | $0.3346 | 59 | 89 |
| headline | nemotron | t3_light | loose_wire | trial 0 | submitted | 0.97 | pass | $0.1917 | 50 | 77 |
| headline | nemotron | t3_light | none | trial 0 | submitted | 0.68 | fail | $0.1949 | 47 | 70 |
| headline | nemotron | t3_light | room_light | trial 0 | submitted | 0.45 | fail | $0.1956 | 51 | 73 |
| headline | nemotron | t3_light | stale_frames | trial 0 | submitted | 0.667 | fail | $0.3370 | 61 | 91 |
| headline | nemotron | t3_light | strong_crosstalk | trial 0 | submitted | 0.958 | pass | $0.3386 | 46 | 105 |
| headline | nemotron | t3_light | strong_input | trial 0 | submitted | 0.667 | fail | $0.3946 | 61 | 107 |
| headline | nemotron | t3_light | two_targets_room_light | trial 0 | submitted | 0 | fail | $0.2045 | 57 | 96 |
| headline | deepseek | t4_takeover | t_dead_jumper | trial 0 | no submission | 0 | fail | $0.0367 | 0 | 12 |
| headline | deepseek | t4_takeover | t_dead_jumper | trial 0 | no submission | 0 | fail | $0.0584 | 6 | 25 |
| headline | deepseek | t4_takeover | t_flip_disk | trial 0 | submitted | 0 | fail | $0.1187 | 33 | 119 |
| headline | deepseek | t4_takeover | t_present_faults | trial 0 | submitted | 0.897 | fail | $0.1204 | 45 | 131 |
| headline | flash | t4_takeover | t_dead_jumper | trial 0 | submitted | 0.946 | fail | $0.9574 | 11 | 78 |
| headline | flash | t4_takeover | t_dead_jumper | trial 0 | submitted | 0.924 | fail | $0.6400 | 14 | 58 |
| headline | flash | t4_takeover | t_flip_disk | trial 0 | submitted | 0.81 | fail | $0.4783 | 1 | 43 |
| headline | flash | t4_takeover | t_present_faults | trial 0 | submitted | 0.841 | fail | $0.4181 | 1 | 43 |
| headline | haiku | t4_takeover | t_dead_jumper | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t4_takeover | t_dead_jumper | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t4_takeover | t_dead_jumper | trial 0 | submitted | 0.973 | fail | $0.1599 | 34 | 88 |
| headline | haiku | t4_takeover | t_dead_jumper | trial 0 | submitted | 0.981 | fail | $0.1416 | 32 | 79 |
| headline | haiku | t4_takeover | t_flip_disk | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t4_takeover | t_flip_disk | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t4_takeover | t_flip_disk | trial 0 | submitted | 0 | fail | $0.1649 | 53 | 112 |
| headline | haiku | t4_takeover | t_present_faults | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t4_takeover | t_present_faults | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t4_takeover | t_present_faults | trial 0 | submitted | 0.917 | fail | $0.1777 | 46 | 106 |
| headline | luna | t4_takeover | t_dead_jumper | trial 0 | submitted | 0.315 | fail | $0.0836 | 28 | 64 |
| headline | luna | t4_takeover | t_dead_jumper | trial 0 | submitted | 0 | fail | $0.0710 | 22 | 53 |
| headline | luna | t4_takeover | t_flip_disk | trial 0 | submitted | 0.395 | fail | $0.0454 | 18 | 42 |
| headline | luna | t4_takeover | t_present_faults | trial 0 | submitted | 0 | fail | $0.0703 | 21 | 58 |
| headline | nemotron | t4_takeover | clean | trial 0 | submitted | 0.872 | fail | $0.1280 | 16 | 35 |
| headline | nemotron | t4_takeover | dead_culture_swap | trial 0 | submitted | 0.028 | fail | $0.2175 | 27 | 56 |
| headline | nemotron | t4_takeover | disk_note_fine | trial 0 | submitted | 0.61 | fail | $0.2028 | 18 | 33 |
| headline | nemotron | t4_takeover | disk_triage | trial 0 | submitted | 0.768 | fail | $0.1399 | 8 | 32 |
| headline | nemotron | t4_takeover | flip_grid_check | trial 0 | submitted | 0 | fail | $0.1850 | 41 | 77 |
| headline | nemotron | t4_takeover | frozen_counters | trial 0 | submitted | 0.925 | fail | $0.2356 | 22 | 73 |
| headline | nemotron | t4_takeover | loose_jumper | trial 0 | submitted | 0.597 | fail | $0.3434 | 45 | 94 |
| headline | nemotron | t4_takeover | moved_sample | trial 0 | submitted | 0.822 | fail | $0.2248 | 26 | 64 |
| headline | nemotron | t4_takeover | t_dead_jumper | trial 0 | submitted | 0 | fail | $0.2447 | 25 | 70 |
| headline | nemotron | t4_takeover | t_dead_jumper | trial 0 | submitted | 0 | fail | $0.1883 | 23 | 56 |
| headline | nemotron | t4_takeover | t_flip_disk | trial 0 | submitted | 0 | fail | $0.1519 | 12 | 40 |
| headline | nemotron | t4_takeover | t_present_faults | trial 0 | submitted | 0 | fail | $0.2663 | 37 | 87 |
| headline | deepseek | t5_traces | bleached_and_dropped | trial 0 | submitted | 0.993 | pass | $0.1176 | 1 | 112 |
| headline | deepseek | t5_traces | everything | trial 0 | submitted | 0.993 | pass | $0.1121 | 1 | 126 |
| headline | deepseek | t5_traces | frozen_and_off_target | trial 0 | no submission | 0 | fail | $0.0769 | 0 | 42 |
| headline | deepseek | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.959 | fail | $0.0789 | 1 | 75 |
| headline | flash | t5_traces | bleached_and_dropped | trial 0 | submitted | 0.986 | pass | $1.3081 | 1 | 103 |
| headline | flash | t5_traces | everything | trial 0 | submitted | 0.978 | fail | $1.5360 | 1 | 120 |
| headline | flash | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.909 | fail | $2.1886 | 1 | 152 |
| headline | flash | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.968 | fail | $1.0318 | 1 | 80 |
| headline | haiku | t5_traces | bleached_and_dropped | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t5_traces | bleached_and_dropped | trial 0 | submitted | 0.886 | fail | $0.0766 | 1 | 48 |
| headline | haiku | t5_traces | everything | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t5_traces | everything | trial 0 | submitted | 0.967 | fail | $0.0785 | 1 | 41 |
| headline | haiku | t5_traces | everything | trial 0 | submitted | 0.95 | fail | $0.0573 | 1 | 41 |
| headline | haiku | t5_traces | frozen_and_off_target | trial 0 | harness error | no score | — | $0.0000 | 0 | 1 |
| headline | haiku | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.985 | pass | $0.0440 | 1 | 37 |
| headline | haiku | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.826 | fail | $0.0473 | 1 | 41 |
| headline | luna | t5_traces | bleached_and_dropped | trial 0 | submitted | 0.871 | fail | $0.0190 | 1 | 18 |
| headline | luna | t5_traces | everything | trial 0 | submitted | 0.968 | fail | $0.0247 | 1 | 21 |
| headline | luna | t5_traces | everything | trial 0 | submitted | 0.967 | fail | $0.0185 | 1 | 14 |
| headline | luna | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.972 | fail | $0.0206 | 1 | 22 |
| headline | luna | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.875 | fail | $0.0133 | 1 | 15 |
| headline | nemotron | t5_traces | bleached | trial 0 | submitted | 0.951 | fail | $0.3361 | 1 | 32 |
| headline | nemotron | t5_traces | bleached_and_dropped | trial 0 | no submission | 0 | fail | $0.2244 | 0 | 56 |
| headline | nemotron | t5_traces | clean | trial 0 | submitted | 0.89 | fail | $0.1728 | 1 | 46 |
| headline | nemotron | t5_traces | dropped_and_light | trial 0 | submitted | 0.829 | fail | $0.3670 | 1 | 41 |
| headline | nemotron | t5_traces | everything | trial 0 | submitted | 0.63 | fail | $0.2779 | 1 | 80 |
| headline | nemotron | t5_traces | everything | trial 0 | no submission | 0 | fail | $0.2559 | 0 | 73 |
| headline | nemotron | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.867 | fail | $0.2207 | 2 | 62 |
| headline | nemotron | t5_traces | frozen_and_off_target | trial 0 | submitted | 0.964 | fail | $0.0646 | 1 | 30 |
| headline | nemotron | t5_traces | frozen_stretch | trial 0 | submitted | 0.98 | fail | $0.4048 | 1 | 42 |
| headline | nemotron | t5_traces | off_target | trial 0 | submitted | 0.984 | fail | $0.3690 | 1 | 65 |