A sealed gate on a six-task adapter-training pilot

STOP experiment

A pre-registered per-task viability gate was applied to a small adapter-training pilot on six tasks. Only 3 of 6 tasks were viable (the rule needed 4), so the gate said stop.

Key numbers

viable tasks (need 4 of 6)

3 of 6
Source file: sealed-gate/examples/r3_stage_a/STAGE_A_PUBLIC.json
Source hash: b8fb0e758968ccda948da345c82806a3baad5529e3789d472f5eaf75ebd6447f

Caveats

  • The results file itself was not sealed
  • A 0.0025 miss is inside one standard error

Watch the roundup

What we tested, and what we learned (90 s)

Video hash: 3de55bc330bba5f8

Request the full write-up

Full write-ups are not public yet. You can request one; requests are reviewed by hand.

Requests are stored privately for up to twelve months, reviewed by hand, never shared, and deleted on request. Contact QMAI@quantummindaillc.com.