01
Falsify
Hackathon · live
7th Hack-Nation Global AI Hackathon · Solo build · 24 hours · October 2026
Agent evals mostly ask whether an agent succeeded. The harder question is why it behaved that way, and what intervention would change it.
Owned
- Solo build: lab design, experiments, site, in 24 hours
- Autonomous lab of AI agents: PI, pods, analyst, skeptic, reviewer
- Pre-registered hypotheses and a synthetic test environment
- Statistical analysis with confidence intervals on every claim
- React/TypeScript results site, deployed on Vercel
Result
Ran four research loops on Claude Haiku and Qwen agents studying when they resist correction. Most hypotheses came back null, and the lab said so: 0/90 agents persisted with an invalidated plan. Its first real effect: an advisory majority saying "skip it" cut verification by 30 points. Result-to-decision time fell from 60 minutes in the first loop to 6–11 minutes in later loops.