The Reproducibility Bill: 918 AI Papers Map the Cost of Missing Artifacts
A 918-paper study maps the cost of reproducing AI research. Use its findings to budget code, data, compute, and reviewer time.
Category
Research
5articlesin this category.
WorldCup Arena Avoids Leakage, but Its Leaderboard Is Not a Verdict
WorldCup Arena tests LLM forecasts before results exist, but scoring changes the ranking and the public archive does not include every original model call.
ASI-Bench Finds AI Agents Struggle Without a Research Procedure
ASI-Bench tests scientific agents as human guidance disappears. Its largest score drop reveals a procedure-building problem, not proof about superintelligence.
Why Google DeepMind Is Testing AI Agents in an Offline EVE Online
DeepMind is starting its EVE agent research offline. Here is why persistent worlds need different tests for memory, planning, recovery, and safety.
NVIDIA AVO's 100% ARC-AGI-3 Result Measures a Harness, Not a Model
NVIDIA AVO cleared ARC-AGI-3's public set, but the benchmark does not isolate the harness contribution or test generalization on private tasks.