The Reproducibility Bill: 918 AI Papers Map the Cost of Missing Artifacts
A 918-paper study maps the cost of reproducing AI research. Use its findings to budget code, data, compute, and reviewer time.
Tag
#evaluation
9articleswith this tag.
ChatGPT Raised Assignment Scores. The Bocconi Study Did Not Measure Learning
A 1,053-student trial found that ChatGPT improved scored recommendations, but its originality metric was computational and the study did not measure later learning.
Apple's Foundation Models API Hides Three Different Trust Boundaries
Apple's common Swift session API can reach on-device models, Private Cloud Compute, or another provider, but those routes differ in privacy, capacity, and availability.
GitHub Copilot Retirements Show Why a Fallback Model Is Temporary
Six Copilot models retire September 1, and one suggested replacement retires nine days later. The product name is more stable than its model catalog.
Google HEIR Makes Private Inference Compilable, Not Automatically Practical
Google's HEIR compiler can translate several models into encrypted computation, but ciphertext expansion, memory, latency, and model changes remain decisive.
Sentence Transformers v6 Makes Late Interaction Easier, Not Cheaper
Sentence Transformers v6 adds multi-vector retrieval, while its own results show a modest average quality gain beside a much larger storage bill.
Google's AI Contrail Avoidance Moves to an Airspace Trial
Operation Blue Skies will test whether AI-guided altitude changes reduce warming contrails across busy North Atlantic airspace, not just selected flights.
Cross-Model KV Cache Transfer Is Fast—and Surprisingly Pair-Specific
NVIDIA researchers report a 25× component speedup for one KV-cache mapping, while several other model pairs lost much of the target model’s task accuracy.
Linus Torvalds' 24-Patch Debug Session Shows Where AI Helped—and Failed
An AI assistant helped iterate through 24 debug patches and 18 boots, but repeatedly urged Linus Torvalds to abandon the investigation before the evidence found the bug.