AI Is Eating Science: What the Newest Results Actually Show
On 29 September, the National Bureau of Economic Research published a working paper. It describes an open-source workflow in which a large language model reproduces, improves, and extends published economics research. The workflow flagged discrepancies in 3,460 of 4,452 replication packages.

NBER Working Paper 35782, dated September 2026, appeared on the bureau's site on 29 September. Authors Matthew Schwartz, Isaiah Andrews, and Jesse M. Shapiro describe a three-step workflow. It first reproduces an article's original calculations. It then checks for discrepancies with published findings. Finally it runs automated sensitivity analysis.
Across 4,452 published replication packages from five economics journals, the workflow flagged discrepancies in 3,460 articles or their appendices. This does not mean most economics is wrong. It measures how often an automated re-run fails to match printed results. The causes may be coding slips, version mismatches, or undocumented choices. The paper reports two other figures. In 496 articles, the workflow cut computation time by more than a factor of 10 at similar or greater accuracy. In 923 articles, it produced extensions absent from the original work but aligned with its goals and assumptions.
An honest disclosure in the paper itself
The paper includes a disclosure worth reading before quoting results. It states that LLMs were used in the analysis and writing. Schwartz worked as a contractor for Anthropic. The paper clarifies that Anthropic does not endorse the results or views. Shapiro has previously been a paid visitor at Microsoft Research New England and a paid consultant for FutureOfCapitalism. He has also been paid for writing by the New York Times. This level of transparency is rare in the field. It allows readers to weigh the conflicts, which are real.
Mathematicians are arguing about the same thing
Two posts published on 29 September address the question from a pure-math perspective. Dan Romik writes on his blog about OpenAI's announcement of a solution to the Navier-Stokes problem. He says mathematicians are anxious about their future role. He quotes Scott Aaronson's reaction as a run of the letter A. Romik then argues that this anxiety is misplaced.
Mathematics research is a feedback loop that generates new knowledge in a constant process of re-examining, digesting, and distilling existing knowledge and attempting to improve on it, Romik writes.
Romik's technical claim is narrower than the headlines suggest. AI models trained on existing corpora can generate theorems, in his phrase, distance one away from human-generated knowledge. They do so faster than people can. However, he argues they cannot reflect on that output, simplify it, extract why a proof works, or generalize the idea for reuse. Left alone, he predicts, an autonomous system stalls after the first wave and drowns in its own output. Stephen Wolfram makes a related argument in a long post dated 28 September and published on 29 September. He writes that modern AI is primarily a way of drawing on the existing corpus of human knowledge. The core of pure mathematics, he says, is human imagination guiding which questions to ask. Wolfram also distinguishes AI from computation. AI mines what humans have already produced. Computation starts from a rule and runs it, generating results that are irreducibly new. He calls this property computational irreducibility.
The industrial layer is moving in parallel
Research results arrive alongside commercial announcements treating autonomous research as a product feature. CoreWeave published a post on 29 September introducing ARIA, a coding agent built into Weights & Biases. It reads a team's experiments, forms a hypothesis, writes a config, and launches the run through W&B Launch. It then evaluates the result against a baseline and drafts a report.
The company says ARIA builds shareable W&B workspaces, panels, and reports rather than returning text. It is available in the Weights & Biases mobile app. The post was originally published on the W&B blog on 29 July, according to a line at the top of the page. CoreWeave's site carries it under a September date. Oracle made a similar move on 29 September, announcing Fusion Claw, a governed agentic execution runtime for its Fusion Applications. The company says 25 Claw-powered agentic applications are available, part of a portfolio of 75. It says the runtime combines a frontier model with deterministic enterprise computation, with an Outcome Receipt as an auditable record of what ran. Oracle's announcement quotes CEO Mike Sicilia. The systems run on Oracle Cloud Infrastructure and are powered by frontier models including Gemini and OpenAI, with support for others planned, according to the press release.
Hardware is chasing the same problem from the energy side. Efficient Computer said on 29 September that it raised a $97 million Series B led by TQ Ventures. That takes its total raise to $173 million at a $650 million valuation. CEO Brandon Lucia writes that the company's processors bring 10 to 100 times better energy efficiency than traditional CPU architectures. He says it is launching the Electron E1 at volume for embedded physical AI systems. That claim comes from the company's own blog post and has not been independently verified here.
Energy, water and the places asked to host it
The compute buildout has a geography, and that geography has politics. CBC News reported on 29 September on Newfoundland and Labrador's energy minister, Lloyd Parrott. He told the House of Assembly during a special session on the Churchill Falls agreement in mid-September that the province's door is open for business. A department spokesperson, Brodie Thomas, confirmed to CBC that the government has been approached by companies about data centres. He said commercially sensitive discussions could not be commented on. CBC quotes Paris Marx, author of a book on data centres, asking whether it makes sense to give that electricity to data centres when there might be better uses. Andrea King, CEO of TechNL, told the broadcaster that Labrador meets the criteria proponents look for: low-carbon hydro, cold weather, and land. But that does not by itself make a project a good idea.
The debate is not only Canadian. CBC notes that Meta's planned data centre in Sturgeon County, Alberta, is expected to cost $13 billion and come online in two to three years. It notes that Nova Scotia Premier Tim Houston has set five starting conditions for any proponent. The energy arithmetic behind all of this is old and unfashionable. David MacKay's Sustainable Energy Without the Hot Air, whose site carries a last-modified date of 29 August 2015, remains the standard back-of-the-envelope treatment. The page was still being surfaced on 29 September.
A newer treatment comes from Hannah Ritchie, who published an analysis of electrification on her Substack on 29 September. Working through numbers from Oxford professor Nick Eyre, she reports that global final energy demand falls from 416 to 247 exajoules in a post-transition system, about 40% lower. Electricity demand rises from 110 to 189 EJ. Electric cars convert around 80% of energy to motion against 20% for petrol, she writes. The model assumes all non-electrified sectors run on hydrogen. She flags that as a simplification.
What the week actually established
Nothing here shows that AI has replaced researchers. The NBER paper is a workflow paper about replication, not a claim about discovery. Romik's argument is a prediction, not a result. He says plainly that he does not think we are in that world yet. Wolfram's is an essay. What the week did establish is that the tools for automated replication and extension of published work now exist in the open. Their error rate on a large corpus is high enough to matter. And the people building the commercial infrastructure are selling autonomy on a much shorter timeline than the people thinking about what autonomy is for.
Sources
9- 01An LLM Workflow That Reproduces, Improves, and Extends Published Economics ResearchEN
- 02The feedback loop of mathematics researchEN
- 03What's the Future for Pure Math Research in the Age of AI?EN
- 04Introducing CoreWeave ARIA: AI Research and Iteration AgentEN
- 05Oracle Extends Fusion Agentic Applications with Introduction of Fusion ClawEN
- 06Solving computing's energy problem with Efficient Computer's $97M Series BEN
- 07AI data centres in N.L.? The door is 'open for business,' says energy ministerEN
- 08Electrification efficiency: The world will need less energy after the transitionEN
- 09Sustainable energy without the hot airEN
All figures and quotations in this text come from the sources listed below.
Content prepared by the editorial team with AI assistance.
Comments
0- No comments yet — be the first.