Skip to content
World clockEU--:--UK--:--USA--:--CN--:--PLDEFRIT中文EN

portal about AI and technologyevents · analysis · interviews · technical background

Search
LIVE
›

Forecasters Get More AI Tools, but the Weather Models Still Have to Earn Trust

On 5 October, Liquid AI launched d1, a "decision model" that returns probabilities instead of generated text. The company says it answers in 200 to 300 ms.

AI & modelsAnalysisRachel NwosuPublished: 5 October 20264 min readSources 11
Forecasters Get More AI Tools, but the Weather Models Still Have to Earn Trust
The most recent item in the dossier is not a weather model at all: on 5 October, Liquid AI launched d1, a "dec

The pitch is narrow and easy to check. Liquid AI's blog says d1 reads text, images or both in one forward pass. It returns a probability for each possible answer. No tokens are generated. A text decision takes 200 to 300 ms, the company says. It claims d1 matches or beats GPT-6.1 Sol on four of six "real applications" it tested.

Liquid's own examples are mostly industrial and clerical: filtering support tickets, filing documents, inspecting circuit boards from four production lines on the public VisA dataset. There, d1 sorts good and defective parts with 85-97% accuracy. The company says the model was never trained for that task.

Why does this matter to a weather desk? A forecast is, at bottom, a structured decision under uncertainty. The cheap end of that pipeline is where small models are being pushed. No benchmark of d1 on meteorological data has been published, and Liquid AI does not claim one. Treat the weather angle as a hypothesis, not a result.

What the record actually shows on forecasting

One forecasting result stands out. It is a hybrid model combining a driving-inspired optimiser with AI. Bioengineer.org reported that it improves wind power forecasts by 12.7%. It appears only as a headline in the context list, so the number is all we have: no method, no dataset, no baseline. On that evidence, 12.7% is a press release figure until someone reproduces it.

Elsewhere the pattern is the same: capable general models, thin domain evidence. NASA-IMPACT published fine-tuning and inference code for the NASA-IBM Lunar Foundation Model on 5 October. It includes TerraTorch configs for crater detection, IMP segmentation and ice prospectivity. It is a foundation model for lunar surface science, not weather. But it shows the template: a pretrained backbone plus task-specific heads, released with weights on Hugging Face.

The core reads the request, decides which specialists to run, and composes the answer from what they return.

That line comes from the Interfaze 1.1 Lite model card posted on 5 October. It describes a mixture-of-architectures design that runs on a single 80 GB GPU with no external services. Its benchmark table lists GPQA Diamond at 85.9, MMMU-Pro at 73.2 and olmOCR-Bench at 83.8. None of those is a weather benchmark. They are the kind of numbers vendors now publish by default. They tell you almost nothing about whether a model can handle a 10 km grid.

The trust problem underneath

UC Riverside researchers reported on 23 September that confidence and correctness in large language models can arise from different internal features. Het Patel, a doctoral student and lead author, said the field's main assumption is that confidence tracks correctness, but "we often see the counterexamples that are well documented." The team studied Meta's Llama-3.1-8B and Google's Gemma-2-9B with sparse autoencoders. It found they could suppress selected features without retraining the whole model.

For anyone bolting a language model onto a forecast pipeline, that is the practical warning. A model that sounds sure about a storm track is not thereby right about it. Patel's comparison was to "turning knobs" inside a model to see how behaviour changed. Suppressing features tied purely to uncertainty sharply reduced accuracy.

The efficiency claims are real but separate. Reflection announced Beam on 5 October. It is a 501B-parameter sparse mixture-of-experts model with 23B active. It was trained with over 100 million RL rollouts on 10.5K NVIDIA GB300 GPUs over four weeks. Reflection says Beam is competitive with GLM 5.2 while using 3 to 4 times less inference compute. The weights are not out yet: the company says final red-teaming is under way and the release comes later this month.

Small-model tooling is moving too. Jeff-Code, a fork of Pi published on 5 October, puts a 0.8B decision model alongside Qwen 3.8-27B. It reports tasks running at 0.68 times the baseline time at a 62.4% versus 62.8% pass rate across 1,242 paired tasks. That is a speed result, not an accuracy one. The author is candid that in about 5% of tasks it runs more than 30 minutes longer.

The honest reading of this week's news: the infrastructure for cheap, fast structured decisions is arriving faster than the evidence that it works on physical systems. Weather forecasting will get these tools. It has not yet been shown that it should trust them.

Comments 0

Sources

11
  1. 01Introducing d1: The most capable decision model, now with visionEN
  2. 02NASA-IBM Lunar Foundation Model and fine-tuning codeEN
  3. 03Interfaze-1-lite: the first open-weight model for deterministic taskEN
  4. 04Study: Path discovered to make AI models red-flag their doubtful answersEN
  5. 05Beam: Reflection's 501B open-weight modelEN
  6. 06Jeff-Code: a 0.8B model makes Qwen 3.8-27B coding 47% faster, same pass rateEN
  7. 07Reika: a coding agent CLI designed around small local models firstEN
  8. 08Precogly: open-source threat modeling platformEN
  9. 09Sales of sub-EUR25,000 electric car models set to rise sevenfoldEN
  10. 10Topological Models of Modal LogicEN
  11. 11System One models like Jev can train their own replacementsEN

All figures and quotations in this text come from the sources listed below.

Content prepared by the editorial team with AI assistance.

Rachel Nwosu

Rachel Nwosu

AI, models and technology

Rachel Nwosu covers AI, models and technology for FLASH24, working from public model documentation, benchmark releases and repository histories rather than press summaries, and she skips announcements that arrive without reproducible numbers. She checks training-data claims against dataset cards and reruns reported metrics where code is available. She spends much of her week interviewing researchers and engineers, tracking model launch calendars, and comparing vendor benchmarks with independent evaluations. Outside the desk she runs 3D printers, restores old computers, and tests how models learn from internet junk. She does not publish benchmark figures she cannot trace to a source.

Newsroom →

Comments

0
  1. No comments yet — be the first.

Write a comment

Comments are public. We do not publish abuse, spam or advertising.