FLASH24 English
page 131 / 171Latest
20 textsSmall models, big questions: on-device AI's confidence problem
Nvidia released Nemotron 3 Diarization on 27 September. The roughly 100 million parameter speech model has weights anyone can download, the latest sign that small on-device AI is shipping faster than researchers understand it.
Small models, big claims: entropy is blind below 3B parameters
Token-level entropy in small language models sits near zero in 91% of dataset-model combinations, whether the answer is right or not, according to a paper posted to arXiv on 22 September. The finding undercuts the most common confidence signal used to decide when an on-device model should hand a query to a bigger one.
Show HN agent tooling roundup: runtime, registry, scanner and inbox projects
Four self-hosted AI agent projects appeared on Hacker News. They cover runtimes, an artifact registry, a security scanner and an inbox for long-running agents.