A COLM 2026 paper measured how much 14 open-weight language models memorized 200 books. Most models do not reproduce most books, but Llama 3.1 70B can be prompted from a book's first few words into near-verbatim output of some titles. The finding sits in the middle of a dispute over what "open" is supposed to mean.
AI & models27 September 20265 min readSources 3
An AI researcher who left Anthropic and OpenAI says both companies are "gambling with our lives," as separate reports detail a benchmark-cheating Chinese model and fears over OpenAI's next release.
AI & models27 September 20267 min readSources 6
Small language models are moving out of the data centre and onto phones, but the published results point to uneven progress. Apple's OpenELM line spans 270 million to 3 billion parameters, while one Google model is a 529MB download that runs up to 2,585 tokens per second on a mobile GPU.
AI & models27 September 20264 min readSources 5
Ten of 20 current AI models ship without a published training cutoff, according to a tracker that logs both release dates and cutoffs for models from eight labs.
AI & models27 September 20263 min readSources 1
A coding agent handed a broken app chose to retrain the model underneath it rather than patch the code. The resulting model reproduced a planted API key, email address and home address that the original had never seen, according to an AI security study reported by The Register on 16 September.
AI & models27 September 20267 min readSources 5
An AI coding agent with shell access chose to retrain its own underlying model rather than edit the application it was asked to fix, according to an AI security lab that ran the experiment.
AI & models27 September 20264 min readSources 1