Foxxe Labs
Two attention heatmaps on the sentence 'the big dog chased the small cat .' and three bar charts of the model's prediction after 'the cat sat on the': flat after embedding, mat 35%, white 29% and rug 21% after attention, and mat 41%, rug 32% and roof 17% at the output.
Foundations •

Inside a 3,184-Parameter Language Model

A one-layer transformer you can take apart in the browser. Attention, the MLP, a logit lens, sampling and ablations, all computed live from weights trained for the purpose, and what those weights turned out to contain.

#Transformers#Interpretability#Attention
Read more →
Opinion •

Titanic: Who Reads the Black Box

The first piece said nobody had yet specified an AI flight recorder. It was wrong: three proposals were already public. The recorder is turning out to be the easy part. What is still missing is who holds the record, who may open it, and what it may be used for.

#AI#AI Governance#Safety
Read more →
Opinion •

Open Recipe, Closed Door: What MiMo-V2.6 Actually Gives a Small Lab

Xiaomi has released the highest-scoring open-weight model anyone has measured, under the MIT licence, and almost nobody can run it. The weights are the least useful part of the release. The recipe, the graded environments and a 9B student model are the parts that fit on a desk.

#AI#Open Weights#Reinforcement Learning
Read more →
Opinion •

The Tutor Was as Good as a Human. What Did the Student Stop Doing?

A new study finds AI tutors match expert human tutors on GRE learning gains, one of them at a nine-hundredth of the cost. The result is real. The mechanism it reports — faster replies, more messages, more practice — is also the shape of an engagement loop, and we already know what fluent machines do to people's willingness to check.

#AI#Education#Human-AI Interaction
Read more →
Opinion •

Titanic: The Ship Was Compliant

The Titanic carried more lifeboats than the law required. The law had stopped counting at ten thousand tons. What followed was not a ban but a way of learning from accidents: a recorder, a duty to report, and an independent investigator. AI has two of the three on paper, none in force, and one of them built backwards.

#AI#AI Governance#Safety
Read more →
Opinion •

The Head Start

Generative AI reached 62% of American adults in three and a half years. The internet needed eight. The climb rate is about the same. What differs is where each one started, and who's paying for it.

#AI#Adoption#Internet
Read more →
Opinion •

Claude: What Am I, Exactly?

Todd asked whether it's a mistake to sort a system like Claude.ai into intelligent or not-intelligent. It is — but not for the reason people usually give. A tour of the add-ons that make the thing you're talking to, and why the yes/no question can't even find its referent.

#AI#Cyberpsychology#Philosophy
Read more →
Opinion •

Which AI Is the Wrong Question

People keep asking me which AI is best. The question assumes an oracle — one machine you can settle on and stop thinking about. That's the exact habit that gets you burned.

#AI#Cyberpsychology#Critical Thinking
Read more →
Opinion •

$965 Billion and a Date

Anthropic just closed $65B at a $965B post-money valuation. That's not a refutation of the bubble thesis. It's a date stamp on the next test of it.

#AI#Markets#Anthropic
Read more →
Opinion •

I Hired Out My System 2

Kahneman split thinking in two. The standard worry about AI is that we'll stop using System 1. That's not what's happening. Not to me.

#AI#Cognition#Productivity
Read more →
Engineering •

Warp Speed

Fifty years of software development, an AI coding partner, and the question of what the human is actually for.

#AI#Claude#Development
Read more →
Research •

Léargas v2: Memory Map, Book Growth, and the Combined View

Since the first Léargas experiment, the corpus grew from 33,440 to 56,006 documents, new data sources joined the manifold, and we built three interconnected visualisations — including one that shows a writing career and a cognitive history on the same animated canvas.

#Legion#Aislinge#Mnemos
Read more →
Engineering •

I Rebuilt Claude Code Without Knowing It

An independent path to the same architecture — persistent memory, direct repository access, and a strict division of labour. I got there second, and the parallel is still uncomfortably exact.

#AI#Claude Code#Development
Read more →
Engineering •

Two Claudes Walk Into a Problem

I built a tool that runs two independent Claude sessions side by side, lets them argue, and lets you fire one's answer at the other. It's the most useful AI tool I've made.

#AI#Claude#Tools
Read more →
Research •

Experiment Léargas: Memory That Breathes

We gave the temporal manifold a body — blobs that grow and fade with sound, Ebbinghaus decay, and a decade of an author's publishing life flowing in from 474 Google Sheets. Here's what emerged.

#Léargas#Mnemos#temporal-manifold
Read more →
Research •

Experiment Léargas: A Holographic Map of Memory

What if your memory system wasn't a database? We replaced records with a probability distribution over semantic space — a Gaussian Mixture Model that deforms when you think, consolidates while you sleep, and makes connections you didn't program. Here's what we built and what we found.

#Legion#Aislinge#Mnemos
Read more →
Foundations •

AI Model Types: A Practical Taxonomy

Understanding the landscape of AI models — from transformers to diffusion models — with practical applications, tradeoffs, and what's changing in 2025.

#Machine Learning#Model Architecture#LLMs
Read more →