Thel Gunter·Oct 1248 of 64 Layers: The Architecture Change Behind Long-Context Local AIIn April, Alibaba released Qwen3.6–27B, a model with sixty-four layers, and forty-eight of them don’t use attention at all.
Thel Gunter·May 16The Ledger and the LensA man wakes up one morning with a strange condition. He can still learn facts. He can read the news, meet new people, remember what he had…
Thel Gunter·Mar 3Part 4: The Last Private LanguageWittgenstein spent a significant portion of the Philosophical Investigations attacking an idea that, on the surface, seems obviously true…
Thel Gunter·Mar 3Part 3: Performing ThinkingThere is a thought experiment that philosophers of mind have been arguing about for decades, and it goes like this: imagine a person who…
Thel Gunter·Feb 28Part 2: The Premature CollapseJohn Keats, in a letter to his brothers in December 1817, described a quality he had noticed in Shakespeare and found lacking in most other…
Thel Gunter·Feb 28Part 1: The Last Unobserved SpaceYou think differently when someone is watching. This is not a claim about self-consciousness or social anxiety. It is one of the oldest…
Thel Gunter·Feb 25The Epistemic Monoculture: How Cross-Lab Distillation Is Collapsing AI’s Cognitive DiversityWhen every AI lab trains on every other AI lab’s outputs, what happens to the range of possible thought?
Thel Gunter·Feb 7What We Forgot We ForgotA companion to “Our Registers, Their Weights” and “The Reward That Teaches Nothing”