Cram Less to Fit More: Training Data Pruning Improves Memorization of Facts
This paper was accepted at the Workshop on Navigating and Addressing Data Problems for Foundation…
TAPs or it didn’t happen
Once, I went to talk about "curiosity" with @LoganStrohl. They noted "it seems like you…
Trump officials may be encouraging banks to test Anthropic’s Mythos model
The report is particularly surprising since the Department of Defense recently declared Anthropic a supply-chain…
Talk English, Think Something Else
There's an adage from programming in C++ which goes something like "Yes, you write C,…
Eggs, rooms, puzzles, and talking about AI
I live with five friends in a big house, and two things I’ve done in…
Apple reportedly testing four designs for upcoming smart glasses
These glasses are a step back from an ambitious plan that once called for Apple…
Book Review: Existential Kink
In a recent rationalist unconference multiple people recommended me Carolyn Elliott's Existential Kink, one of…
Sparse Autoencoders for Single-Cell Models
People are rushing to build bigger and bigger single cell foundation models (trained on RNA…
Counterintuitive Coin Toss. Part II
Translation from Russian. Original text available here. The first part available here.This Is a Fraud,…