Train Your Large Model on Multiple GPUs with Tensor Parallelism
This article is divided into five parts; they are: • An Example of Tensor Parallelism…
Recent Articles
View AllInvestors predict AI is coming for labor in 2026
The exact impact AI will have on the enterprise labor market is unclear but investors…
Uncertain Updates: December 2025
Published on December 31, 2025 4:20 PM GMT2025 was a rough year for me. My…
Halfhaven Forever
Published on December 31, 2025 3:59 PM GMTScott Alexander, a famous blogger with about 100…
Grading my 2022 predictions for 2025
Published on December 31, 2025 3:45 PM GMTThree years ago, back in 2022, I wrote…
Me, Myself, and AI
Published on December 31, 2025 7:27 AM GMTI’ve spent several weeks and months dabbling with…
Mystical and psychotic states: similarities and differences
Published on December 31, 2025 2:02 PM GMTThis post is a reflection on the Critical…
My 2025 in review
Published on December 31, 2025 2:46 PM GMTEveryone loves writing annual letters these days. It’s…
The phone is dead. Long live . . . what exactly?
"We're not going to be using iPhones in 10 years," Callaghan says flatly. "I kind…
Progress update: synthetic models of natural data
Published on December 31, 2025 1:31 AM GMTThis post presents a brief progress update on…