This article is divided into four parts; they are: • How Logits Become Probabilities • Temperature • Top- k Sampling • Top- p Sampling When you ask an LLM a question, it outputs a vector of logits. Read More
How LLMs Choose Their Words: A Practical Walk-Through of Logits, Softmax and Sampling
This article is divided into four parts; they are: • How Logits Become Probabilities • Temperature • Top- k Sampling • Top- p Sampling When you ask an LLM a question, it outputs a vector of logits.
Related Posts
Hilbert: Recursively Building Formal Proofs with Informal Reasoning
Large Language Models (LLMs) demonstrate impressive mathematical reasoning abilities, but their solutions frequently contain errors…
Embedding Atlas: Low-Friction, Interactive Embedding Visualization
Embedding projections are popular for visualizing large datasets and models. However, people often encounter “friction”…
NarrativeTrack: Evaluating Video Language Models Beyond the Frame
Multimodal large language models (MLLMs) have achieved impressive progress in vision-language reasoning, yet their ability…