Machine Learning

Score Distillation of Flow Matching Models

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework, has since been shown to be theoretically equivalent to diffusion under Gaussian assumptions, raising the question of whether distillation techniques such as score distillation transfer directly. We provide a simple derivation — based on Bayes’ rule and conditional expectations — that unifies Gaussian diffusion and flow matching without relying on ODE/SDE…

​Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework, has since been shown to be theoretically equivalent to diffusion under Gaussian assumptions, raising the question of whether distillation techniques such as score distillation transfer directly. We provide a simple derivation — based on Bayes’ rule and conditional expectations — that unifies Gaussian diffusion and flow matching without relying on ODE/SDE… ​​ Read More

Leave a Reply

Your email address will not be published. Required fields are marked *