SCoT: Unifying Consistency Models and Rectified Flows via Straight-Consistent Trajectories

Longbing Cao (Macquarie University, Australia) · zhangkai wu (Macquarie University) · Xuhui Fan (Macquarie University) · Hongyu Wu (Macquarie University)
approximation errorsconsistency modelcritical objectivesdistillationdual propertiesfast samplinggradient regulationmapping functionnumerical ode solverspre-trained diffusion modelsprojection functionsrectified flow methodsampling efficiencystraight-consistent trajectoriestrajectory consistency

Pre-trained diffusion models are commonly used to generate clean data (e.g., images) from random noises, effectively forming pairs of noises and corresponding clean images. Distillation on these pre-trained models can be viewed as the process of constructing advanced trajectories within the pair to accelerate sampling. For instance, consistency model distillation develops consistent projection functions to regulate trajectories, although sampling efficiency remains a concern. Rectified flow method enforces straight trajectories to enable faster sampling, yet relies on numerical ODE solvers, which may introduce approximation errors. In this work, we bridge the gap between the consistency model and the rectified flow method by proposing a Straight-Consistent Trajectories~(SCoT) model. SCoT enjoys the benefits of both approaches for fast sampling, producing trajectories with consistent and straight properties simultaneously. These dual properties are strategically balanced by targeting two critical objectives: (1) regulating the gradient of SCoT's mapping function to a constant and (2) ensuring trajectory consistency. Extensive experimental results demonstrate the effectiveness and efficiency of SCoT.