Diffusion models are widely used in many AI applications, but research on efficient inference-time scalability, particularly for reasoning and planning (known as System 2 abilities) has been lacking.

Policy Gradient is a policy-based reinforcement learning algorithm that approximates the optimal policy through a parametric function. The algorithm classifies the observations by softmax through ...