Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent ...

(1) We released the 50 diffusion steps model (instead of 1000 steps) which runs 20X faster with comparable results. (2) Calling CLIP just once and caching the result runs 2X faster for all models.