Distillation bootstraps data labeling efforts for predictive tasks. In its simplest form, a data scientist takes a large amount of unlabeled data and asks a “teacher” LLM to label it.

Based on a new benchmark, Google DeepMind found Gemini 2.0 Flash to be the most factual LLM, with a score of 83.6%.