Decision trees are a simple but powerful prediction method. Figure 1: A classification decision tree is built by partitioning the predictor variable to reduce class mixing at each split.