Gradient boosting is a [[machine learning]] [[technique]] used in [[regression]] and [[classification]] [[task]]s, among others. It gives a [[prediction model]] in the form of an ensemble of weak prediction models, i.e., models that make very few assumptions about the data, which are typically simple decision trees