Math behind all the mainstream tree-based machine learning models
Machine learning study notes, contains Math behind all the mainstream tree-based machine learning models, covering basic decision tree models (ID3, C4.5, CART), boosted models (GBM, AdaBoost, Xgboost, LightGBM), bagging models (Bagging Tree, Random Forest, ExtraTrees).
1. ID3 Model
2. C4.5 Model
3. CART Tree Model
1. Adaptive Boosting (AdaBoost)
2. GBM (Gradient Boosting Machine)
3. XGboost (Extreme Gradient Boosting)
4. LightGBM (Light Gradient Boosting Machine)
1. Bagging Tree
2. Random Forest
3. Extra Trees (Extremely Randomized Trees)