| Title: |
Practical guidelines for the use of gradient boosting for molecular property prediction. |
| Authors: |
Boldini, Davide, Grisoni, Francesca, Kuhn, Daniel, Friedrich, Lukas, Sieber, Stephan A. |
| Source: |
Journal of Cheminformatics; 8/28/2023, Vol. 15 Issue 1, p1-13, 13p |
| Subject Terms: |
SCIENCE competitions, DECISION trees, STRUCTURE-activity relationships, DATA science, FORECASTING, BOOSTING algorithms |
| Abstract: |
Decision tree ensembles are among the most robust, high-performing and computationally efficient machine learning approaches for quantitative structure–activity relationship (QSAR) modeling. Among them, gradient boosting has recently garnered particular attention, for its performance in data science competitions, virtual screening campaigns, and bioactivity prediction. However, different variants of gradient boosting exist, the most popular being XGBoost, LightGBM and CatBoost. Our study provides the first comprehensive comparison of these approaches for QSAR. To this end, we trained 157,590 gradient boosting models, which were evaluated on 16 datasets and 94 endpoints, comprising 1.4 million compounds in total. Our results show that XGBoost generally achieves the best predictive performance, while LightGBM requires the least training time, especially for larger datasets. In terms of feature importance, the models surprisingly rank molecular features differently, reflecting differences in regularization techniques and decision tree structures. Thus, expert knowledge must always be employed when evaluating data-driven explanations of bioactivity. Furthermore, our results show that the relevance of each hyperparameter varies greatly across datasets and that it is crucial to optimize as many hyperparameters as possible to maximize the predictive performance. In conclusion, our study provides the first set of guidelines for cheminformatics practitioners to effectively train, optimize and evaluate gradient boosting models for virtual screening and QSAR applications. [ABSTRACT FROM AUTHOR] |
|
Copyright of Journal of Cheminformatics is the property of Springer Nature and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Database: |
Complementary Index |
|
Full text is not displayed to guests. |
Login for full access.
|
