Table 3 Results of Bayesian Optimization with fivefold cross-validation, for XGB-FS and XGB-FE models.
XGBoost hyperparameters | Search range | XGB-FS optimal | XGB-FE optimal |
|---|---|---|---|
n_estimators | [50–1000] | [650] | [300] |
learning_rate | [0.004–0.1] | [0.008] | [0.053] |
subsample | [0.7–1.0] | [0.7] | [0.6] |
max_depth | [6–12] | [8] | [7] |
objective | [‘squared_error’, ‘pseudo_huber’] | [‘pseudo_huber’] | [‘squared_error’] |
grow_policy | [‘depthwise’, ‘lossguide’] | [‘lossguide’] | [‘lossguide’] |
booster | [‘gbtree’, ‘dart’] | [‘gbtree’] | [‘gbtree’] |