Python:LightGBM交叉验证.如何使用lightgbm.cv进行回归?

Mar*_*ius 14 python regression cross-validation lightgbm

我想用lgb.Dataset对LightGBM模型进行交叉验证,并使用early_stopping_rounds.以下方法在XGBoost的xgboost.cv中没有问题.我不想将Scikit Learn的方法与GridSearchCV一起使用,因为它不支持提前停止或lgb.Dataset.

import lightgbm as lgb
from sklearn.metrics import mean_absolute_error
dftrainLGB = lgb.Dataset(data = dftrain, label = ytrain, feature_name = list(dftrain))

params = {'objective': 'regression'}

cv_results = lgb.cv(
        params,
        dftrainLGB,
        num_boost_round=100,
        nfold=3,
        metrics='mae',
        early_stopping_rounds=10
        )
Run Code Online (Sandbox Code Playgroud)

任务是进行回归,但以下代码会引发错误: Supported target types are: ('binary', 'multiclass'). Got 'continuous' instead.

LightGBM支持回归,还是我提供了错误的参数?

Viv*_*mar 28

默认情况下,lightgbm.cv中的分层参数为True.根据文件:

分层(bool,optional(默认= True)) - 是否执行分层抽样.

但分层仅适用于分类问题.因此,要使用回归,您需要将其设为False.

cv_results = lgb.cv(
        params,
        dftrainLGB,
        num_boost_round=100,
        nfold=3,
        metrics='mae',
        early_stopping_rounds=10,

        # This is what I added
        stratified=False
        )
Run Code Online (Sandbox Code Playgroud)

现在它的工作.

  • 有趣.看起来它被交换为True [here](https://github.com/Microsoft/LightGBM/pull/734).一个要记住未来!OP - 它看起来像`shuffle = True`是默认值,所以要小心比较scikit-learn,其中`shuffle = False`是CV的默认值! (3认同)