尚未安装RandomForestClassifier实例。使用此方法之前，请使用适当的参数调用“ fit”

Question

我正在尝试训练决策树模型，保存它，然后在以后需要时重新加载它。但是，我不断收到以下错误：

该DecisionTreeClassifier实例尚未安装。使用此方法之前，请使用适当的参数调用“ fit”。

这是我的代码：

X_train, X_test, y_train, y_test = train_test_split(data, label, test_size=0.20, random_state=4)

names = ["Decision Tree", "Random Forest", "Neural Net"]

classifiers = [
    DecisionTreeClassifier(),
    RandomForestClassifier(),
    MLPClassifier()
    ]

score = 0
for name, clf in zip(names, classifiers):
    if name == "Decision Tree":
        clf = DecisionTreeClassifier(random_state=0)
        grid_search = GridSearchCV(clf, param_grid=param_grid_DT)
        grid_search.fit(X_train, y_train_TF)
        if grid_search.best_score_ > score:
            score = grid_search.best_score_
            best_clf = clf
    elif name == "Random Forest":
        clf = RandomForestClassifier(random_state=0)
        grid_search = GridSearchCV(clf, param_grid_RF)
        grid_search.fit(X_train, y_train_TF)
        if grid_search.best_score_ > score:
            score = grid_search.best_score_
            best_clf = clf

    elif name == "Neural Net":
        clf = MLPClassifier()
        clf.fit(X_train, y_train_TF)
        y_pred = clf.predict(X_test)
        current_score = accuracy_score(y_test_TF, y_pred)
        if current_score > score:
            score = current_score
            best_clf = clf


pkl_filename = "pickle_model.pkl"  
with open(pkl_filename, 'wb') as file:  
    pickle.dump(best_clf, file)

from sklearn.externals import joblib
# Save to file in the current working directory
joblib_file = "joblib_model.pkl"  
joblib.dump(best_clf, joblib_file)

print("best classifier: ", best_clf, " Accuracy= ", score)

这是我如何加载模型并对其进行测试：

#First method
with open(pkl_filename, 'rb') as h:
    loaded_model = pickle.load(h) 
#Second method 
joblib_model = joblib.load(joblib_file)

如您所见，我尝试了两种保存方式，但没有一种有效。

这是我的测试方式：

print(loaded_model.predict(test)) 
print(joblib_model.predict(test)) 

您可以清楚地看到这些模型实际上是拟合的，并且如果我尝试使用任何其他模型（例如SVM或Logistic回归），该方法就可以正常工作。

Answer 1

问题在这一行：

best_clf = clf

您已clf转到grid_search，它会克隆估算器并使数据适合那些克隆的模型。因此，您的实际状况clf仍然没有改变。

您需要的是

best_clf = grid_search

保存拟合的grid_search模型。

如果您不想保存grid_search的全部内容，则可以使用best_estimator_属性grid_search来获得实际的克隆拟合模型。

best_clf = grid_search.best_estimator_