我正在尝试使用 TFIDF 和 SVM 对某些文件进行文本分类。每次选择 3 个词的功能。我的数据文件已经是这样的格式:angel eyes has, each one for, on its own. 没有停用词,也不能进行旅鼠或词干提取。我希望该功能被选择为:angel eyes has ...我编写的代码如下:
import os
import sys
import numpy
from sklearn.svm import LinearSVC
from sklearn.metrics import confusion_matrix
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.feature_extraction.text import TfidfTransformer
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn import metrics
from sklearn.datasets import load_files
from sklearn.cross_validation import train_test_split
dt=load_files('C:/test4',load_content=True)
d= len(dt)
print dt.target_names
X, y = dt.data, dt.target
print y
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=0)
print y_train …Run Code Online (Sandbox Code Playgroud)