尝试使用BorutaPy进行特征选择,但出现TypeError错误:“(slice(None,None,None),array([0,1,2,3,4]))”是无效的键。
from sklearn.ensemble import RandomForestClassifier
from boruta import BorutaPy
rf = RandomForestClassifier(n_jobs=-1, max_depth=4)
# define Boruta feature selection method
feat_selector = BorutaPy(rf, n_estimators='auto', verbose=2, random_state=1)
X = train_dt[['age', 'menopause', 'tumor_size', 'inv_nodes', 'node_caps',
'deg_malig', 'breast', 'breast_quad', 'irradiat']]
Y = train_dt.label
# find all relevant features - 5 features should be selected
feat_selector.fit(x, y)
# check selected features - first 5 features are selected
feat_selector.support_
# check ranking of features
feat_selector.ranking_
# call transform() on X to filter it down to selected features
X_filtered = feat_selector.transform(X)
我使用了乳腺癌数据集,并进行了一些小的调整,比如添加标题、特征缩放和缺失值处理。