sklearn_api.tfidf – Scikit learn wrapper for TF-IDF model

sklearn_api.tfidf – Scikit learn wrapper for TF-IDF model

Scikit learn interface for gensim for easy use of gensim with scikit-learn Follows scikit-learn API conventions

class gensim.sklearn_api.tfidf.TfIdfTransformer(id2word=None, dictionary=None, wlocal=<function identity>, wglobal=<function df2idf>, normalize=True)

Bases: sklearn.base.TransformerMixin, sklearn.base.BaseEstimator

Base Tf-Idf module

Sklearn wrapper for Tf-Idf model.

fit(X, y=None)

Fit the model according to the given training data.

fit_transform(X, y=None, **fit_params)

Fit to data, then transform it.

Fits transformer to X and y with optional parameters fit_params and returns a transformed version of X.

Parameters:

• X (numpy array of shape [n_samples, n_features]) – Training set.
• y (numpy array of shape [n_samples]) – Target values.

Returns:

X_new – Transformed array.

Return type:

numpy array of shape [n_samples, n_features_new]

get_params(deep=True)

Get parameters for this estimator.

Parameters:deep (boolean, optional) – If True, will return the parameters for this estimator and contained subobjects that are estimators. Returns:params – Parameter names mapped to their values. Return type:mapping of string to any

set_params(**params)

Set the parameters of this estimator.

The method works on simple estimators as well as on nested objects (such as pipelines). The latter have parameters of the form <component>__<parameter> so that it’s possible to update each component of a nested object.

Returns: Return type:self

transform(docs)

Return the transformed documents after multiplication with the tf-idf matrix.