de.gwdg.metadataqa.api.uniqueness

Class TfIdfExtractor

java.lang.Object

de.gwdg.metadataqa.api.uniqueness.TfIdfExtractor

public class TfIdfExtractor
extends Object

Extracts TF-IDF information from Apache Solr.

Author:

Péter Király

Constructor Summary

Constructors

Constructor and Description
TfIdfExtractor(Schema schema)

Method Summary

Modifier and Type	Method and Description
FieldCounter<Double>	extract(String jsonString, String recordId) Extracts sums and average of TF-IDF value for the schema's Solr field array without collecting the terms.
FieldCounter<Double>	extract(String jsonString, String recordId, boolean doCollectTerms) Extracts sums and average of TF-IDF value for the schema's Solr field array.
Map<String,List<TfIdf>>	getTermsCollection() Returns the term collection.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TfIdfExtractor

public TfIdfExtractor(Schema schema)

Method Detail

extract

public FieldCounter<Double> extract(String jsonString,
                                    String recordId)

Extracts sums and average of TF-IDF value for the schema's Solr field array without collecting the terms.

Parameters:

jsonString - The JSON string

recordId - The record identifier

Returns:

Sums and average of TF-IDF value

extract

public FieldCounter<Double> extract(String jsonString,
                                    String recordId,
                                    boolean doCollectTerms)

Extracts sums and average of TF-IDF value for the schema's Solr field array.

Parameters:

jsonString - The JSON string

recordId - The record identifier

doCollectTerms - A flag if the method collects terms

Returns:

Sums and average of TF-IDF value

getTermsCollection

public Map<String,List<TfIdf>> getTermsCollection()

Returns the term collection. The term collection is a map. The keys are the field names, the values are the list of TfIdf objects.

Returns:

The term collection