Back to articles
Volume: 14 | Article ID: art00023
Identifying top performing TF*IDF classifiers using the CNN corpus
  DOI :  10.2352/issn.2168-3204.2017.1.0.105  Published OnlineMay 2017

TF*IDF (term frequency times inverse document frequency) is a common metric used to automatically discover keywords in documents for use in classification and other text processing applications. We are interested in determining whether these measures can help in classifying documents. There are multiple ways to define TF*IDF, but there has been no real attempt to determine the value of these different forms. We explore a large family of 112 TF*IDF measures (corresponding to an a priori estimate of 20 degrees of freedom among these measures) applied to 588 CNN articles belonging in 12 classes such as Business, Sport, and World. We postulate that at least some sets of these measures must be effective for classification. The goal is to use a set of TF*IDF measures that best match the a priori classifications by CNN. We also show that by combining the results of a few wellperforming TF*IDF measures can increase classification results.

Subject Areas :
Views 11
Downloads 3
 articleview.views 11
 articleview.downloads 3
  Cite this article 

A. Marie Vans, Steven J. Simske, "Identifying top performing TF*IDF classifiers using the CNN corpusin Proc. IS&T Archiving 2017,  2017,  pp 105 - 115,

 Copy citation
  Copyright statement 
Copyright © Society for Imaging Science and Technology 2017
Archiving Conference
Society for Imaging Science and Technology