Classification and analysis of literary works based on distribution weighted term frequency-inverse document frequency

作者：Wei Dai · 发表于：Journal of Physics Conference Series · 年份：2021 · DOI：10.1088/1742-6596/1941/1/012018 · 被引用次数：3 · 研究领域：Text and Document Classification Technologies

Abstract Term Frequency-Inverse Document Frequency (TF-IDF) is a commonly used data mining weighting technology for information retrieval. It can evaluate the importance of a word to a text and is widely used in Internet search engines. In order to improve the text analysis ability of different text types, a variety of weighting algorithms of TF-IDF have been developed. For the word analysis of literary works of various genres, this paper adopts Distribution Weighted Term Frequency-Inverse Document Frequency (TF-IDF-DW), which takes the distribution of feature items within and between classes into account, and can get better screening results. In the text classification part, via the comprehensive weight value obtained by TF-IDF-DW, and the classification results are obtained by class center vector algorithm and Bayesian algorithm. Finally, the classification performance of TF-IDF-DW algorithm is evaluated by comparison with the traditional TF-IDF method.