A self-supervised seed-driven approach to topic modelling and clustering

作者：Federico Ravenda, Seyed Ali Bahrainian, Andrea Raballo, Antonietta Mira, Fábio Crestani · 发表于：Journal of Intelligent Information Systems · 年份：2024 · DOI：10.1007/s10844-024-00891-8 · 被引用次数：8 · 研究领域：Topic Modeling、Advanced Text Analysis Techniques、Text and Document Classification Technologies

Abstract Topic models are useful tools for extracting the most salient themes within a collection of documents, grouping them to construct clusters representative of each specific topic. These clusters summarize and represent the semantic contents of the documents for better document interpretation. In this work, we present a light approach able to learn topic representations in a Self-Supervised fashion. More specifically, we propose a lightweight and scalable architecture using a seed-word driven approach to simultaneously co-learn a representation from a document and its corresponding word embeddings. The results obtained on a variety of datasets of different sizes and natures show that our model is capable of extracting meaningful topics. Furthermore, our experiments on five benchmark datasets illustrate that our model outperforms both traditional and neural topic modelling baseline models in terms of different coherence and clustering accuracy measures.