[4Xin2] Poster session 2

[4Xin2-36] On the Quantitative Evaluation of Academic Papers and their Effective Utilization

〇Miki Ota¹, Yusuke Akimoto¹, Hisashi Okui¹ (1.ARISE analytics)

Keywords:Information retrieval, Metrics, Survey, Academic writing

Research metrics play an important role in succinctly evaluating the academic contributions of scientific researchers. On the other hand, given the vast volume of daily publications, these metrics also serve as benchmarks, guiding researchers in identifying relevant papers within specific topics. Although widely used, the adequacy of citation-based metrics, such as the h-index, in accurately representing a paper's quality is questionable. In this work, we investigate existing research metrics by assessing their effectiveness in reflecting the quality and impact of academic papers, focusing on practical contexts such as research surveys. We find that in some cases the existing citation metrics are not adequate, thereby motivating us in developing a novel research metric. The proposed metrics is not solely based on citations count, but involves content-based evaluation as well, thus offering a more holistic assessment of an academic paper's quality.