[1P4-OS-1b] OS-1

[1P4-OS-1b-02] LLM Performance Evaluation on Japanese Data in the Human Resources Domain via Compression

〇Tetsu R Sato¹, Nanami Tsuji¹, Peng Hong¹, Masashi Ueno¹, Hiroyuki Okumura¹ (1. PERSOL CAREER, CO., LTD.)

Keywords:LLM, Compression

In data compression using LLM outputs, the relationship between LLM performance and compression performance has been studied. However, few studies have verified this relationship using Japanese data in the Human Resources Domain. In this study, we investigated the relationship between LLM performance and compression performance using Japanese data from a specific domain. As a result, we found that there is nearly a linear relationship between compression ratio and the scores obtained from multiple benchmarks.