[3F1-GS-10] AI application: Language model

[3F1-GS-10-04] Improving the Strength of Counter-Arguments by the Premise-Generation-Step with LLM

〇Taisei Ozaki¹, Chihiro Nakagawa^1,5, Shoichi Naito^2,3, Naoya Inoue^4,5, Kenshi Yamaguchi³, Shotaro Amano¹, Atsuhiko Shintani¹ (1. Osaka Metropolitan University, 2. RICOH COMPANY,LTD., 3. Tohoku University, 4. Japan Advanced Institute of Science and Technology, 5. Institute of Physical and Chemical Research)

Keywords:Large Language Model, Premise generation, Academic debate

This study proposes a framework for generating counter-arguments in debates using large language models (LLMs), consisting of two steps: the generation of five premises supporting an affirmative claim, and the generation of attacking premises to effectively weaken the opponent's argument. We applied this framework to LLMs, using topics and affirmative arguments collected from past middle and high school English debate competitions. The counter-arguments generated with and without the application of this framework were then evaluated by student judges. The results showed that counter-arguments produced through the two-step process clearly articulated attacking premises and demonstrated a certain level of effectiveness. This study reports on the potential of LLMs to generate high-quality counter-arguments and aims to contribute to their practical use in educational applications.