[4Xin2] Poster session 2

[4Xin2-92] Template Following of Generative Counterarguments for Large Language Models

〇Shotaro Amano¹, Chihiro Nakagawa^2,1,3, Shoichi Naito^3,4,5, Naoya Inoue^6,3, Kenshi Yamaguchi⁵, Taisei Ozaki², Atsuhiko Shintani^1,2 (1.Osaka Prefecture University, 2.Osaka Metropolitan University, 3.RIKEN, 4.Ricoh Co., Ltd., 5.TOHOKU UNIVERSITY, 6.Japan Advanced Institute of Science and Technology)

Keywords:LLM

While debate-based education is effective in developing critical thinking skills, it is prohibitively costly for teachers to provide examples of counter-arguments from various perspectives.
To assist in the feedback process, we explore the controllability of logical structures in generating counter-arguments.
Specifically, we develop ten counter-argument templates and use them as an instruction for large language models to guide the structure of the generated counter-arguments.
Our manual evaluation of 20 arguments shows that, despite the approach's simplicity, the generated counter-arguments generally adhere to the provided templates. However, it also reveals that the counter-arguments generated from templates with complex logical structures tend to lack self-consistency.