JSAI2024

Presentation information

General Session

General Session » GS-11 AI and Society

[2G1-GS-11] AI and Society:

Wed. May 29, 2024 9:00 AM - 10:40 AM Room G (Room 22+23)

座長:髙橋 翼(LINEヤフー/SB Intuitions)

9:20 AM - 9:40 AM

[2G1-GS-11-02] Proposal and evaluation experiment of Fine-Tuning method using copywriter's thinking process

○Daisuke Niino1, Yasuharu Sasaki1, Susumu Namikawa1, Dai Hirose1, Yosuke Yamagami1, Takuma Kawada1, Kazuya Kishimoto1, Kobori Tomoki1, Nao Arai1, Hiroki Kita1, Shinya Shiragami2, Masahiro Fukuda2, Takuya Ito2, Yoshia Abe3, Yoshimasa Tsuruoka3, Hitoshi Matsubara3 (1. DENTSU INC., 2. Dentsu Digital Inc., 3. AI Center, The Univ. of Tokyo)

Keywords:Large language Models, Fine-Tuning, Process of Thinking, Creative Task, Computer Supported Cooperative Work

When an LLM is used in creative tasks, satisfactory output is not always obtained due to a lack of expert knowledge. Therefore, we examine how fine-tuning with a copywriter’s thought process as the training data would change the quality of the output by comparing it with the output of an LLM without fine-tuning. Our experimental results show that the fine-tuned LLMs achieve a 5% higher overall rating, and the sub-item ratings of “period” and “charming” increase by 24% and 13%, respectively.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password