JSAI2024

Presentation information

Organized Session

Organized Session » OS-5

[2T5-OS-5b] OS-5

Wed. May 29, 2024 3:30 PM - 4:50 PM Room T (Room 62)

オーガナイザ:荒井 ひろみ(理研AIP)、小山 聡(名市大)、鹿島 久嗣(京大)、堤 瑛美子(東大)、森 純一郎(東大)

3:50 PM - 4:10 PM

[2T5-OS-5b-02] Mitigating Cognitive Biases in Large Language Models

〇Yasuaki Sumita1, Koh Takeuchi1, Hisashi Kashima1 (1. Kyoto University)

Keywords:Large Language Model, Cognitive Bias

In recent years, Large Language Models (LLMs) have been developed and have shown high performance on various tasks. This high level of performance is achieved by learning from large corpora of documents written by humans. However, since humans are subject to various cognitive biases, leading to irrational judgments, LLMs can also be influenced by these cognitive biases resulting in irrational decision-making. For example, changing the order of options in multiple-choice questions affects the performance of LLMs due to order bias. Our research aims to mitigate such cognitive biases and prompt LLMs to make rational decisions. In our proposed methods, we apply cognitive biases mitigation methods used in crowdsourcing to prompts that are input to LLMs. To test the effectiveness of our methods, we conduct experiments on GPT-3.5 and GPT-4 to evaluate the influence of six cognitive biases on the outputs before and after applying our methods. The results showed that our proposed method can mitigate the influence of cognitive biases.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password