[1I2-GS-4a] Webインテリジェンス：モデル化

[1I2-GS-4a-04] Pairwise Comparisons with Sequential Biases

〇Shintaro Kurimoto¹, Kouta Nakayama^1,2, Tomoya Fujita¹, Yukino Baba¹ (1. University of Tsukuba, 2. RIKEN)

Keywords:pairwise comparison, cognitive bias, preference estimation

Pairwise comparisons have been widely used to estimate people's preferences. However, the preferences expressed by pairwise comparisons are not always accurate. Human evaluations are known to be distorted by cognitive biases. In the case of pairwise comparisons, the order in which the pairwise comparisons are conducted may have some effects on choice. We first confirmed the influence of the order of evaluation in pairwise comparisons by conducting a preliminary experiment. Based on the results, we propose a model that explicitly considers the effect of the order of evaluation to reduce its effect and to estimate the true preference. We applied the proposed method to the data collected via a crowdsourcing service and confirmed that the proposed model achieves better prediction accuracy scores than the baselines, especially when the number of items is large and the number of training samples is small.