2:20 PM - 2:40 PM
[1I2-GS-4a-04] Pairwise Comparisons with Sequential Biases
Keywords:pairwise comparison, cognitive bias, preference estimation
Pairwise comparisons have been widely used to estimate people's preferences. However, the preferences expressed by pairwise comparisons are not always accurate. Human evaluations are known to be distorted by cognitive biases. In the case of pairwise comparisons, the order in which the pairwise comparisons are conducted may have some effects on choice. We first confirmed the influence of the order of evaluation in pairwise comparisons by conducting a preliminary experiment. Based on the results, we propose a model that explicitly considers the effect of the order of evaluation to reduce its effect and to estimate the true preference. We applied the proposed method to the data collected via a crowdsourcing service and confirmed that the proposed model achieves better prediction accuracy scores than the baselines, especially when the number of items is large and the number of training samples is small.
Authentication for paper PDF access
A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.