Presentation information

International Session

International Session » ES-2 Machine learning

[2S5-IS-2c] Machine learning

Wed. Jun 15, 2022 3:20 PM - 5:00 PM Room S (Online S)

Chair: Jun Sakuma (University of Tsukuba)

4:00 PM - 4:20 PM

[2S5-IS-2c-03] Constraints-based explanation by visual feature learning

〇Jingbo Yan1,2, Seiji Yamada2,1,3 (1. The Graduate University for Advanced Studies, 2. National Institute of Informatics, 3. Tokyo Institute of Technology)


Keywords:XAI, Semi-Supervised Learning, representation learning

The paper develops a semi-supervised algorithm with user feedback for feature level explanation generation. Letting human to label data usually will improve learning accuracy. At the same time, if we presume user feedback as background knowledge, there also exists potential to enhance a model's interpretability. However, the acquisition of labeled data often requires a skilled expert. In this paper, we convert the features extracted by deep learning into natural images for human understanding. Then we design a user interface where users can drag and drop image segments on the clustering result. We also propose a method to improve constraints for better clustering. In our experiments, two classes from the large-scale dataset, we explore the benefit of our semi-supervised approach over the image features given by CNN models. This semi-supervised approach not only improves classification accuracy but also helps downstream applications generate explanation.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.