JSAI2022

Presentation information

Organized Session

Organized Session » OS-19

[2M6-OS-19d] 世界モデルと知能(4/4)

Wed. Jun 15, 2022 5:20 PM - 6:40 PM Room M (Room B-2)

オーガナイザ:鈴木 雅大(東京大学)、岩澤 有祐(東京大学)[現地]、河野 慎(東京大学)、熊谷 亘(東京大学)、森 友亮(スクウェア・エニックス)、松尾 豊(東京大学)

View presentations(録画データは2M6-OS-19cから連続しています)

6:00 PM - 6:20 PM

[2M6-OS-19d-03] Unlabelled Test sets Evaluation with Differentiable Automatic Data Augmentation

〇Makoto Kawano1, Shintaro Tomie2, Yutaka Matsuo1 (1. The University of Tokyo, 2. Kyoto University)

Keywords:Unlabelled Test Evaluation , Data Augmentation, Deep Learning

Application research of deep learning and the development of open data sets are in progress. Annotation to thecollected data is required for accuracy evaluation in the real world, but when operation under various conditions isassumed, the collected data becomes enormous and the problem of annotation arises. Therefore, in this study, wework on unlabeled test evaluation using labeled training data. By using a model (predictor) that can predict the accuracy of a given data set of a trained model (classifier), it is possible to predict the accuracy of an unlabeled testset. In order to train the predictor, prepare a dataset (meta-set) converted from the labeled training data. Since the meta-set is labeled with the original dataset, it can be formulated as a regression problem of accuracy by the trained classifier. At this time, the method of creating the meta-set, which is the learning data, is important. In this study, we propose a method to calculate the required meta-set statistic from the test set statistic and create the desired meta-set using differentiable data expansion. In this study, we performed experiments using benchmark datasets such as MNIST and SVHN and reported the results.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password