Presentation information

Organized Session

Organized Session » OS-18

[2D4-OS-18a] OS-18 (1)

Wed. Jun 10, 2020 1:50 PM - 3:30 PM Room D (jsai2020online-4)

岩澤 有祐(東京大学)、鈴木 雅大(東京大学)、山川 宏(東京大学/全脳アーキテクチャ・イニシアティブ)、松尾 豊(東京大学)

1:50 PM - 2:10 PM

[2D4-OS-18a-01] Conditional image inpainting based on auxiliary information using the energy function of deep generative models

〇Masahiro Suzuki1, Yutaka Matsuo1 (1. The University of Tokyo)

Keywords:deep generative models, image inpainting

In this study, we consider the task of "conditional image inpainting", which aims to restore collapsed images by using the corresponding auxiliary information (e.g., label information). Normally, image inpainting assumes that the process of generating missing or collapsed images is known in advance. In contrast, we consider them unknown and consider inpainting them based on the auxiliary information provided instead. To tackle this task, we first train a conditional model of images given labels based on VAEs. We then estimate an energy function by considering this learned model as a prior. We propose to update images iteratively to minimize this energy function in order to perform conditional image inpainting. Experimental results show that restoration by conditional VAE reconstruction does not consider given labels and that the proposed method can perform conditional image inpainting considering them.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.