JSAI2020

Presentation information

General Session

General Session » J-3 Data mining

[2P5-GS-3] Data mining: Fundamental theory

Wed. Jun 10, 2020 3:50 PM - 5:30 PM Room P (jsai2020online-16)

座長:笹井健行(トヨタ自動車/統計数理研究所)

3:50 PM - 4:10 PM

[2P5-GS-3-01] Visualization for Multimodal Relational Data using t-Stochastic Graph and Neighbor Graph Joint Embedding

〇Morihiro Mizutani1, Akifumi Okuno2, Kazuki Fukui1,2, Geewook Kim1,2, Hidetoshi Shimodaira1,2 (1. Kyoto University, 2. RIKEN Center for Advanced Intelligence Project)

Keywords:multimodal data, visualization, manifold learning, dimensionality reduction, stochastic neighbor embedding

Multimodal relational data analysis has become of increasing importance in recent years, for exploring across different domains of data, such as text and images obtained from Flickr or Instagram. A variety of methods have been developed for visualization; to give an example, t-Stochastic Neighbor Embedding (t-SNE) computes low-dimensional feature vectors so that their similarities keep those of the observed data vectors. However, t-SNE is designed only for a single domain of data but not multimodal relational data; this paper aims at visualizing multimodal relational data, whose associations across domains and data vectors in some domains are observed. Our proposed method (1) first computes augmented associations for the multimodal relational data, where the associations across domains are observed and those within domain are computed via the observed data vectors, and (2) jointly embeds the multimodal relational data to a common low-dimensional subspace. Through Flickr dataset visualization, we demonstrate the promising performance of the proposed method.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password