1:00 PM - 1:20 PM
[4H2-OS-6a-04] Cross-Situational Word Learning through Attribute Discovery via Disentanglement
Keywords:Symbol Emergence in Robotics, Disentanglement, Cross-Situaltional Learning
This paper presents a computational model that mimics human word learning through cross-situational learning. Humans acquire word meanings by forming categories based on observed information about attributes like color and shape. The proposed model learns to understand attributes in images and establishes the relationship between attribute categories and words. To achieve this, we combine CSL-PGM, which facilitates cross-situation learning, with β-VAE, which enables unsupervised disentanglement of attributes. In our experiments, we trained the model on a dataset comprising images with five attributes and word sequences. Our model achieved a remarkable attribute comprehension rate of 99.9% for each word. In addition, the model outperformed existing multimodal generative models, achieving an 87.0% correct response rate for inferring images from word sequences.
Authentication for paper PDF access
A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.