JSAI2024

Presentation information

Poster Session

Poster session » Poster session

[4Xin2] Poster session 2

Fri. May 31, 2024 12:00 PM - 1:40 PM Room X (Event hall 1)

[4Xin2-104] Ensemble Transfer Learning for Multilingual Learning via BrainLM: A Multi-modal Model

〇Ying Luo1, Ichiro Kobayashi1 (1.Ochanomizu University)

Keywords:BrainLM, Transfer Learning, Multilingual Learning

Recently, a multi-modal model: BrainLM was introduced, which shows excellent efficacy in text-brain encoding and decoding tasks. Expanding upon this groundwork, this study extended the applicability of BrainLM into a novel dataset and unexplored language systems. By employing transfer learning techniques, this study sought to extend the model's potential in multilingual learning tasks and improve its generalization capabilities. Notably, during the fine-tuning process of the binary classification task, BrainLM achieved the highest accuracy of 51.75%. this study obtained an improvement in correlation coefficients of about 3%-15% by comparing the model before and after performing transfer learning for the brain prediction task. Furthermore, BrainLM demonstrated the highest correlation in the brain prediction task under the whole cerebral cortex compared to other models. This study not only broadens the application scope of BrainLM but also sheds light on the intricate interactions between brain functional regions and large language models across diverse linguistic environments.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.

Password