[3G1-GS-11] AI and Society:

[3G1-GS-11-03] Report on the Possibilities and Challenges Discovered from the Use of Artificial Intelligence Technology in Cultural and Artistic Activities by People with Disabilities (2)

From the practice of a music production workshop using the tone generation AI tool "Neutone"

〇Shigeru Kobayashi¹, Nao Tokui^2,3, Daisuke Kobayashi⁴, Takuya Ooi⁴, Taro Okabe⁴, Miki Goan⁴, Shizuka Morishita⁴ (1. Institute of Advanced Media Arts and Sciences, 2. Qosmo, Inc., 3. Neutone, Inc., 4. Tanpopo-No-Ye Foundation)

Keywords:people with disabilities, cultural and artistic activities, well-being, generative AI

We aim to report the potential and challenges that have been found from the continuous project using AI technologies in cultural and artistic activities for people with disabilities. In the 2020s, generative AI technology capable of producing text and images has rapidly developed, allowing for the easy creation of "works" by simply providing prompts. However, in one-way operations where machines generate outputs all at once following human instructions, it is difficult for humans to find meaning, such as joy in the creation process. In contrast, music production using music editing software encourages repeated interactions between humans and a machine geared towards the end goal of creating a piece. Focusing on this, we held two workshops where participants generated materials using AI from sounds collected on-site and created pieces using these materials. The sound generation AI "Neutone" used in these workshops is an audio plugin capable of tone conversion and sound source separation through algorithms such as RAVE and DDSP. 33 participants, including those with and without disabilities, engaged in music production regardless of prior experience and endeavored until the completion of their piece. We discovered various possibilities, such as reinterpreting the sounds that play in care facilities and finding new meanings.