30 September 2024 @ 2:00 pm

Solaris

Solaris: exploring musicking with AI through practice and code.

In this performance-lecture, Craig Vear will demonstrate and explain his practice-based research project Solaris. This Digital Score (Vear 2019) is a jazz quartet created from 3 creative-AI agents (piano, bass and TR909 drum machine) and a single human musician (drum kit). It uses abstract visual notation and the behaviours of creative AI to stimulate relationships inside music that are used to communicate musical ideas to the human. The creative-AI is built using an approach called Embodied Intelligence (Vear 2022) and exemplifies the application of the Human-AI Musicking Framework (Vear et al 2023). Solaris uses Creative AI datasets and algorithms to make music from inside the flow (Vear et al 2024). Embodied Intelligence differs from other music-AI approaches insofar that it is not using AI to construct the physical phenomena of music (sound wave), nor the meta-workings of music composition (sequencing of notes). Instead, the AI is powering the realtime generation of core impetus from within the dynamic flow of live music-making (Poltronieri & Vear 2024, Small 1998). Overall, this AI digital score has been designed to make humans more creative.

https://solarisjazz.bandcamp.com/album/tree-mountains-live-demo

Biographies

Craig Vear is Professor of Music and Computer Science at the University of Nottingham split between music and the mixed reality lab. His research is naturally hybrid as he draws together the fields of music, digital performance, creative technologies, Artificial Intelligence, creativity, gaming, mixed reality and robotics. He has been engaged in practice-based research with emerging technologies for nearly three decades, and was editor for The Routledge International Handbook of Practice-Based Research, published in 2022. His recent monograph The Digital Score: creativity, musicianship and innovation, was published by Routledge in 2019, and he is Series Editor of Springer’sCultural Computing Series. In 2021 he was awarded a €2Million ERC Consolidator Grant to continue to develop his Digital Score research https://digiscore.github.io/
Fabrizio Poltronieri is a computer artist, mathematician, researcher, and programmer, renowned for his contributions to the field of creative computing. He has been recognized with numerous prestigious awards and accolades for his creative endeavors involving computers. Two of his AI artworks, “Dionysus” and “Calliope”, have found their place in the esteemed collection of the Victoria and Albert Museum (V&A) in London, UK. In addition to his artistic pursuits, Fabrizio Poltronieri currently dedicates his efforts to pioneering research in harnessing the collaborative and creative potential of AI across various domains, including music, education, healthcare, and visual arts. His innovative explorations aim to unlock novel ways of integrating AI into these fields, fostering groundbreaking advancements and pushing the boundaries of creative expression. He is also the co-editor of the books The Language of Creative AI and Explorations in Art and Technology.

References

Poltronieri, F., Vear, C., (2024) Towards sentience: A path through jazz, datasets and digital scores. In Proceedings of International Symposium of Electronic Arts 2024, Brisbane, Australia.
Small, C. 1998. Musicking: The Meanings of Performing and Listening. Middletown: Wesleyan University Press
Vear, C. (2024). Jess+: AI and robotics with inclusive music-making. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24). Honolulu, HI, USA. doi: 10.1145/3613904.3642548
Vear, C.; Poltronieri, F.; DiDonato, B.; Zhang, Y.; Benerradi, J.; Hutchinson, S.; Turowski, P.; Shell, J.; and Malekmohamadi, H. 2024. Building an Embodied Musicking Dataset for co-creative music-making: 13th International Conference, EvoMUSART 2024, Held as Part of
EvoStar 2024, Wales, April 2–4, 2024, Proceedings, volume 13999. Springer Nature.
Vear, C., Benford, S., Avila, J. M., & Moroz, S. (2023). Human-AI Musicking: A Framework for Designing AI for Music Co-creativity. AIMC 2023. Retrieved from https://aimc2023.pubpub.org/pub/zd46ltn3 Vear, C. 2021. Creative ai and musicking robots. Frontiers in Robotics and AI 8:631752.
Vear, C. 2022. Embodied ai and musicking robotics. In The Language of Creative AI: Practices, Aesthetics and Structures. Springer. 113–135.
Vear, C. (2019). The Digital Score. London: Routledge.