Composing the Actual: Brainwave Sonification as Materialized Intensity of Virtual Relations
Keywords:sonified brain waves, virtual-actual dimension, open-social, affective interaction, music experiment
My recently performed experimental music performance I Sit and Worry About Her comprises a transdisciplinary research project that explores the function of large-scale cortical networks and application of EEG, monitoring the brainwaves in music making and perceiving. The project aims at understanding the activity of the brain and its electric impulses as an affect or intensity of virtual relations. There are several assemblages that relate rhizomatically in different dimensions inside an event; from minor gestures in the brain’s electric impulse continuum, its self-enjoyment and experience of sound frequencies, to the affective modality that creates authentic collective identity during the performance, thus questioning the unity of movement between subject and object. The project involves playing pre-recorded music content back to the performance space in real time, triggered by a threshold of a certain brainwave frequency; thus, it functions as a sonification of the brain’s electricity – a kind of materialization of a virtual property. Pre-recorded music is perceived in the performing space before the subject becomes a knower of the actualized potential, before she perceives her thought. Does that make me a composer of the perceiver’s actual dimension? If we apply this performance technique, is it possible to actualize the virtual open-social identity, even while involved in a social collaborative interaction?
Article received: April 30, 2020; Article accepted: May 30, 2020; Published online: October 15, 2020; Original scholarly paper
Beck, Christian and François-Xavier. “Deleuze and the event(s).” Journal for Cultural Research 20, 4 (2016): 329–33. DOI: https://doi.org/10.1080/14797585.2016.1264770
Colman, Felicity J. “Affect.” In The Deleuze Dictionary Revised Edition, edited by Adrian Parr, 11–13. Edinburgh: Edinburgh University Press, 2010.
De Assis, Paulo. Logic of Experimentation: Rethinking Music Performance through Artistic Research. Leuven: Leuven University Press, 2018. DOI: https://doi.org/10.11116/9789461662507
Deleuze, Gilles and Félix Guattari. Tisuću platoa. Translated by Marko Gregović. Zagreb: Sandorf & Mizantrop, 2013.
Filipović, Andrija. Brajan Masumi. Beograd: Orion Art, 2016.
Gray, Simon. Mindfulness for Beginners. Great Reads Publishing, 2015.
Hadjidimitriou, S. K. and L.J. Hadjileontiadis. “Toward an EEG-based recognition of music liking using time-frequency analysis.” IEEE Transactions on Biomedical Engineering 59, 12 (2012): 3498–510. DOI: https://doi.org/10.1109/TBME.2012.2217495
Holman Jones, Stacy, Tony Adams, and Carolyn Ellis. “Introduction: Coming to Know Autoethnography as More than a Method.” In Handbook of Autoethnography, edited by Stacy Holman Jones, Tony Adams, and Carolyn Ellis, 17–48. London, New York: Routledge, 2016.
“EEG (Electroencephalogram): What is an EEG.” Healthline. https://www.healthline.com/health/eeg#risks. Accessed on January 21, 2020.
Jovićević, Jasna “I Sit and Worry About Her 2019.” Jasna Jovicevic artist website. http://www.jasnajovicevic.com/music-mind. Accessed on January 15, 2020.
Jovićević, Jasna. “Flow Vertical: Composing and Improvising Original Music Inspired by Bodily Sound Vibrations.” Leonardo Music Journal 29 (December 2019): 78–82. doi: 10.1162/lmj_a_01068 DOI: https://doi.org/10.1162/lmj_a_01068
Livesey, Graham. “Assemblage.” In The Deleuze Dictionary Revised Edition, edited by Adrian Parr, 18–19. Edinburgh: Edinburgh University Press, 2010.
Manning, Erin. Minor Gesture. Durham and London: Duke University Press, 2016. DOI: https://doi.org/10.2307/j.ctv111jhg1
Massumi, Brian. Parables for the Virtual: Movement, Affect, Sensation. Durham and London: Duke University Press, 2002. DOI: https://doi.org/10.1215/9780822383574
Massumi, Brian. Semblance and Event: Activist Philosophy and Occurrent Arts. Cambridge and London: The MIT Press, 2011. DOI: https://doi.org/10.7551/mitpress/7681.001.0001
Meelberg, Vincent. Colloquium on Artistic Research in Performing Arts. CARPA3, 2014.
Millet, D. “Hans Berger: From Psychic Energy to the EEG.” Perspectives in Biology and Medicine 44, 4 (2001): 522–42. DOI: https://doi.org/10.1353/pbm.2001.0070
Miranda, Eduardo R. and A. Brouse. “Interfacing the Brain Directly with Musical Systems: On Developing Systems for Making Music with Brain Signals.” Journal Leonardo 38, 4 (2005): 331–36. DOI: https://doi.org/10.1162/0024094054762133
Nijholt, Anton. “Introduction: Brain-Computer Interfaces for Artistic Expression.” In Brain Art, Brain-Computer Interfaces for Artistic Expression, edited by Nijholt Anton. 1–32. Switzerland: Springer, 2019. DOI: https://doi.org/10.1007/978-3-030-14323-7_1
Steinweg, David A. “Improvisational Music Performance: On-Stage Communication of Power Relationships.” Graduate Theses and Dissertations, University of South Florida, 2012.
Stover, Chris. “Affect and Improvising Bodies.” Perspectives of New Music 55, 2 (2017): 5–66. DOI: https://doi.org/10.1353/pnm.2017.0007
Stover, Chris. “Musical Bodies: Corporeality, Emergent Subjectivity, and Improvisational Spaces.” Journal of Media and Culture 19, 1 (2016). DOI: https://doi.org/10.5204/mcj.1066
Suvakovic, Miodrag. Epistemologija Umetnosti. Beograd: Orion art, 2008.
“How can we measure brain activity?” Science Museum website. http://whoami.sciencemuseum.org.uk/whoami/findoutmore/yourbrain/howdoesyourbrainwork/howcanwemeasurebrainactivity. Accessed on January 23, 2020.
“What are Brainwaves?” Brainworks. https://www.brainworksneurotherapy.com/what-are-brainwaves. Accessed on January 10, 2020.
Živojinović, Bojan. “Process of research and production of music experiment I Sit and Worry About Her – Jasna Jovicevic.” www.youtu.be/iI6iGA5tj6Y. Accessed on January 15, 2020.
Živojinović, Bojan. “Performance I Sit and Worry About Her – Jasna Jovicevic.” www.youtu.be/mAww21eWKKo. Accessed on January 15, 2020.
DOI: http://dx.doi.org/10.25038/am.v0i23.395 DOI: https://doi.org/10.25038/am.v0i23.395
How to Cite
Copyright (c) 2023 AM Journal of Art and Media Studies
This work is licensed under a Creative Commons Attribution 4.0 International License.
The content on this site is licensed under a Creative Commons Attribution 4.0 International License.
AM Journal of Art and Media Studies ISSN 2217-9666 - printed, ISSN 2406-1654 - online, UDK 7.01:316.774
Publisher: Faculty of Media and Communications, Singidunum University, Belgrade, Serbia
Indexed in: ERIH PLUS, EBSCO, DOAJ, and in The List of Scientific Journals Categorization of Ministry of Education, Science and Technological Development of Republic of Serbia (M24-2021). Beginning with No. 12 2017, AM is indexed, abstracted and covered in Clarivate Analytics service ESCI.