Jump to ContentJump to Main Navigation
Language, Music, and the BrainA Mysterious Relationship$
Users without a subscription are not able to see the full content.

Michael A. Arbib

Print publication date: 2013

Print ISBN-13: 9780262018104

Published to MIT Press Scholarship Online: May 2015

DOI: 10.7551/mitpress/9780262018104.001.0001

Show Summary Details
Page of

PRINTED FROM MIT PRESS SCHOLARSHIP ONLINE (www.mitpress.universitypressscholarship.com). (c) Copyright The MIT Press, 2022. All Rights Reserved. An individual user may print out a PDF of a single chapter of a monograph in MITSO for personal use.date: 02 July 2022

Computational Modeling of Mind and Music

Computational Modeling of Mind and Music

(p.393) 16 Computational Modeling of Mind and Music
Language, Music, and the Brain

Paul F. M. J. Verschure

Jônatas Manzolli

The MIT Press

Music can be defined as organized sound material in time. This chapter explores the links between the development of ideas about music and those driven by the concept of the embodied mind. Music composition has evolved from symbolic notated pitches to converge onto the expression of sound filigrees driven by new techniques of instrumental practice and composition associated with the development of new interfaces for musical expression. The notion of the organization of sound material in time adds new dimensions to musical information and its symbolic representations. To illustrate our point of view, a number of music systems are presented that have been realized as exhibitions and performances. We consided these synthetic music compositions as experiments in situated aesthetics. These examples follow the philosophy that a theory of mind, including one of creativity and aesthetics, will be critically dependent on its realization as a real-world artifact because only in this way can such a theory of an open and interactive system as the mind be fully validated. Examples considered include RoBoser, a real-world composition system that was developed in the context of a theory of mind and brain called distributed adaptive control (DAC), and “ADA: intelligent space,” where the process of music expression was transported from a robot arena to a large-scale interactive space that established communication with its visitors through multi-modal composition. Subsequently, re(per)curso, a mixed reality hybrid human–machine performance, is analyzed for ways of integrating the development of music and narrative. Finally, the chapter concludes with an examination of how multimodal control structures driven by brain–computer interfaces (BCI) can give rise to a brain orchestra that controls complex sound production without the use of physical interfaces. All these examples show that the production of sound material in time that is appreciated by human observers does not need to depend on the symbolically notated pitches of a single human composer but can emerge from the interaction between machines, driven by simple rules and their environment. Published in the Strungmann Forum Reports Series.

Keywords:   embodied mind, RoBoser, theory of mind, distributed adaptive control, ADA: intelligent space, re(per)curso, narrative, brain–computer interfaces

MIT Press Scholarship Online requires a subscription or purchase to access the full text of books within the service. Public users can however freely search the site and view the abstracts and keywords for each book and chapter.

Please, subscribe or login to access full text content.

If you think you should have access to this title, please contact your librarian.

To troubleshoot, please check our FAQs, and if you can't find the answer there, please contact us.