11.09 Brain-To-Sound Computer Interfaces: Neurofeedback of Music for Entrainment, Interaction and Neurorehabilitation (INTERACT)
In cognitive neuroscience, sound sequences are used as abstracted models for temporal and sensorimotor processing in individuals and multi-agent interactions. In particular, use of musical stimuli permits the study of perception-action coupling as well as joint action and entrainment via reciprocal prediction and adaptation. In engineering, Brain-Computer Interfaces (BCI) and Neurofeedback applications have been developed for providing patients with alternative pathways of communication and interaction, as well as innovative neuro-rehabilitation treatment protocols. Bridging these two fields, the goal of this project is the interdisciplinary development of a Brain-Computer Interface platform that allows human subjects to interact directly and continuously with synthesized sound and music stimuli. Sound synthesis will be informed by contemporary understanding of the roles of certain parameters (e.g. rhythm, harmonics, and timbre) in entrainment. As such, this platform will allow studying the human brain in closed loop, e.g. the underlying neural dynamics of specific aspects of entrainment, such as temporal prediction and anticipation, synchronization and adaptation. Aside from the technical aspect of developing this BCI, an important part of this project will be its validation with respect to the above hypotheses in a series of studies. Potential contributions of this project are expected to be in human-machine interaction as well as neurorehabilitation.
Ehrlich, S., Guan, C., & Cheng, G. (2017, December). A closed-loop Brain-Computer Music Interface for continuous affective interaction. In 2017 International Conference on Orange Technologies (ICOT) (pp. 176-179). IEEE.
Ehrlich, S. K., Agres, K. R., Guan, C., & Cheng, G. (2019, March). A closed-loop, music-based brain-computer interface for emotion mediation. PLoS ONE 14(3): e0213516.