scieee Science in your language
[en] (orig)

Innermost Echoes

Author: Hynds, Danny; Uyama, Aoi; Chernyshov, George; Zheng, DingDing; Matsumoto, Kozue; Pogorzhelskiy, Michael; Saito, Tatsuya; Kunze, Kai; Minamizawa, Kouta
Publisher: Zenodo
DOI: 10.5281/zenodo.17552925
Source: https://zenodo.org/records/17552925/files/nime2023_music_1340.pdf
Inne mos Echoes
DANNY HYNDS, Keio Uni e si y G adua e School o Media Design
AOI UYAMA, Keio Uni e si y G adua e School o Media Design
GEORGE CHERNYSHOV, Keio Uni e si y G adua e School o Media Design
LADY DINGDING ZHENG, Keio Uni e si y G adua e School o Media Design
MICHAEL POGORZHELSKIY, Keio Uni e si y G adua e School o Media Design
TATSUYA SAITO, Keio Uni e si y G adua e School o Media Design
KAI KUNZE, Keio Uni e si y G adua e School o Media Design
KOUTA MINAMIZAWA, Keio Uni e si y G adua e School o Media Design
Addi ional Key Wo ds and Ph ases: li e pe o mance, physiological sensing, imp o isa ion, obo ic ins umen , human compu e
in e ace
ACM Re e ence Fo ma :
Fig. 1. Pe o me s and he obo ic ko o om he i s public pe o mance a ANB Tokyo.
1 PROGRAM NOTES
Inne mos Echoes is a pe o mance wo k which u ilizes pe o me physiological da a as a no el inpu mechanism o
in oduce a new o m o hyb id imp o isa ion alongside a obo ic ko o which soni ies his da a in a communica i e
eedback loop and a Eu o ack sys em which will se e as a b idge be ween he passi e physiological da a and he ac i e
pe o mance. By in oducing his o m o inpu , ou imp o isa ional pe o mance challenges he adi ional app oach
o li e pe o mance by c ea ing a closed loop be ween ou emo ions and he pe o mance i sel . In a sense, we a e
Licensed unde a C ea i e Commons A ibu ion 4.0 In e na ional License (CC BY 4.0). Copy igh emains wi h he au ho (s).
Danny Hynds, Aoi Uyama, Geo ge Che nysho , Lady DingDing Zheng, Michael Pogo zhelskiy, Ta suya Sai o, Kai Kunze, and Kou a
Minamizawa. 2023. Inne mos Echoes. 1, 1 (May 2023), 3 pages.
Music P oceedings o he In e na ional Con e ence on New In e aces o Musical Exp ession
NIME’23, May 31-June 2, 2023, Mexico Ci y, Mexico
2 Anonymous
imp o ising wi h ou own p esence and pe cep ion. We belie e his new kind o pe o ma i e dialogue can challenge
exis ing hie a chies wi hin li e music pe o mances.
2 PROJECT DESCRIPTION
Inne mos Echoes is an imp o isa ional pe o mance wo k o ko o, Eu o ack syn hesize s, and a obo ic ko o. I seeks o
examine he ela ionship be ween pe o me s and hei own p esence h ough he u iliza ion o eal ime physiological
da a and challenge cu en hie a chies in music pe o mance. We wish o de elop new pe o ma i e dialogues and
ideas on wha i means o pe o m li e. Cu en pe o mance p ac ices a e o en based p edominan ly on he di ec
communica ion o he pe o me s h ough hei espec i e ins umen s, whe e one oice is no always in con ol
[
1
]. When we in oduce he pe o me ’s physiology as a ges u al language, we aim o de ine a new me hodology o
p esence-based imp o isa ion.
Fig. 2. Pe o mance Diag am Indica ing Flow o Da a and Pe o mance Ges u es
The pe o me s wea cus om buil sensing w is bands and elas ic b ea hing bands a ound hei ches o ga he
physiological da a consis ing o EDA (elec ode mal ac i i y), HRV (hea a e a iabili y), and espi a ion a e. This
da a is hen sen ia OSC o a lap op unning Max/MSP which applies his li e da a o he obo ic ko o and he Eu o ack
sys em. These da a s eams and occu ences o synch ony be ween he pe o me s’ da a a e hen soni ied and used as
an indica o o he cu en s a e o he pe o me s, he eby o ming a new unspoken dialogue be ween he wo.
In designing he obo ic ko o, we leaned hea ily on an an ique and ecycled aes he ic. The ko o i sel was pu chased
o almos no cos a a second-hand shop. Al hough he e a e se e al "impe ec ions" such as c acks along he bo om
side, we ound his o gi e i an in e es ing sonic and isual iden i y. Up-cycling his old ins umen was one o he
ea ly inspi a ions o he design aes he ic. We ca ied his design app oach o e in o he es o he design, such as
u ilizing much o he elec onics and cabling om p e ious p ojec s and junk sec ions o secondhand s o es. While his
Inne mos Echoes 3
was no ou ini ial plan o his p ojec , i quickly became a la ge pa o ou design app oach o u ilize as much as we
could wi h wha we could sa e om being disca ded and o go en.
Fig. 3. Image o he Con ol Boa d
3 MEDIA LINKS
•Video: h ps://you u.be/OI6VO-ZUeoY
•Audio: h ps://soundcloud.com/anonymous-nime
ACKNOWLEDGMENTS
The au ho s would like o hank ANB Tokyo o p o iding us a space o p esen ou i s pe o mance.
This wo k was suppo ed by JST Moonsho R&D P og am “Cybe ne ic being” P ojec (G an numbe JPMJMS2013).
REFERENCES
[1] B uce Ellis Benson. 2003. The imp o isa ion o musical dialogue: A phenomenology o music. Camb idge Uni e si y P ess.