Open AccessA Sound-Image Coding Method Inspired by an Acousto-Optic Electronic Piano
Author(s) -
Qi Liu,
Shaocheng Qu
Publication year - 2020
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/1631/1/012037
Subject(s) - timbre , computer science , loudness , piano , coding (social sciences) , visualization , matlab , bridge (graph theory) , software , sound design , sound (geography) , speech recognition , computer vision , artificial intelligence , acoustics , musical , art , mathematics , visual arts , medicine , statistics , physics , programming language , operating system
This paper firstly brings up a point that there seems to be a lack of a direct mapping bridge method for interconversion between sound and image, because many methods invented for scientific research on sound visualization are based on the sound characteristics of pitch, duration, loudness and timbre. Secondly, it designs an acousto-optic electronic piano which can possess both sound and color effects with the application of music visualization, and presents a sound-image coding method inspired by the previous design which can transform music note to picture pixel. Thirdly, it manages to transform a simple piece of music called “I am a painting master” into a corresponding picture with the mapping bridge method using Matlab software. More coding bits of the method should be added for complex music. The sound-image coding method exhibits a mapping bridge role for sound-image interactive design, which may help to find essential relationship between music and picture in mentality.