並列タイトル等Synthetic audio-tactile stimuli generation based on human multi-modal perception
一般注記In this document we propose a novel multi-modal listening environment to enrich the music listening though the use of a redundant haptic and visual stimuli. The environment, which we called the Haptic Music Player, uses music score to create a visual animation and a synthetic haptic vibration that resembles the sound of one instrument in the song. To develop the synthetic haptic vibration several psychophysical experiments were performed, where the similarity perception between an audio and haptic signal was evaluated. Also the impact of a redundant audio-tactile and visual stimuli was evaluated. The experiment’s results demonstrate that the attack synchrony and resemblance of the envelope shapes, between the audio and haptic signals, are important to be similarly perceived. Also we found that the selective listening of the users improves when using a audio-tactile-visual stimuli. All these findings were applied on the implementation of the Haptic Music Player. Therefore, though the Haptic Music Player the user is able to easily identify and follow any instrument in a song. Also, this environment helps the user to understand the melody, structure, and the role of each instrument in a song and consequently the user could have a deeper understanding of music.
identifier:oai:t2r2.star.titech.ac.jp:50461799
コレクション（個別）国立国会図書館デジタルコレクション > デジタル化資料 > 博士論文
受理日（W3CDTF）2021-05-16T23:51:55+09:00
連携機関・データベース国立国会図書館 : 国立国会図書館デジタルコレクション