Training method and mechanism of voice pitch control using tactile feedback to assist singing of deaf-blind persons

• Project/Area Number: 24501126
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Educational technology
• Research Institution: Tsukuba University of Technology
• Principal Investigator: SAKAJIRI Masatsugu 筑波技術大学, 保健科学部, 准教授 (70412963)
• Project Period (FY): 2012-04-01 – 2015-03-31
• Project Status: Completed (Fiscal Year 2014)
• Budget Amount: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000); Fiscal Year 2014: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2013: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000); Fiscal Year 2012: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
• Keywords: 触覚フィードバック / 盲ろう / 聴覚障害 / 音声ピッチ / 触覚ディスプレイ / 歌唱

Outline of Final Research Achievements

The aim of this research was establishment of training method and elucidation of the mechanism of voice pitch control using tactile feedback to assist singing of deaf-blind or hearing impaired persons. The results of the evaluation of our system, differences in accuracy of singing by the size of the melody change were not observed. It was indicated that the deafblind users regained the correspondence between pitch control and proprioceptive feedback of laryngeal muscles by the training using our system. Training method using data of the accuracy of singing as an indicator was also established.

Research Products

• [Journal Article] Tactile pitch feedback system for deafblind or hearing impaired persons -Singing accuracy of hearing persons under conditions of added noise- (2014)
  • Author(s): Sakajiri M, Miyoshi S, Onishi J, Ono T, Ifukube T
  • Journal Title: Proceedings of the 2014 IEEE Symposium on Computational Intelligence in Robotic Rehabilitation and Assistive Technologies Volume: なし Pages: 31-35
  • DOI: 10.1109/cirat.2014.7009738
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Accuracy of voice pitch control in singing using tactile voice pitch feedback display (2013)
  • Author(s): Sakajiri M
  • Journal Title: 2013 IEEE International Conference on Systems, Man, and Cybernetics Volume: CFP13SMC-USB Pages: 4201-4206
  • DOI: 10.1109/smc.2013.716
  • Peer Reviewed
• [Journal Article] 触覚フィードバックによる音声ピッチ制御～歌唱時のピッチの正確性について～ (2013)
  • Author(s): 坂尻正次
  • Journal Title: 電子情報通信学会福祉情報工学研究会技術研究報告 Volume: WIT2013-31 Pages: 41-46
• [Journal Article] Effect of voice pitch control training using a two-dimensional tactile feedback display system (2012)
  • Author(s): M.Sakajiri
  • Journal Title: 2012 IEEE International Conference on Systems, Man, and Cybernetics Volume: CFP12SMC-USB Pages: 2937-2941
  • Peer Reviewed
• [Journal Article] 触覚フィードバックによる音声ピッチ制御と固有感覚フィードバックに及ぼす影響 (2012)
  • Author(s): 坂尻正次
  • Journal Title: 電子情報通信学会技術研究報告応用音響研究会 Volume: EA-2012-48 Pages: 17-22
  • NAID: 110009626211