Improvement of easy-to-understand exhibit technology by explaining audiovisual data to persons with cognitive dysfunction by applying the multimedia DAISY

2015 Fiscal Year Final Research Report

• Project/Area Number: 25350404
• Research Category: Grant-in-Aid for Scientific Research (C)
• Allocation Type: Multi-year Fund
• Section: 一般
• Research Field: Cultural assets study and museology
• Research Institution: University of Hyogo
• Principal Investigator: MITANI Masazumi 兵庫県立大学, 自然・環境科学研究所, 准教授 (20202343)
• Project Period (FY): 2013-04-01 – 2016-03-31
• Keywords: 生涯学習施設 / 博物館 / 美術館 / 情報アクセシビリティ / コミュニケーション障害 / 高次脳機能障害 / 失語症 / 聴覚認知

Outline of Final Research Achievements

I tried to improve to exhibit displays by explaining the data in order to ensure that the information is accessible to persons with cognitive dysfunction (referred to as "Disabilities"). The majority of persons easily understand the sentences through the multimedia DAISY. In order to confirm whether Disabilities are able to easily understand this technology, I conducted an audiovisual experiment using real voices emitted by humans, formant synthesis speech, and concatenative synthesis speech to examine their ability. As a result, (1) non-Disabilities had difficulty understanding the formant synthesis speech without visual information. (2) Some Disabilities were able to understand whether real voices or a different kind of synthesized speech, and other Disabilities could not understand at all. (3) Human voice is the easiest to understand for Disabilities, but if synthesized technique is needed, concatenative synthesis speech is better than formant synthesis speech.

Free Research Field

人間行動進化学、霊長類学、コミュニケーション障がい学