1990 Fiscal Year Final Research Report Summary

Optimum Conditions for Simultaneous Presentation of Letter and Speech for Video Viewing/ Listening

Research Project

Project/Area Number	62580014
Research Category	Grant-in-Aid for General Scientific Research (C)
Allocation Type	Single-year Grants
Research Field	Informatics
Research Institution	Waseda University
Principal Investigator	HIKI Shizuo Waseda University, School of Human Sciences, Professor, 人間科学部, 教授 (50006227)
Project Period (FY)	1987 – 1989
Keywords	Vision / Hearing / Letter / Speech / Video / Kana / Kanji
Research Abstract	Purpose of this project was to obtain a practical guide line for superposing letter and speech in recording of video teaching materials, based on the analysis of optimum conditions for simultaneous presentation of letter and speech through audio/visual experiments with special regards to l) kind of letter to be superposed on the video picture, 2) rules of introducing Kanji to Kana sentence, 3) interaction of phonetic component, temporal synchronization and correspondence of contents between letter and speech simultaneously presented each other, and 4) characteristics of short term memory in processing letter and speech in visual and hearing sensation. 1. Recording of Letter and Speech Materials Texts of letter and speech materials for the audio/visual experiments were edited taking into account of legibility of Kana, complexity of Kanji patterns and factors involved in short term memory of Kanji. Then, the materials were recorded on video tapes using a video camera and microphone. 2. Audio/visual Experiments By playing back the recorded letter and speech materials, audio/visual experiments were conducted, and accuracy of transmission of language information was estimated through various mode of response such as writing and rehearsing. 3. Analysis of the results of the experiments The optimum conditions for simultaneous presentation of letter and speech obtained as results of analysis of the audio/visual experiments were summarized in a chart which can be practically utilized for superposition of letter and speech in video recording. The results were also arranged for demonst ration on a video tape.