Study on construction of sign language morphological dictionary by 3D animation and its application to sign language engineering

2016 Fiscal Year Final Research Report

• Project/Area Number: 26244021
• Research Category: Grant-in-Aid for Scientific Research (A)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Linguistics
• Research Institution: Kogakuin University
• Principal Investigator: NAGASHIMA YUJI 工学院大学, 情報学部(情報工学部), 教授 (50138137)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Keywords: 手話 / 形態素解析 / 形態素辞書 / 福祉工学

Outline of Final Research Achievements

In this research, we constructed a medical sign language morphological dictionary that enables users to view 3D animated images of sign language motions. The data of the 3D sign language motions were obtained using optical motion capture technology. The data of the 3D motions are in BVH format. The words contained in the dictionary are described using the NVSG element model that is suggested by the authors. Because the notation results are stored in SQLite format, it is possible to construct a morpheme dictionary database. Accordingly, the dictionary permits searches of sign language motions with unknown meanings by hand shape, motion, and other elements.
In solving common subjects, we developed the system which supported the analysis and notation of a phoneme level of the sign language by using 3D motion data in BVH format. Furthermore, we developed a 3D viewer that renders animated images of sign language in real time by reading the BVH data.

Free Research Field

手話工学