• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of a Dictionary System to Convert Japanese Sentences into CG Sign Language Animations for Aiding Hearing- and Speaking-Disabled Person

Research Project

Project/Area Number 08558026
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section展開研究
Research Field Intelligent informatics
Research InstitutionHOKKAIDO UNIVERSITY

Principal Investigator

AOKI Yoshinao  Grad.School of Eng., Hokkaido Univ., Pro., 大学院・工学研究科, 教授 (90001180)

Co-Investigator(Kenkyū-buntansha) JO Gun  Nihon Knowledge Industry Co.Ltd., Researcher, 研究員
TANAHASHI Shin  Grad.School of Eng., Hokkaido Univ., Assistant, 工学研究科, 助手 (90250480)
KAWASHIMA Toshio  Grad.School of Eng., Hokkaido Univ., Asso.Pro., 工学研究科, 助教授 (20152952)
YAMAMOTO Tsuyoshi  Computer Center, Hokkaido Univ., Pro., 大型計算機センター, 教授 (80158287)
Project Period (FY) 1996 – 1998
Project Status Completed (Fiscal Year 1998)
Budget Amount *help
¥3,400,000 (Direct Cost: ¥3,400,000)
Fiscal Year 1998: ¥600,000 (Direct Cost: ¥600,000)
Fiscal Year 1997: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 1996: ¥1,700,000 (Direct Cost: ¥1,700,000)
KeywordsSign Language CG Animation / Sign Language Dictionary / Description of Sign Language Gesture / MATLAB / LIFO / Action Units / Generation of Emotional Face / Avatar / アクション・ユニット / 表情形成 / 手話画像 / CGアニメーション / 手話通訳 / CG画像生成 / 聴覚・発声障害者支援 / 手話者動作 / 辞書システム
Research Abstract

The research results are listed as follows ;
(1) We developed a trial system to display CG animations of sign language for aiding hearing- and speaking-disabled person with high-speed processing by extending the functions of Lifo language, which was developed as a descendent language of Lisp and Forth. We confirmed the validity of the developed system by producing examples of CG animation of sign language.
(2) For simplicity of designing gesture of sign language and for easiness of keeping software, we use MATLAB which recently has an excellent GUI functions, resulting in development of a prototype of a dictionary system.
(3) A method to generate emotional expression of a face is developed using AU (Action Units) and an experiment was done to draw a face by changing emotional expressions, resulting in proving the fact that emotion can be transmitted to fair extent by using two-dimensional simple faces.
(4) Beside the use by disabled person, a sign language communication among ordinary person who are in the circumstances separated by the linguistic barrier, is proposed and a non-verbal communication system between Japan and Korea was discussed, where these two countries have the similar linguistic and cultural systems.
(5) We obtained knowledge that our developed system can be applied to the comic chat which is expected widely used in near future.
(6) We introduced a new concept of "field of meaning" in order to express sign language by considering the expression of past. We also introduced a concept of "avatar language" from the term "avatar" which originally came from Sanskrit to express the symbol of God, and is used in Internet. as a technique to express ourselves. Because sign language has a fixed idea of the language for the hearing-and speaking-disabled person, we introduced avatar language for expressing the fact that the technique discussed in our research is not only for disabled people but for ordinary person.

Report

(4 results)
  • 1998 Annual Research Report   Final Research Report Summary
  • 1997 Annual Research Report
  • 1996 Annual Research Report
  • Research Products

    (14 results)

All Other

All Publications (14 results)

  • [Publications] 青木由直: "衛星通信を利用した知的通信方式による手話画像伝送の研究" 電子情報通信学会誌. 80・5. 41-442 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Y.Aoki: "Development of a CG-Animation System for Sing Language Communication between Different Language" Proc. of Int. Conf. on Information, Communication and Signal Processing (ICICS'97'). vol. 3. 1668-1671 (1997)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Y.Aoki: "Sign Language Communication between Japanese-Korean and Japanese-Portuguese Using CG Animation" Proc. of IEEE Int. Conf. on Acoust, Speech and Signal Processing. vol. 6. 3765-3768 (1998)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 李 今燦: "日韓手話通信のためのCGアニメーションシステム構築の基礎的検討" 電子情報通信学会論文誌D-III. J82D-II (掲載予定)印刷中. (1999)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Y.Aoki and S.Tanahashi: "Investigation on the Transmission of Sign Language Images by Intelligent Communication Method Using a Communications Satellite." J.of IEICE. Vol.80, No.5. 441-442 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Y.Aoki, S.Tanahashi, A.Burger, H.Hattori and H.Wakoh: "Development of a CG-Animation System for Sign Languages Communication between Different Languages." Proc.of International Conference on Information, Communication and Signal Processing (ICICS'97). Vol.3. 1668-1671 (1997)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] Y.Aoki, R.Mitsumori, J.Li and A.Burger: "Sign Language Communication Between Japanese-Korean and Japanese-Portuguese Using CG Animation" Proc.of International Conference on Acoustics, Speech and Signal Processing (ICASSP'98). vol.6. 3765-3768 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] J.Li, Y.Aoki and S.Kim: "Consideration on the Construction of a CG-Animation System for Sign Language Communication between Japan and Korea" Trans.of IEICE. vol.J82-D-II,(in press). (1999)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      1998 Final Research Report Summary
  • [Publications] 青木由直: "衛星通信を利用した知的通信方式による手話画像伝送の研究" 電子情報通信学会誌. 80.5. 441-442 (1997)

    • Related Report
      1998 Annual Research Report
  • [Publications] 呉 芝英: "An Implementation of Sign Language Chatting System Using Intelligent Image Communication" 1997年度大韓電子工学会秋季綜合学術大会論文集. 20.2. 1221-1224 (1997)

    • Related Report
      1998 Annual Research Report
  • [Publications] Y.Aoki: "Sign Language Communication Between Japanese-Korean and Japanese-Portuguese Using CG Animation" Proc.of IEEE Int.Conf.on Acoust.,Speach,and Signal Processing. Vol.6. 3765-3768 (1998)

    • Related Report
      1998 Annual Research Report
  • [Publications] 李 今燦: "日韓手話通信のためのCGアニメーションシステム構築の基礎的検討" 電子情報通信学会論文誌D-II. J82-D-II(掲載予定). (1999)

    • Related Report
      1998 Annual Research Report
  • [Publications] 青木由直: "衛星通信を利用した知的通信方式による手話画像伝送の研究" 電子情報通信学会誌. 80・5. 441-442 (1997)

    • Related Report
      1997 Annual Research Report
  • [Publications] 呉 芝英: "An Implementation of sign Language Chatting System Using Intelligent Image Communication" 1997年度大韓電子工学会秋季綜合学術大会論文集. 20・2. 1221-1224 (1997)

    • Related Report
      1997 Annual Research Report

URL: 

Published: 1996-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi