• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A Study of Interactive Electronic Dictionary System Construction Based on Automatic Synthesis Function of Sign Language Articulators

Research Project

Project/Area Number 11680399
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionKogakuin University

Principal Investigator

NAGASHIMA Yuji  Kogakuin University, Faculty of Engineering, Associate Professor, 工学部, 助教授 (50138137)

Co-Investigator(Kenkyū-buntansha) KANDA Kazuyuki  Chukyo University, Faculty of Liberal Arts, Professor, 教養部, 教授 (70132123)
ICHIKAWA Akira  Chiba University, Graduate School of Science and Technology, Professor, 大学院・自然科学研究科, 教授 (80241933)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 2001: ¥800,000 (Direct Cost: ¥800,000)
Fiscal Year 2000: ¥700,000 (Direct Cost: ¥700,000)
Fiscal Year 1999: ¥2,000,000 (Direct Cost: ¥2,000,000)
KeywordsSign Language / Sign Linguistic Engineering / Electronic Dictionary / Animation / Speech Reading / sIGNDEX / Image Database / Segmentation Analysis / サインデックス
Research Abstract

It is for a purpose of this research to construct an electronic dictionary system supporting multi-media. Function of this electronic dictionary is automatic generation of an animated image. An articulator of the animated image attached with mouth shape satisfies syntagmatic structure. In this research, I examined it in each function of sign language conversation corpus part, linguistic analysis part, articulation generation part, image database part on construction of electronic dictionary system by 3D animation through research period.
1. In sign language conversation corpus part, I examined proposed in the corpus collection method which removed influence from Japanese. With the data collection method which I proposed, I chose 994 sign words from KOSIGN Ver.2 and had been collection and a video recording of about 3,800 sign language conversation corpus. Furthermore, I constructed support system to analyze segmentation of sign conversation video image. This system is able to easily set … More a tag in various analyses item with frame unit on its sheet.
2. In language analysis part, I analyzed a sign language conversation corpus with this analysis support system. The analysis subject matter is extract of distinctive feature and a morpheme of sign language. I proposed of NVGS morpheme descriptive model of sentence level from an analysis result.
3. In animated image generation part, I proposed in the method that generated an articulator of an animated image from description. The articulator described language construction by NVGS morpheme model with sIGNDEX for non-manual signals. Furthermore, this system has 15 basic mouth-shaped function to generate to improve recognition accuracy of a sign language animated image.
4. In electronic dictionary part, I constructed an interactive sign language electronic dictionary. In this dictionary, there are sign language example sentences database retrieval function and an animated image with the mouth shape generated function. In addition, total vocabulary number of this dictionary is 1,142 sign words.
This research purpose and the execution plan were almost achieved as above. In addition, results of research are presented in Journal of IEICE, Transactions of Human Interface Society, International Conference, etc. " Construction of the Mouth Shape Animation System" (HIS2000) of these result got the sciences encouragement prize from Human Interface Society in March 2001.
I feel necessity to develop this research. On the basis of result of this research, I continue analysis work from the side of cognitive science through conversation analysis of sign language. Less

Report

(4 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • 1999 Annual Research Report
  • Research Products

    (56 results)

All Other

All Publications (56 results)

  • [Publications] Kazuyuki KANDA: "Signdex V.1 & V.2 The Computerized Dictionary of Japanese Sign Language"Proceedings of 7th International Conference on Theoretical Issues in Sign Language Research. 1. 65-65 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 高田雄二: "手話文認識のためのセグメント要素の解析"ヒューマンインタフェース学会論文誌. 2・3. 29-36 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 木谷寿一: "読話アニメーションシステムの構築"ヒューマンインタフェース学会ヒューマンインタフェースシンポジウム. 1. 181-184 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 長嶋祐二: "手話電子化辞書とその応用--形態辞書の構築--"ヒューマンインタフェース学会ヒューマンインタフェースシンポジウム. 1. 189-192 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 神田和幸: "日本手話の非手指信号の統計的分析-sIGNDEX V.2 解析作業中間報告-"ヒューマンインタフェース学会研究報告集. 2・5. 5-10 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 福田佳史: "sIGNDEXとNVG形態モデルを用いたアニメーション生成に関する検討"信学技報. 00・46. 39-44 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 長嶋祐二: "手話文コーパスの開発"日本手話研究所 手話コミュニケーション研究. 39. 24-30 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 長嶋祐二: "手話のコンピュータ処理"電子情報通信学会学会誌. 84・5. 320-324 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yuji NAGASHIMA: "Present Stage and Issues of Sign Linguistic Engineering"Proceedings of Human-Computer Interaction (Universal Access in HCI). 3. 387-391 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazuyuki KANDA: "Notation System and Statistical Analysis of NMS in JSL"Proceedings of Human-Computer Interaction. 1. 25-27 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 市川 熹: "手話日本語間の自動翻訳とその周辺"ヒューマンインタフェース学会誌. 3・3. 179-188 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 松尾英明: "動作構成要素に基づく非接触手話動作認識方式"ヒューマンインタフェース学会論文誌. 3・3. 135-144 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 武藤大至: "手話の対話映像解析支援システム"ヒューマンインタフェース学会論文誌. 3・3. 153-161 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 長嶋祐二: "手話の記述法の開発とコーパス収集"電子情報通信学会ソサエティ大会(ソサエティ特別企画). 1. 307-308 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 神田和幸: "統計的解析から見た日本手話手指動作・非手指信号の相関について"ヒューマンインタフェース学会研究報告集. 3・5. 53-58 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 安部憲広: "マルチモーダルインタフェースの研究開発とその応用事例"ヒューマンインタフェース学会誌. 4・1. 35-40 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 寺内美奈: "手話会話におけるターンテイキングに関する基礎検討"信学技報. 101・703. 1-6 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazuyuki KANDA: "Notation System and Statistical Analysis of NMS in JSL"Lecture Notes in Artificial Intelligence, Springer-Verlag. 2298(In Press). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 3次元画像用語事典編集委員会: "3次元画像用語事典"新技術コミュニケーションズ. 147 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazuyuki KANDA: "SIGNDEX V.1 & V.2 The Computerized Dictionary of Japanese Sign Language"Proceedings of 7th International Conference on Theoretical Issues in Sign Language Research. Vol. 1. 65 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yuji TAKATA: "Analysis of Segmented Factors for Japanese Sign Language Recognition"Journal of Human Interface Society. Vol. 2, No. 3. 29-36 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Toshikazu KITANI: "Construction of the Mouth Shape Animation System"Proceedings of Human Interface Symposium 2000. 181-184 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yuji NAGASHIMA: "JSL Electronical Dictionary and its Application to Morphological Analysis"Proceedings of Human Interface Symposium 2000. 189-192 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazuyuki KANDA: "Statistical Analysis of NMS in JSL"Correspondences on Human Interface. Vol. 2, No. 5. 5-10 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yoshihito FUKUDA: "Synthesize of the Sign-Language Animation using sIGNDEX and NVG Morphological Notation Model"Technical Report of lEICE. Vol. WIT00, No. 46. 39-44 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yuji NAGASHIMA: "Development of sign language sentence corpus"Japanese Institute for Sign Language Studies. Vol. 39. 24-30 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yuji NAGASHIMA: "Sign Language and Its Computer Processing"Journal of the Institute of Electronics, Information and Communication Engineers. Vol. 84, No. 5. 320-324 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yuji NAGASHIMA: "Present Stage and Issues of Sign Linguistic Engineering"Proceedings of Human-Computer Interaction (Universal Access in HCI). Vol. 3. 387-391 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazuyuki KANDA: "Notation System and Statistical Analysis of NMS in JSL"Proceedings of Human-Computer Interaction. Vol. 1. 25-27 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Akira Ichikawa: "Automatic Translation between Sign Language and Japanese and Its Surroundings"Journal of Human Interface Society. Vol. 3, No. 3. 33-42 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Hideaki MATSUO: "A Japanese Sign Language recognition based on global movement features and localized characteristics in images capture using stereo camera"Transactions of Human Interface Society. Vol. 3, No. 3. 14-24 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Daishi MUTOH: "Conversation Analysis Support System for Sign Video Images"Transactions of Human Interface Society. Vol. 3, No. 3. 33-42 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Yuji NAGASHIMA: "Development of Notational System and Corpus for JSL"Proceedings of the 2001 Engineering Sciences Society Conference of IEICE. 307-308 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazuyuki KANDA: "On Statistical Correlations between Manual and Non-Manual Signals in Japanese Sign Language"Correspondences on Human Interface. Vol. 3, No. 5. 53-58 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Norihiko ABE: "The research and development of multi-modal interface and the application"Journal of Human Interface Society. Vol. 4, No. 1. 35-39 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Mina TERAUCHI: "A Fundamental Analysis of Turn-taking for Sign Language Conversation"Technical Report of lEICE. Vol. WIT2001-43. 1-6 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Kazuyuki KANDA: "Notation System and Statistical Analysis of NMS in JSL"Lecture Notes in Artificial Intelligence, Springer-Verlag. Vol. 2998 (In Press).

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 神田和幸: "Signdex V.2による手話文記述法に関する検討"電子情報通信学会福祉情報工学研究会資料. 00・1. 37-42 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 武藤大至: "対話映像解析支援ツールに関する基礎検討"電子情報通信学会福祉情報工学研究会資料. 00・1. 57-62 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 長嶋祐二: "第5回ヒューマンインタフェース研究会報告"ヒューマンインタフェース学会誌. 2・2. 122-123 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Hideaki MATUO: "The Japanese Sign Language using General Movement Traits and Localized Characteristics in Images"Proceedings of SCI2000 (World Multiconference on Systemics, Cybernetics and Informatics). 5・1. 189-195 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] Kazuyuki KANDA: "Signdex V.1 & V.2 The Computerized Dictionary of Japanese Sign Language"Proceedings of TISLR (7 th International Conference on Theoretical Issues in Sign Language Research). 1・1. 195-195 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 高田雄二: "手話文認識のためのセグメント要素の解析"ヒューマンインタフェース学会誌. 2・3. 29-36 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 木谷寿一: "読話アニメーションシステムの構築"ヒューマンインタフェース学会HIS2000論文集. 2214. 181-184 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 長嶋祐二: "手話電子化辞書とその応用-形態辞書の構築-"ヒューマンインタフェース学会HIS2000論文集. 2222. 189-192 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 長嶋祐二: "手話調動自動生成機能をもつインタラクティブ電子化辞書システムの構築に関する研究"工学院大学総合研究所年報. 7. 117-120 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 長嶋祐二: "手話通訳システム"計測自動制御学会 第19回先端電子計測部会講演会-福祉機器の現状と将来の展望-. 1. 38-44 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 神田和幸: "日本手話の非手指信号の統計的分析-sIGNDEX V.2解析作業中間報告-"ヒューマンインタフェース学会研究報告集. 2・5. 5-10 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 福田佳史: "sIGNDEXとNVG形態モデルを用いたアニメーション生成に関する検討"電子情報通信学会福祉情報工学研究会資料. 00・4. 39-44 (2001)

    • Related Report
      2000 Annual Research Report
  • [Publications] 3次元画像用語編集委員会: "3次元画像用語事典"新技術コミュニケーションズ. 147 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 小島隆史: "音声表記記号を用いた手話文章の調動生成に関する検討"ヒューマンインタフェース学会研究報告集. 1・3. 55-60 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 神田和幸: "手話の文章表記法-Signdex V.2-"ヒューマンインタフェース学会 HIS'99 論文集. 1. 745-748 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 長嶋祐二: "手話情報学の現状と課題"電子情報通信学会パターン認識・メディア理解、ヒューマン情報処理. 99・452. 45-52 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 武藤大至: "手話セグメンテーション解析ツール"ヒューマンインタフェース学会研究報告集. 1・5. 29-32 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 松浦隆行: "アニメーションと例文再生可能な手話電子化辞書システム"ヒューマンインタフェース学会研究報告集. 1・5. 33-36 (1999)

    • Related Report
      1999 Annual Research Report
  • [Publications] 福田佳史: "口形付き手話アニメーションの生成に関する検討"電子情報通信学会福祉情報工学研究会資料. 99・20. 3-10 (2000)

    • Related Report
      1999 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi