• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on an effective method of video communication of sign language in consideration of cognitive characteristics

Research Project

Project/Area Number 16091209
Research Category

Grant-in-Aid for Scientific Research on Priority Areas

Allocation TypeSingle-year Grants
Review Section Science and Engineering
Research InstitutionKogakuin University

Principal Investigator

NAGASHIMA Yuji  Kogakuin University, Faculty of Infomatics, Professor (50138137)

Project Period (FY) 2004 – 2006
Project Status Completed (Fiscal Year 2006)
Budget Amount *help
¥17,200,000 (Direct Cost: ¥17,200,000)
Fiscal Year 2006: ¥3,500,000 (Direct Cost: ¥3,500,000)
Fiscal Year 2005: ¥7,200,000 (Direct Cost: ¥7,200,000)
Fiscal Year 2004: ¥6,500,000 (Direct Cost: ¥6,500,000)
KeywordsCognitive Science / Sign Linguistic Engineering / Video Communication / ERP / ICT on Well-being / Corpus / Commnnication Assistive Technology / 画像評価 / 動画像符号化
Research Abstract

This research has aimed at the communication support using ICT for the hearing impaired people. Provided result is the following items.
(a) We are concerned with language cognition, semantic processing process analysis based on N400 ; event related potential measurement was examined for the understanding the Japanese sign language comprehension mechanisms. As a result, because it is understood that N400 is observed in semantic congruity sentence by sign language and the character, and the potential is large in the character stimulation, and was shown the difference of the processing process by the presentation modality.
(b) We discussed evaluation techniques for the quality of digitally encoded motion picture of sign language. This result guarantees that opinion test can be substituted for intelligibility test. Further investigation shows that motion pictures with high frame rate are more legible than those with high precision. Another result shows that screen size of sign picture doesn' … More t affect comprehensibility.
(c) We are concerned with low-bit rate digital encoding of moving picture of sign language. A new encoding method suitable for sign language is presented based on characteristics of sign language. As a result, an encoding image data using our proposed method is more possible at a low bit rate in comparison with an existing method. Moreover, our method in the same parameter condition has been confirmed that it was obtained a clearer image in comparison with an existing method.
(d) We have also worked on a problem of mental workload, which is mental stress that sign language users undergo during interactive communication. We have found that NASA-TLX is effective enough for measuring the degree of mental workload
(e) In the research process, we collected a corpus by video image and electronic data by three-dimensional movement for linguistic analysis of sign language. The electronic data showed it on Web as sign language animation by the BoT3D engine.
Our findings have been appeared in journals such as the one of the transactions on IEICE, and the one of Human Interface Society.
We feel necessity to develop this research. On the basis of result of this research, we continue analysis work from the side of cognitive science through conversation analysis of sign language. Less

Report

(4 results)
  • 2006 Annual Research Report   Final Research Report Summary
  • 2005 Annual Research Report
  • 2004 Annual Research Report
  • Research Products

    (62 results)

All 2007 2006 2005 2004

All Journal Article (62 results)

  • [Journal Article] Collaboration between Linguistics and Engineering in Generating Animation of Japanese Sign Language : the Development of sIGNDEX Vol. 32007

    • Author(s)
      Daisuke HARA
    • Journal Title

      9^<th> European Conference for the Association for the Advancement of Assistive Technology in Europe(Accepted)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Temporal Feature of Sign Language through the Analysis of Shadowing2007

    • Author(s)
      Koru NAKAZONO
    • Journal Title

      9^<th> European Conference for the Association for the Advancement of Assistive Technology in Europe(Accepted)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 視覚・聴覚障害への情報工学支援2007

    • Author(s)
      長嶋祐二
    • Journal Title

      総合リハビリテーション 35・5

      Pages: 447-455

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] 映像遅延が手話対話へ及ぼす影響の定量化手法2007

    • Author(s)
      中園薫
    • Journal Title

      電子情報通信学会論文誌D J90-D・3

      Pages: 628-638

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Collaboration between Linguistics and Engineering in Generating Animation of Japanese Sign Language : the Development of sIGNDEX Vol. 32007

    • Author(s)
      Daisuke HARA
    • Journal Title

      9th European Conference for the Association for the Advancement of Assistive Technology in Europe (Accepted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Temporal Feature of Sign Language through the Analysis of Shadowing2007

    • Author(s)
      Koru NAKAZONO
    • Journal Title

      9th European Conference for the Association for the Advancement of Assistive Technology in Europe (Accepted)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Information and Communication Assistive Technology for the Visually Impaired and Hearing-Impaired2007

    • Author(s)
      Yuji NAGASHIMA
    • Journal Title

      Sogo Rehabilitation Vol. 35, No. 5

      Pages: 447-455

    • NAID

      40015472642

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Quantization Method of Delay Effect on Sign Dialogue2007

    • Author(s)
      Kaoru NAKAZONO
    • Journal Title

      IEICE Transactions on Information and Systems Vol. J90-D, No. 3

      Pages: 628-638

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Collaboration between Linguistics and Engineering in Generating Animation of Japanese Sign Language : the Development of sIGNDEX Vol.32007

    • Author(s)
      Daisuke HARA
    • Journal Title

      9^<th> European Conference for the Association for the Advancement of Assistive Technology in Europe (Accepted)

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Temporal Feature of Sign Language through the Analysis of Shadowing2007

    • Author(s)
      Koru NAKAZONO
    • Journal Title

      9^<th> European Conference for the Association for the Advancement of Assistive Technology in Europe (Accepted)

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 遅延手話対話における頷きの時間的特長と差異分析2007

    • Author(s)
      寺内美奈
    • Journal Title

      信学技報 106・612

      Pages: 17-20

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 遅延環境における対話の単語表出と発話時間の検討2007

    • Author(s)
      安川真奈
    • Journal Title

      信学技報 106・612

      Pages: 13-16

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 話の認知メカニズム解析のための輝点手話による分析方法の検討2007

    • Author(s)
      柳沢美貴
    • Journal Title

      信学技報 106・612

      Pages: 7-12

    • Related Report
      2006 Annual Research Report
  • [Journal Article] シャドーイングと遅延フィードバック発話による手話の時間的特性の分析2007

    • Author(s)
      竹田祐樹
    • Journal Title

      信学技報 106・612

      Pages: 1-6

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Digital Encoding Applied to Sign Language Video2006

    • Author(s)
      Koru NAKAZONO
    • Journal Title

      IEICE Transactions on Information and Systems E89-D・6

      Pages: 1893-1900

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Annual Research Report 2006 Final Research Report Summary
  • [Journal Article] Evaluation of Effect of Delay on Sign Video Communication2006

    • Author(s)
      Koru NAKAZONO
    • Journal Title

      Lecture Notes in Computer Science、 Springer LNCS 4061

      Pages: 659-666

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] デジタル符号化された手話動画像の品質評価について2006

    • Author(s)
      中園薫
    • Journal Title

      電子情報通信学会論文誌D J89-D・3

      Pages: 541-551

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 視聴覚障害者のコミュニケーション支援2006

    • Author(s)
      長嶋祐二
    • Journal Title

      電子情報通信学会誌 89・3

      Pages: 231-235

    • NAID

      110004665293

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary 2005 Annual Research Report
  • [Journal Article] Digital Encoding Applied to Sign Language Video2006

    • Author(s)
      Koru NAKAZONO
    • Journal Title

      IEICE Transactions on Information and Systems Vol. E89-D, No. 6

      Pages: 1893-1900

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Evaluation of Effect of Delay on Sign Video Communication2006

    • Author(s)
      Kaoru NAKAZONO
    • Journal Title

      Lecture Notes in Computer Science, Springer LNCS 4061

      Pages: 659-666

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Communication Assistive Technology for the Hearing Impaired, the Visually Impaired and the Visually and Hearing Impaired2006

    • Author(s)
      Yuji NAGASHIMA
    • Journal Title

      Journals of IEICE Vol. 89, No. 3

      Pages: 231-235

    • NAID

      110004665293

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Evaluations of Digitally Encoded Motion Picture of Sign Language2006

    • Author(s)
      Kaoru NAKAZONO
    • Journal Title

      IEICE Transactions on Information and Systems Vol. J89-D, No. 3

      Pages: 541-551

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Study of Japanese Sign Language Semantic Process Based on N400 Analysis2006

    • Author(s)
      Hisaya TANAKA
    • Journal Title

      Proceedings of 2006 IEEE International Conference on Systems, Man, and Cybernetics

      Pages: 355-357

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Evaluation of Effect of Delay on Sign Video Communication2006

    • Author(s)
      Kaoru NAKAZONO
    • Journal Title

      Lecture Notes in Computer Science(Springer) LNCS 4061

      Pages: 659-666

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 遅延環境下における映像対話のメンタルワークロードの評価2006

    • Author(s)
      中園薫
    • Journal Title

      信学技報 106・258

      Pages: 95-100

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 手話と字幕の同時呈示に対する見やすさについて2006

    • Author(s)
      宮本一郎
    • Journal Title

      信学技報 106・258

      Pages: 89-94

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 手話と字幕の同時呈示に対する見やすさについての検討2006

    • Author(s)
      宮本一郎
    • Journal Title

      信学技報 106・144

      Pages: 55-58

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 遅延のある手話画像による対話の定量的分析2006

    • Author(s)
      中園薫
    • Journal Title

      人工知能学会研究会資料 SIG-SLDU-A601-9

      Pages: 49-56

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 遅延を含む手話対話のターンテイキング解析2006

    • Author(s)
      寺内美奈
    • Journal Title

      人工知能学会研究会資料 SIG-SLDU-A601-8

      Pages: 43-48

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 遅延環境における手話対話の発話交替解析2006

    • Author(s)
      寺内美奈
    • Journal Title

      信学技報 106・57

      Pages: 59-64

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 手話アニメーション合成エディタの開発2006

    • Author(s)
      出渕亮一郎
    • Journal Title

      信学技報 106・57

      Pages: 53-58

    • Related Report
      2006 Annual Research Report
  • [Journal Article] デジタル符号化された手話動画像の品質評価について2006

    • Author(s)
      中園 薫
    • Journal Title

      電子情報通信学会論文誌D J89-D・3

      Pages: 541-551

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 手話対話の遅延に及ぼす影響2006

    • Author(s)
      長嶋祐二
    • Journal Title

      ヒューマンインタフェース学会第10回ノンバーバル研究会論文集 Vol.10

      Pages: 50-55

    • Related Report
      2005 Annual Research Report
  • [Journal Article] コントロール手話における話者交替の分析2006

    • Author(s)
      寺内美奈
    • Journal Title

      ヒューマンインタフェース学会第10回ノンバーバル研究会論文集 Vol.10

      Pages: 44-49

    • Related Report
      2005 Annual Research Report
  • [Journal Article] コントロール手話における頷きの再分析2006

    • Author(s)
      寺内美奈
    • Journal Title

      電子情報通信学会技術研究報告 105・508

      Pages: 73-78

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 手話通信における遅延の影響と遅延検知限の評価2006

    • Author(s)
      長嶋祐二
    • Journal Title

      電子情報通信学会技術研究報告 105・508

      Pages: 61-66

    • NAID

      110004071777

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 手話動画像用デジタル符号化法の提案と評価2005

    • Author(s)
      中園薫
    • Journal Title

      ヒューマンインタフェース学会論文誌 7・1

      Pages: 131-140

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 聴覚障害支援2005

    • Author(s)
      長嶋祐二
    • Journal Title

      ヒューマンインタフェース学会誌 7・1

      Pages: 33-40

    • NAID

      10014479082

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Turn-Taking in Controlled JSL Conversation2005

    • Author(s)
      Eishi Watanabe
    • Journal Title

      Proceedings of 11th International Conference on Human-Computer Interaction) by CR-ROM

      Pages: 1-5

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] 手話対話の映像遅延に及ぼす影響の基礎的な検討2005

    • Author(s)
      長嶋祐二
    • Journal Title

      信学技報 105・67

      Pages: 25-30

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Encoding for Moving Picture of Sign Language and It's Evaluation2005

    • Author(s)
      Kaoru NAKAZONO
    • Journal Title

      Transactions of Human Interface Society Vol. 7, No. 1

      Pages: 131-140

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Assist to the hearing impairment2005

    • Author(s)
      Yuji NAGASHIMA
    • Journal Title

      Journals of Human Interface Society Vol. 7, No. 1

      Pages: 33-40

    • NAID

      10014479082

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Turn-Taking in Controlled JSL Conversation2005

    • Author(s)
      Eishi Watanabe
    • Journal Title

      Proceedings of 11th International Conference on Human-Computer Interaction (CR-ROM)

      Pages: 1-5

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] Fundamental Study on Influence of Transmission Delay by Sign Video Communication2005

    • Author(s)
      Yuji NAGASHIMA
    • Journal Title

      Technical Report of IEICE Vol. 105, No. 67

      Pages: 25-30

    • NAID

      10016435178

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2006 Final Research Report Summary
  • [Journal Article] ヒューマンインタフェースから見た聴覚障害者支援2005

    • Author(s)
      長嶋祐二
    • Journal Title

      電子情報通信学会シンポジウム論文集

      Pages: 51-62

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 事象関連電位N400計測に基づく日本手話理解における意味処理分2005

    • Author(s)
      田中久弥
    • Journal Title

      ヒューマンインタフェース学会HIS2005講演論文集 2・3343

      Pages: 897-900

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 手話対話の映像遅延に及ぼす影響計測の為の課題の検討2005

    • Author(s)
      住田英之
    • Journal Title

      ヒューマンインタフェース学会HIS2005講演論文集 2・331

      Pages: 889-892

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 高齢難聴者の介護者の支援マニュアル2005

    • Author(s)
      和田篤
    • Journal Title

      日本リハビリテーション協会 第20回リハ工学カンファレンス論文集

      Pages: 318-319

    • Related Report
      2005 Annual Research Report
  • [Journal Article] Turn-Taking in Controlled JSL Conversation2005

    • Author(s)
      Eishi Watanabe
    • Journal Title

      Proceedings of 11th International Conference on Human-Computer Interaction) (CD-ROM)

      Pages: 1-5

    • Related Report
      2005 Annual Research Report
  • [Journal Article] テレビ電話を利用した手話通話2005

    • Author(s)
      中園薫
    • Journal Title

      日本手話学会第31回大会予稿集

      Pages: 45-48

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 事象関連電位N400による日本手話の文脈理解分析〜呈示例文の収集〜2005

    • Author(s)
      宮本一郎
    • Journal Title

      日本手話学会第31回大会予稿集

      Pages: 41-44

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 高齢難聴者の介護支援マニュアル2005

    • Author(s)
      和田篤
    • Journal Title

      電子情報通信学会技術研究報告 105・186

      Pages: 95-99

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 手話対話の映像遅延に及ぼす影響の基礎的な検討2005

    • Author(s)
      長嶋祐二
    • Journal Title

      電子情報通信学会技術研究報告 105・67

      Pages: 25-30

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 手話動画像の評価実験-画面サイズ,フレームレート,量子化幅等の影響-2005

    • Author(s)
      中園薫
    • Journal Title

      電子情報通信学会技術研究報告 105・67

      Pages: 19-24

    • Related Report
      2005 Annual Research Report
  • [Journal Article] 字幕付手話映像の手話読み取りに及ぼす影響に関する基礎的検討2005

    • Author(s)
      宮本一郎
    • Journal Title

      電子情報通信学会技術研究報告 105・67

      Pages: 13-18

    • Related Report
      2005 Annual Research Report
  • [Journal Article] N400解析に基づく手話理解メカニズムの一考察2005

    • Author(s)
      田中久弥
    • Journal Title

      電子情報通信学会技術研究報告 105・67

      Pages: 7-12

    • Related Report
      2005 Annual Research Report
  • [Journal Article] ぼかし手話映像の観測時における視線解析2005

    • Author(s)
      米原裕貴
    • Journal Title

      電子情報通信学会技術研究報告 104・750

      Pages: 19-22

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 同一手話動作による手話リズムの解析に関する検討2005

    • Author(s)
      住田英之
    • Journal Title

      電子情報通信学会技術研究報告 104・750

      Pages: 13-18

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 手話における"顔"のはたらき2005

    • Author(s)
      市川 熹
    • Journal Title

      情報処理学会研究会 2005-CVIM

      Pages: 67-72

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 手話動画像用デジタル符号化法の提案と評価2005

    • Author(s)
      中園 薫
    • Journal Title

      ヒューマンインタフェース学会論文誌 7・1

      Pages: 131-140

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 基礎講座 高齢の人・障害がある人への支援 第4回 聴覚障害支援2005

    • Author(s)
      長嶋祐二
    • Journal Title

      ヒューマンインタフェース学会誌 7・1

      Pages: 33-40

    • Related Report
      2004 Annual Research Report
  • [Journal Article] 拘束手話におけるターンテイキング解析2004

    • Author(s)
      渡辺英志
    • Journal Title

      可視化情報第32回可視化情報シンポジウム 24・SUPPl.1

      Pages: 291-294

    • Related Report
      2004 Annual Research Report

URL: 

Published: 2004-04-01   Modified: 2018-03-28  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi