A Proposal of Annotation and Transcription Scheme for Sign Language Interaction

• Project/Area Number: 26704005
• Research Category: Grant-in-Aid for Young Scientists (A)
• Allocation Type: Partial Multi-year Fund
• Research Field: Linguistics
• Research Institution: National Institute of Informatics
• Principal Investigator: Bono Mayumi 国立情報学研究所, コンテンツ科学研究系, 准教授 (50418521)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥22,750,000 (Direct Cost: ¥17,500,000、Indirect Cost: ¥5,250,000); Fiscal Year 2016: ¥7,930,000 (Direct Cost: ¥6,100,000、Indirect Cost: ¥1,830,000); Fiscal Year 2015: ¥7,280,000 (Direct Cost: ¥5,600,000、Indirect Cost: ¥1,680,000); Fiscal Year 2014: ¥7,540,000 (Direct Cost: ¥5,800,000、Indirect Cost: ¥1,740,000)
• Keywords: 日本手話 / 手話相互行為 / マウジング / 即興手話表現 / 手話言語記述手法 / トランスクリプト / ジェスチャー単位 / 言いよどみ / 手話言語 / 会話分析 / 相互行為分析 / アノテーション / コーパス / 言語記述手法 / 手話会話 / 修復の連鎖

Outline of Final Research Achievements

In this project, we attempted to propose a new scheme for annotating and transcribing sign language interactions. The method we proposed is based on 'Gesture Unit' originally came from Gesture studies, which is nearly equal to transcription system for phonetic features in spoken interaction, e.g. extended final particle. Thereby, it is made possible to observe phenomena of 'hesitation' and 'word-search' in signed interaction. Furthermore, we published several papers on the original concept of 'improvisational signing' as a communicative strategy of word-searching.

Research Products

• [Int'l Joint Research] マックスプランク心理言語学研究所/ラドバウド大学(オランダ)
• [Int'l Joint Research] Monash University(Australia)
• [Int'l Joint Research] Max Planck Institute(Netherlands)
• [Journal Article] 手話相互行為における即興手話表現：修復の連鎖の観点から (2017)
  • Author(s): 坊農真弓
  • Journal Title: 社会言語科学 Volume: Vol.19, No.2 Pages: 20-31
  • NAID: 130005628783
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] 会話における“収録される”ことの多様な利用 (2017)
  • Author(s): 牧野遼作, 阿部廣二, 古山宣洋, 坊農真弓
  • Journal Title: 質的心理学研究 Volume: Vol.16 Pages: 25-45
  • NAID: 130007872450
  • Peer Reviewed
• [Journal Article] 相互行為としての手話通訳活動: 手話通訳者を介した聞き手獲得手続きの分析 (2015)
  • Author(s): 菊地浩平, 坊農真弓
  • Journal Title: 認知科学 Volume: 22(1) Pages: 167-180
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Presentation] Recipients’ stance-taking actions during storytelling in signed interactions: An analysis of sequential position of nodding and facial expression (2017)
  • Author(s): Bono, Mayumi
  • Organizer: The 15th International Pragmatics Conference(15th IPRA)
  • Place of Presentation: Belfast, Northern Ireland
  • Year and Date: 2017-07-16
  • Int'l Joint Research
• [Presentation] Using relationships as an interactional resource in multiparty Japanese conversation involving children (2017)
  • Author(s): Makino, Ryosaku., Bono, Mayumi.
  • Organizer: The 15th International Pragmatics Conference(15th IPRA)
  • Place of Presentation: Belfast, Northern Ireland
  • Year and Date: 2017-07-16
  • Int'l Joint Research
• [Presentation] Interactional Ground: Synchronous Walking during Conversation (2017)
  • Author(s): Sakaida, Rui., Bono, Mayumi.
  • Organizer: The 15th International Pragmatics Conference(15th IPRA)
  • Place of Presentation: Belfast, Northern Ireland
  • Year and Date: 2017-07-16
  • Int'l Joint Research
• [Presentation] 子供のいる多人数会話における多層的構造の検討 (2017)
  • Author(s): 牧野遼作, 坊農真弓
  • Organizer: 日本発達心理学会第28回大会
  • Place of Presentation: 広島国際会議場，JMSアステールプラザ，広島市文化交流会館
  • Year and Date: 2017-03-25
• [Presentation] 手話辞典の使用実態と会話におけるろう者の伝達手法 (2017)
  • Author(s): 岡田智裕, 坊農真弓
  • Organizer: 情報処理学会アクセシビリティ研究会第3回研究会
  • Place of Presentation: 筑波技術大学
  • Year and Date: 2017-03-10
• [Presentation] 日本手話の条件文：うなずき型とロールシフト型 (2016)
  • Author(s): 原田なをみ, 高山智恵子, 坊農真弓
  • Organizer: 日本言語学会第153回大会
  • Place of Presentation: 福岡大学
  • Year and Date: 2016-12-03
• [Presentation] 発話割合の算出による来館者の積極性検出手法の提案 (2016)
  • Author(s): 佐藤美祐, 坊農真弓
  • Organizer: 第76回 人工知能学会 言語・音声理解と対話処理研究会
  • Place of Presentation: 早稲田大学
  • Year and Date: 2016-10-05
• [Presentation] 人はいかにして「歩き出す」ことを了解するのか ―展示物解説活動に埋め込まれた移動― (2016)
  • Author(s): 坂井田瑠衣, 坊農真弓
  • Organizer: 日本認知科学会第33回大会
  • Place of Presentation: 北海道大学
  • Year and Date: 2016-09-16
• [Presentation] 手話コミュニティにおける語の社会的な役割についての意識調査 (2016)
  • Author(s): 岡田智裕, 牧野遼作, 坊農真弓
  • Organizer: 情報処理学会アクセシビリティ研究会第1回研究会
  • Place of Presentation: 国立情報学研究所
  • Year and Date: 2016-07-29
• [Presentation] Gestures: a Resource for Describing an Android in an Intercultural Interaction (2016)
  • Author(s): Lefebvre, Augustin., Bono, Mayumi.
  • Organizer: 7th Conference of The International Society for Gesture Studies (ISGS 2016)
  • Place of Presentation: Sorbonne Nouvelle University, France
  • Year and Date: 2016-07-18
  • Int'l Joint Research
• [Presentation] Improvisational signing with mouthing: How native signers create temporary expressions in interaction (2016)
  • Author(s): Bono, Mayumi.
  • Organizer: 7th Conference of The International Society for Gesture Studies (ISGS 2016)
  • Place of Presentation: Sorbonne Nouvelle University, France
  • Year and Date: 2016-07-18
  • Int'l Joint Research
• [Presentation] Improvisational signing with mouthing: How native signers create temporary expressions in interaction (2016)
  • Author(s): Mayumi Bono
  • Organizer: 7th Conference of The International Society for Gesture Studies (ISGS 2016)
  • Place of Presentation: Paris, France
  • Year and Date: 2016-07-18
  • Int'l Joint Research
• [Presentation] Searching for phenomena in a spontaneous Japanese signed discourse corpus using structured annotations (2016)
  • Author(s): Kouhei Kikuchi & Mayumi Bono
  • Organizer: 12th International Conference on Theoretical Issues in Sign Language Research
  • Place of Presentation: Melbourne, Australia
  • Year and Date: 2016-01-04
  • Int'l Joint Research
• [Presentation] 会話映像コーパスデータを利用したコミュニケーションの分析 (2016)
  • Author(s): 牧野遼作, 坊農真弓
  • Organizer: IDRユーザーフォーラム2016
  • Place of Presentation: 国立情報学研究所
• [Presentation] 子供のいる多人数会話で互いの存在を利用すること ―科学コミュニケーターの常体／敬体の使い分けに着目して― (2016)
  • Author(s): 牧野遼作, 坊農真弓
  • Organizer: 思考と言語研究会
  • Place of Presentation: 神戸学院大学
• [Presentation] Challenging the notion of written language: Transcribing sign language interaction. (2015)
  • Author(s): Mayumi Bono & Kouhei Kikuchi
  • Organizer: 14th International Pragmatics Conference
  • Place of Presentation: Antwerp, Belgium
  • Year and Date: 2015-07-26 – 2015-07-31
• [Presentation] Challenging the notion of written language: Transcribing sign language interaction (2015)
  • Author(s): Mayumi Bono & Kouhei Kikuchi
  • Organizer: 14th International Pragmatics Conference (IPrA 2015)
  • Place of Presentation: Antwerp, Belgium
  • Year and Date: 2015-07-26
  • Int'l Joint Research
• [Presentation] Japanese Sign Language Corpus (2015)
  • Author(s): Mayumi Bono & Kouhei Kikuchi
  • Organizer: Digging into Signs Workshop: Developing Annotation Standards for Sign Language Corpora
  • Place of Presentation: University Colleage of London, United Kingdom
  • Year and Date: 2015-03-30 – 2015-03-31
  • Invited
• [Presentation] Skype as an Interactional Agent of Distant Person: An Analysis of Practices of Gazing and Pointing in Japanese Sign Language (2014)
  • Author(s): Kouhei Kikuchi & Mayumi Bono
  • Organizer: Skype Connections and the Gaze of Friendship and Family Conference
  • Place of Presentation: Microsoft Research, Cambridge, United Kingdom
  • Year and Date: 2014-06-03 – 2014-06-04
• [Presentation] Colloquial Corpus of Japanese Sign Language: A Design of Language Resources for Observing Sign Language Conversation (2014)
  • Author(s): Mayumi Bono, Kouhei Kikuchi, Paul Cibulka and Yutaka Osugi
  • Organizer: The 9th edition of the Language Resources and Evaluation Conference
  • Place of Presentation: Reykjavik, Iceland
  • Year and Date: 2014-05-26 – 2014-05-31
• [Book] 「共在相互行為における空間取りと方向付け」山崎敬一編『EMCAハンドブック』 (2017)
  • Author(s): アダム・ケンドン著，坊農真弓・牧野遼作共訳，チブルカ ぱうる翻訳協力
  • Publisher: 新曜社
• [Book] Challenges for Robots Acting on a Stage: Creating Sequential Structures for Interaction and the Interaction Process with the Audience. Ryohei Nakatsu, Matthias Rauterberg & Paolo Ciancarini (Eds.) Handbook of Digital Games and Entertainment (2016)
  • Author(s): Mayumi Bono, Perla Maiolino, Augustin Lefebvre, Fulvio Mastrogiovanni, Hiroshi Ishiguro
  • Publisher: Springer
• [Book] 「手話雑談におけることばと身体とマルチアクティビティ」村田和代・井出里咲子編『雑談の美学』 (2016)
  • Author(s): 坊農真弓
  • Publisher: ひつじ書房
• [Book] 雑談の美学(分担執筆：手話雑談におけることばと身体とマルチアクティビティ，pp. 97-118) (2016)
  • Author(s): 坊農真弓
  • Total Pages: 344
  • Publisher: ひつじ書房
• [Book] ～手話人文学の構築に向けて（２）～手話言語コーパスプロジェクト『手話・言語・コミュニケーション』 (2015)
  • Author(s): 大杉豊，坊農真弓
  • Total Pages: 165
  • Publisher: 文理閣
• [Remarks] 日本手話話し言葉コーパスプロジェクト
  • URL: http://research.nii.ac.jp/jsl-corpus/public/
• [Remarks] みんなでつくる！日本手話話し言葉コーパス
  • URL: http://research.nii.ac.jp/jsl-corpus/research/index.html
• [Remarks] Bono Lab. 音声会話・手話会話のインタラクション研究
  • URL: http://research.nii.ac.jp/~bono/ja/index.html
• [Remarks] みんなでつくる日本手話話し言葉コーパス
  • URL: http://research.nii.ac.jp/jsl-corpus/research/index.html
• [Remarks] 日本手話話し言葉コーパスプロジェクト
  • URL: http://research.nii.ac.jp/jsl-corpus/