• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Multimodal Corpus of Everyday Conversation among Older Adults

Research Project

Project/Area Number 22H00544
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionInstitute of Physical and Chemical Research

Principal Investigator

大武 美保子  国立研究開発法人理化学研究所, 革新知能統合研究センター, チームリーダー (10361544)

Co-Investigator(Kenkyū-buntansha) 小磯 花絵  大学共同利用機関法人人間文化研究機構国立国語研究所, 研究系, 教授 (30312200)
Project Period (FY) 2022-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2024)
Budget Amount *help
¥41,990,000 (Direct Cost: ¥32,300,000、Indirect Cost: ¥9,690,000)
Fiscal Year 2024: ¥14,820,000 (Direct Cost: ¥11,400,000、Indirect Cost: ¥3,420,000)
Fiscal Year 2023: ¥14,300,000 (Direct Cost: ¥11,000,000、Indirect Cost: ¥3,300,000)
Fiscal Year 2022: ¥12,870,000 (Direct Cost: ¥9,900,000、Indirect Cost: ¥2,970,000)
Keywords高齢者 / 日常会話 / コーパス / 言語能力 / 認知機能
Outline of Research at the Start

本研究の目的は、高齢者の日常会話から、認知機能や心理状態、脳活動状態を推定するために、通常の会話データに加え、異なるモダリティのデータと紐づくコーパスを開発することである。本研究では、会話により認知機能維持に寄与する言語能力の生涯発達を支援する技術を開発するため、その技術を用いて実施される会話を含む一連の活動が、参加者の認知機能と言語能力に与える影響を評価する言語解析手法を言語理論に基づいて提案し、実証実験を通じて得られたエビデンスをコーパスとして整備する。認知症患者数が世界的に増える中、高齢者の認知症発症と認知機能低下を防ぐという喫緊の社会課題に対し、学術的基盤を整備する意義がある。

Outline of Annual Research Achievements

2022年度は、研究項目1,2,3について研究を進めた。
1言語理論に基づく言語解析手順、脱文脈化アノテーション手法の確立:子供の発達の特徴をとらえる指標として提案された修辞ユニット分析という分析手法を、高齢者談話に適用し、高齢者の認知機能の維持に効果を資する言語能力を反映しうる、言語特徴量の指標として、脱文脈化指数が挙げられる。修辞ユニット分析は、選択体系機能言語理論における談話分析手法の一つで、発話の場である「今・ここ・わたし」の時空と発話内容の時空との距離を、脱文脈化指数として指標化することができる。既収集データに対してアノテーションを行いながら、具体的な文例に即したアノテーションルールを整備した。
2 会話において表出される高齢者の時間的志向と記憶機能の関係の解明:会話において表出される高齢者の時間的志向が記憶機能と相関することを明らかにした。時間的志向とは、個人がどの時間(現在、過去、未来など)に重きを置くかの傾向を意味する。本研究では、高齢者のグループ会話の発話を、時間の観点から分類し、特に、遠隔記憶と近時記憶との対比を念頭に、「過去」「最近」の分類に着目し、それらで特徴付けられる発話の量と記憶検査スコアとの関連を調べた。その結果、論理的記憶検査のスコアが高い人ほど、すなわち、最近聞いた話をよく憶えている人ほど、「過去の体験と知識を混ぜた発話」および「最近の知識」で特徴付けられる文を多く発する傾向が見られることを明らかにした。
3 脳波データから認知機能低下の有無を判別する技術の開発:異なるモダリティのデータの間の関係を調べるため、会話データを取得した被験者の脳波データの特徴を抽出することを目指し、認知機能が低下した高齢者と、認知機能が保たれている高齢者の、認知課題遂行中の脳波データや、課題遂行データから、認知機能の低下の有無を高精度に判別する技術を開発した。

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

当初計画では、認知機能と相関する会話特徴量として、脱文脈化指数が挙げられるとの仮説に基づいて、アノテーション手法を開発することを主な目標として挙げていた。
この他、会話において表出される高齢者の時間的志向が、記憶機能と相関することを明らかにし、当初計画を超える成果が得られたため。

Strategy for Future Research Activity

確立したアノテーション手法に基づいて、アノテーションを実施すると共に、異なるモダリティのデータを新規に取得する計画である。

Report

(2 results)
  • 2022 Comments on the Screening Results   Annual Research Report
  • Research Products

    (45 results)

All 2024 2023 2022 Other

All Int'l Joint Research (3 results) Journal Article (22 results) (of which Int'l Joint Research: 9 results,  Peer Reviewed: 18 results,  Open Access: 20 results) Presentation (17 results) (of which Int'l Joint Research: 9 results,  Invited: 6 results) Book (2 results) Remarks (1 results)

  • [Int'l Joint Research] University of Friberg(ドイツ)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] INRIA(フランス)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Nicholas Copernicus University(ポーランド)

    • Related Report
      2022 Annual Research Report
  • [Journal Article] Mild cognitive impairment prediction and cognitive score regression in the elderly using EEG topological data analysis and machine learning with awareness assessed in affective reminiscent paradigm2024

    • Author(s)
      Tomasz M. Rutkowski,Tomasz Komendzinski,Mihoko Otake-Matsuura
    • Journal Title

      Frontiers in Aging Neuroscience

      Volume: 15 Pages: 1294139-1294139

    • DOI

      10.3389/fnagi.2023.1294139

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Home-Based Cognitive Intervention for Healthy Older Adults Through Asking Robots Questions: Randomized Controlled Trial2024

    • Author(s)
      Seiki Tokunaga, Takuya Sekiguchi, Kumi Watanabe Miura, Hikaru Sugimoto, Masato S. Abe, Kazuhiro Tamura, Taishiro Kishimoto, Takashi Kudo, Mihoko Otake-Matsuura
    • Journal Title

      JMIR Aging

      Volume: 7 Pages: e47229-e47229

    • DOI

      10.2196/47229

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Word-producing brain: Contribution of the left anterior middle temporal gyrus to word production patterns in spoken language2023

    • Author(s)
      Sugimoto Hikaru、Abe Masato S.、Otake-Matsuura Mihoko
    • Journal Title

      Brain and Language

      Volume: 238 Pages: 105233-105233

    • DOI

      10.1016/j.bandl.2023.105233

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Effect of home-based group conversation intervention using smartphone application on cognitive health and psychological well-being of older adults with subjective cognitive concerns in Japan: a randomized controlled trial protocol2023

    • Author(s)
      Miura Kumi Watanabe、Tokunaga Seiki、Sekiguchi Takuya、Sugimoto Hikaru、Otake-Matsuura Mihoko
    • Journal Title

      Frontiers in Psychology

      Volume: 14 Pages: 1114790-1114790

    • DOI

      10.3389/fpsyg.2023.1114790

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Time-orientations of older adults in group conversations and their association with memory functioning2023

    • Author(s)
      Sekiguchi, T., Sugimoto, H., Tokunaga, S., and Otake-Matsuura, M.
    • Journal Title

      Current Psychology

      Volume: 43 Issue: 7 Pages: 5854-5867

    • DOI

      10.1007/s12144-023-04545-w

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Novel EEG Network Neuroscience Features for Dementia and Awareness Level Estimation in Passive BCI Framework2023

    • Author(s)
      Tomasz M. Rutkowski,Tomasz Komendzinski,Mihoko Otake-Matsuura
    • Journal Title

      Proceedings of the 10th International Brain-Computer Interface Meeting. BCI Society; 2023

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Open Access / Int'l Joint Research
  • [Journal Article] Machine learning approach for early onset dementia neurobiomarker using EEG network topology features2023

    • Author(s)
      Rutkowski, T. M., Abe, M. S., Komendzinski, T., Sugimoto, H., Narebski, S., and Otake-Matsuura, M.
    • Journal Title

      Frontiers in Human Neuroscience

      Volume: 17 Pages: 1155194-1155194

    • DOI

      10.3389/fnhum.2023.1155194

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] AI, Robotics, and Clinical Research for Innovative Dementia Interventions: A Japanese-German Collaboration2023

    • Author(s)
      Simon Stock,Mihoko Otake,Ingo Kilimann,Markus Schinle,Kazumi Kumagai,Sascha Weimar,Marius Gerdes,Florian Mazura,Wilhelm Stork
    • Journal Title

      International German-Japanese Workshop on Digital Dementia Intervention and Prevention Strategies in the Age of AI

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Eye-tracking paradigms for the assessment of mild cognitive impairment: a systematic review2023

    • Author(s)
      Alexandra Wolf,Kornkanok Tripanpitak,Satoshi Umeda,Mihoko Otake-Matsuura
    • Journal Title

      Frontiers in Psychology

      Volume: 14 Pages: 1197567-1197567

    • DOI

      10.3389/fpsyg.2023.1197567

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Multi-modal EEG/fNIRS/ET Data Collection and Cloud Storage System Prototype for the Elderly Home-based Dementia Monitoring2023

    • Author(s)
      Takumi Kodama,Tomasz M. Rutkowski,Tomasz Komendzinski,Youichi M Ito,Mihoko Otake-Matsuura
    • Journal Title

      2023 45th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC): IEEE Press; 2023.

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Journal Article] Mild Cognitive Impairment Detection with Machine Learning and Topological Data Analysis Applied to EEG Time-series in Facial Emotion Oddball Paradigm - Objective Neurobiomarker for Early Onset Dementia Prediction Approach2023

    • Author(s)
      Tomasz M. Rutkowski,Masato S. Abe,Hikaru Sugimoto,Mihoko Otake-Matsuura
    • Journal Title

      2023 45th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC): IEEE Press; 2023.

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Open Access
  • [Journal Article] Topological Data Analysis Applied to EEG for Objective Early Onset Dementia Neurobiomarker2023

    • Author(s)
      Tomasz M. Rutkowski,Masato S. Abe,Hikaru Sugimoto,Tomasz Komendzinski,Mihoko Otake-Matsuura
    • Journal Title

      TDA Week 2023

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Journal Article] Tract-Based Spatial Statistics Analysis of Diffusion Tensor Imaging in Older Adults After the PICMOR Intervention Program: A Pilot Study2022

    • Author(s)
      Sugimoto Hikaru、Otake-Matsuura Mihoko
    • Journal Title

      Frontiers in Aging Neuroscience

      Volume: 14 Pages: 867417-867417

    • DOI

      10.3389/fnagi.2022.867417

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Dementia Digital Neuro-biomarker Study from Theta-band EEG Fluctuation Analysis in Facial and Emotional Identification Short-term Memory Oddball Paradigm2022

    • Author(s)
      Rutkowski TM, Abe MS, Tokunaga S, Komendzinski T, Otake-Matsuura M.
    • Journal Title

      2022 44th Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC)

      Volume: - Pages: 4056-4059

    • DOI

      10.1109/embc48229.2022.9871991

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Passive BCI Oddball Paradigm for Dementia Digital Neuro-biomarker Elucidation from Attended and Inhibited ERPs Utilizing Information Geometry Classification Approaches.2022

    • Author(s)
      Rutkowski TM, Abe MS, Tokunaga S, Sugimoto H, Komendzinski T, Otake-Matsuura M.
    • Journal Title

      2022 IEEE International Conference on Systems, Man and Cybernetics (SMC)

      Volume: - Pages: 2657-2662

    • DOI

      10.1109/smc53654.2022.9945159

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Cognitive behavioral assistive technology (CBAT) as AI for super aged society2022

    • Author(s)
      M. Otake-Matsuura, M. S. Abe, T. Sekiguchi, S. Tokunaga, H. Sugimoto, T. M. Rutkowski, K. W. Miura
    • Journal Title

      Gerontechnology

      Volume: 21 Issue: s Pages: 1-1

    • DOI

      10.4017/gt.2022.21.s.713.opp3

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A summary report through home experiment on a dialogue system for older adults2022

    • Author(s)
      S. Tokunaga, K. Tamura, M. Otake-Matsuura
    • Journal Title

      Gerontechnology

      Volume: 21 Issue: s Pages: 1-1

    • DOI

      10.4017/gt.2022.21.s.497.opp4

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Development of RobotHub: Integration of external system to group conversation system for older adults2022

    • Author(s)
      S. Tokunaga, K. Fukumori, K. Tamura, K. Inoue, T. Kawahara, M. Otake-Matsuura
    • Journal Title

      Gerontechnology

      Volume: 21 Issue: s Pages: 1-1

    • DOI

      10.4017/gt.2022.21.s.510.opp4

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Voice Over Body? Older Adults’ Reactions to Robot and Voice Assistant Facilitators of Group Conversation2022

    • Author(s)
      Katie Seaborn, Takuya Sekiguchi, Seiki Tokunaga, Norihisa P. Miyake, Mihoko Otake-Matsuura
    • Journal Title

      International Journal of Social Robotics

      Volume: 15 Issue: 2 Pages: 143-163

    • DOI

      10.1007/s12369-022-00925-7

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Annotation System for Dialogue Datasets of Older Adult’s with Photos and Storytelling2022

    • Author(s)
      Tokunaga, S., Takata, S., Tamura, K., Otake-Matsuura, M.
    • Journal Title

      2022 Joint 12th International Conference on Soft Computing and Intelligent Systems and 23rd International Symposium on Advanced Intelligent Systems (SCIS&ISIS)

      Volume: - Pages: 447-452

    • DOI

      10.1007/978-3-031-21047-1_41

    • ISBN
      9783031210464, 9783031210471
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Cross-cultural Evaluation of Dementia Passive BCI Neuro-biomarker Candidates2022

    • Author(s)
      T. M. Rutkowski, S. Narebski, P. Bekier, T. Komendzinski, H. Sugimoto and M. Otake-Matsuura
    • Journal Title

      2022 Joint 12th International Conference on Soft Computing and Intelligent Systems and 23rd International Symposium on Advanced Intelligent Systems (SCIS&ISIS)

      Volume: - Pages: 1-1

    • DOI

      10.1109/scisisis55246.2022.10002105

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Association between social comparison orientation and hippocampal properties in older adults: A multimodal MRI study2022

    • Author(s)
      Sugimoto Hikaru、Sekiguchi Takuya、Otake-Matsuura Mihoko
    • Journal Title

      Social Neuroscience

      Volume: 17 Issue: 6 Pages: 544-557

    • DOI

      10.1080/17470919.2023.2166580

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 認知症予防を支援するロボット2024

    • Author(s)
      大武美保子
    • Organizer
      RRI勉強会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 今からできる認知症の予防2024

    • Author(s)
      大武美保子
    • Organizer
      岸和田市認知症ケア(KDC)報告会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Embodied Intelligence in Conversations and its Appliction to Cognitive Intervention and Prediction2024

    • Author(s)
      Mihoko Otake-Matsuura
    • Organizer
      The 4th Embodied Intelligence Conference
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 高齢者の認知的健康を見守り育むAI2023

    • Author(s)
      大武美保子
    • Organizer
      AIと文化シンポジウム「人の行動変容におけるAIの役割」
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] AI for cognitive intervention and prediction of cognitive decline2023

    • Author(s)
      Mihoko Otake-Matsuura
    • Organizer
      International German-Japanese Workshop on Digital Dementia Intervention and Prevention Strategies in the Age of AI
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] ありたい未来を共に考え行動を促すAIロボット2023

    • Author(s)
      大武美保子
    • Organizer
      日本ロボット学会学術講演会2023
    • Related Report
      2022 Annual Research Report
  • [Presentation] AI and robots for cognitive intervention and prediction of cognitive decline2023

    • Author(s)
      Mihoko Otake-Matsuura
    • Organizer
      6th EU-Japan Workshop on Neurorobotics: Healthcare and aging in the era of AI
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 認知症予防とAI2023

    • Author(s)
      大武美保子
    • Organizer
      第12回日本認知症予防学会学術集会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Conversation Assistive Technology: Face to Face, Dialogue System, and Remote Communication2023

    • Author(s)
      Mihoko Otake-Matsuura
    • Organizer
      Second International Workshop on Complex Systems Science and Health Neuroscience
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Network Neuroscience Dementia Neurobiomarker with ML Support2023

    • Author(s)
      Tomasz M.RUTKOWSKI
    • Organizer
      Second International Workshop on Complex Systems Science and Health Neuroscience
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Predictive EEG Biomarkers for Cognitive Impairment2023

    • Author(s)
      Kornkanok TRIPANPITAK
    • Organizer
      Second International Workshop on Complex Systems Science and Health Neuroscience
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Leverage the potential of data collection and utilization to foster cognitively healthy aging2023

    • Author(s)
      Mihoko Otake-Matsuura, Mike Martin
    • Organizer
      International Data Week, SciDataCon 2023
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Contribution of the left anterior middle temporal gyrus to word production patterns in spoken language2022

    • Author(s)
      Sugimoto, H., Abe, M.S., and Otake-Matsuura, M.
    • Organizer
      29th annual meeting of the Cognitive Neuroscience Society (CNS)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 高齢者見守り声掛けロボットのシナリオベース対話中のユーザ発話終了予測に基づく話者交替タイミングの決定2022

    • Author(s)
      熊谷 和実, 徳永 清輝, 三宅 徳久, 田村 和弘, 水内 郁夫, 大武 美保子
    • Organizer
      2022年度人工知能学会全国大会(第36回)
    • Related Report
      2022 Annual Research Report
  • [Presentation] ロボット声掛け音声の個人適合に向けた対話中の感情推定結果の利用手法の検討2022

    • Author(s)
      熊谷 和実, 徳永 清輝, 三宅 徳久, 田村 和弘, 福森 航輔, 水内 郁夫, 大武 美保子
    • Organizer
      LIFE2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] Neural basis underlying production of a variety of words in conversations2022

    • Author(s)
      Sugimoto, H., Abe, M.S., and Otake-Matsuura, M.
    • Organizer
      Constructive Approaches to Co-Creative Communication at the Joint Conference on Language Evolution, 8
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Robots Using “Aizuchi” in Online Group Conversation2022

    • Author(s)
      KOBUKI Sota, SEABORN Katie, TOKUNAGA Seik, FUKUMORI Kosuke, HIDAKA Shun, TAMURA Kazuhiro, INOUE Koji, KAWAHARA Tatsuya, OTAKE-MASTUURA Mihoko
    • Organizer
      第40回 日本ロボット学会学術講演会
    • Related Report
      2022 Annual Research Report
  • [Book] テクノロジー・ロードマップ 2024-2033 全産業編2023

    • Author(s)
      出川 通 ほか95名
    • Total Pages
      602
    • Publisher
      日経BP
    • ISBN
      9784296203031
    • Related Report
      2022 Annual Research Report
  • [Book] テクノロジー・ロードマップ2023-2032 全産業編2022

    • Author(s)
      出川 通 ほか100名
    • Total Pages
      608
    • Publisher
      日経BP
    • ISBN
      9784296200474
    • Related Report
      2022 Annual Research Report
  • [Remarks] 認知行動支援技術チーム

    • URL

      https://aip.riken.jp/labs/goalorient_tech/cogn_behav_assist_tech/

    • Related Report
      2022 Annual Research Report

URL: 

Published: 2022-04-19   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi