• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

International Collaborative Research on Intelligence Augmentation of Human Learning

Research Project

Project/Area Number 20KK0235
Research Category

Fund for the Promotion of Joint International Research (Fostering Joint International Research (B))

Allocation TypeMulti-year Fund
Review Section Medium-sized Section 62:Applied informatics and related fields
Research InstitutionOsaka Metropolitan University (2022-2023)
Osaka Prefecture University (2020-2021)

Principal Investigator

Kise Koichi  大阪公立大学, 大学院情報学研究科, 教授 (80224939)

Co-Investigator(Kenkyū-buntansha) 石丸 翔也  大阪公立大学, 大学院情報学研究科, 特任教授 (10788730)
岩田 基  大阪公立大学, 大学院情報学研究科, 准教授 (70316008)
Project Period (FY) 2020-10-27 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥18,720,000 (Direct Cost: ¥14,400,000、Indirect Cost: ¥4,320,000)
Fiscal Year 2022: ¥5,590,000 (Direct Cost: ¥4,300,000、Indirect Cost: ¥1,290,000)
Fiscal Year 2021: ¥6,760,000 (Direct Cost: ¥5,200,000、Indirect Cost: ¥1,560,000)
Fiscal Year 2020: ¥6,370,000 (Direct Cost: ¥4,900,000、Indirect Cost: ¥1,470,000)
Keywords知能増強 / 学習増強 / 単語学習 / 確信度推定 / 読書検出 / 有酸素運動 / 睡眠 / 呼吸 / 視線解析 / マルチメディア学習 / 理解度推定 / 分かったフリ / NII湘南ミーティング / センシング / アクチュエーション / 限定的有効性 / 処方箋 / EdTech / 学習支援 / 人工知能 / 音読解析 / ナッジ / ピアグループ / マイクロラーニング / ヒューマンセンシング / ヒューマンコンピュータインタラクション / 認知バイアス
Outline of Research at the Start

本研究では,第二言語(L2) の学習を中心的な対象として,ドイツ,フランス,オーストラリアの研究者と協力して研究を進めていく.2020年度には,実験に必要なソフトウェアの構築とセンサの準備などの実験準備を行う.2021年度には,読んだ語数や語彙力,解答に対する確信度,集中度を対象として,アクチュエーションによりどの程度改善するのかを実験によって明らかにする.2021年度には,興味度と書いた語数を対象として,同様の実験を行う.日本だけではなく独仏豪で実験を行うことにより,言語や文化,人種などによるアクチュエーションの効果の違いが明らかになると期待できる.

Outline of Final Research Achievements

In this study, experiments and evaluations were conducted in international cooperation to measure, detect, and evaluate efficient and effective methods of learning English, as well as the fundamentals that influence academic achievement. Specifically, the following are the results of the study. For English language learning, we addressed two issues: vocabulary learning and confidence estimation during learning. For word learning, we studied edutainment using English-English comic books, and unknown word detection and learning strategies in a mobile environment. On the other hand, we experimentally examined the effects of reading time, exercise, sleep, and respiration on the basic factors that influence word learning. A new method for reading detection based on self-supervised learning was proposed. Various conditions and influences on the measurement of sleep and the influence of respiration were investigated.

Academic Significance and Societal Importance of the Research Achievements

本研究成果の学術的意義は,様々な学習支援,データ取得や分析を,実験室環境のように整備された環境ではなく,様々な要因が混入する実環境(in-the-wild環境)で実施し,有効性や限界を明らかにした点にある.特に,実験参加者数が多く,実験が長期間にわたる場合,実験室環境下とはまったく異なる様相を呈するものである.技術を実環境で使うことを考えると,このような開発や実験,検証は避けて通れないものであるため,重要性が高いと確信している.社会的意義もこの点から来ており,技術を実社会に役立てるための重要な一歩を踏み出せたと考える.

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (53 results)

All 2024 2023 2022 2021 2020 Other

All Int'l Joint Research (10 results) Journal Article (11 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 11 results,  Open Access: 3 results) Presentation (29 results) (of which Int'l Joint Research: 12 results,  Invited: 3 results) Funded Workshop (3 results)

  • [Int'l Joint Research] German Rsearch Center for AI (DFKI)(ドイツ)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] Monash University(オーストラリア)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] TU Delft(オランダ)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] LISN(フランス)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] German Research Center for AI(ドイツ)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] University Paris-Saclay(フランス)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] University of Melbourne(オーストラリア)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] German Research Center for AI(ドイツ)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] LIMSI/Sorbonne University/Brest National School of Engineering(フランス)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] University of Melbourne(オーストラリア)

    • Related Report
      2020 Research-status Report
  • [Journal Article] Personalizing Augmented Flashcards Towards Long-Term Vocabulary Learning2024

    • Author(s)
      Yuichiro Iwashita, Andrew Vargo, Motoi Iwata, Koichi Kise
    • Journal Title

      Proceedings of Augmented Humans 2024

      Volume: - Pages: 263-266

    • DOI

      10.1145/3652920.3653045

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] In-the-Wild Exploration of the Impact of the Lunar Cycle on Sleep in a University Cohort with Oura Rings2024

    • Author(s)
      Shota Arai, Andrew Vargo, Benjamin Tag, Koichi Kise
    • Journal Title

      Proceedings of Augmented Humans 2024

      Volume: - Pages: 259-262

    • DOI

      10.1145/3652920.3653044

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Augmenting Sleep Behavior with a Wearable: Can Self-Reflection Help?2024

    • Author(s)
      Hannah R. Nolasco, Andrew Vargo, Marc Moreeuw, Toma Hara, Koichi Kise
    • Journal Title

      Proceedings of Augmented Humans 2024

      Volume: - Pages: 278-281

    • DOI

      10.1145/3652920.3653049

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Considering Wearable Health Tracking Devices and Pandemic Preparedness for Universities2023

    • Author(s)
      Andrew Vargo, Peter Neigel, Koichi Kise
    • Journal Title

      IEEE Pervasive Computing

      Volume: 22 Issue: 4 Pages: 35-44

    • DOI

      10.1109/mprv.2023.3322460

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Poverty Traps in Online Knowledge-Based Peer-Production Communities2023

    • Author(s)
      Andrew Vargo, Chris Blakely, Koichi Kise
    • Journal Title

      Informatics

      Volume: 10 Issue: 3 Pages: 61-61

    • DOI

      10.3390/informatics10030061

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Examining Participant Adherence with Wearables in an In-the-Wild Setting2023

    • Author(s)
      Hannah R Nolasco, Andrew Vargo, Niklas Bohley, Christian Brinkhaus, Koichi Kise
    • Journal Title

      Sensors

      Volume: 23 Issue: 14 Pages: 6479-6479

    • DOI

      10.3390/s23146479

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Perception Versus Reality: How User Self-reflections Compare to Actual Data2023

    • Author(s)
      Hannah R. Nolasco, Andrew Vargo, Yusuke Komatsu, Motoi Iwata, Koichi Kise
    • Journal Title

      Proc. IFIP Conference on Human-Computer Interaction 2023

      Volume: - Pages: 665-674

    • DOI

      10.1007/978-3-031-42286-7_37

    • ISBN
      9783031422850, 9783031422867
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Exploring Users’ Ability to Choose a Proper Fit in Smart-Rings: A Year-Long “In the Wild” Study2023

    • Author(s)
      Peter Neigel, Andrew Vargo, Yusuke Komatsu, Chris Blakely, Koichi Kise
    • Journal Title

      Proc. IFIP Conference on Human-Computer Interaction 2023

      Volume: - Pages: 486-490

    • DOI

      10.1007/978-3-031-42293-5_59

    • ISBN
      9783031422928, 9783031422935
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Exploring Sensor Modalities to Capture User Behaviors for Reading Detection2022

    • Author(s)
      ISLAM Md. Rabiul、VARGO Andrew W.、IWATA Motoi、IWAMURA Masakazu、KISE Koichi
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E105.D Issue: 9 Pages: 1629-1633

    • DOI

      10.1587/transinf.2020ZDL0003

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2022-09-01
    • Related Report
      2022 Research-status Report
    • Peer Reviewed
  • [Journal Article] Obtaining Labels for In-the-Wild Studies:Using Visual Cues and Recall2021

    • Author(s)
      Andrew Vargo, Shoya Ishimaru, Md. Rabiul Islam, Benjamin Tag, Koichi Kise
    • Journal Title

      IEEE Pervasive

      Volume: 21 Issue: 1 Pages: 9-17

    • DOI

      10.1109/mprv.2021.3129500

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Confidence Estimation via Wrist Movement2021

    • Author(s)
      Seiya Tanaka, Andrew W. Vargo, Motoi Iwata, Koichi Kise
    • Journal Title

      Proc. of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing

      Volume: 1 Pages: 76-77

    • DOI

      10.1145/3460418.3479286

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Presentation] Personalizing Augmented Flashcards Towards Long-Term Vocabulary Learning2024

    • Author(s)
      Yuichiro Iwashita, Andrew Vargo, Motoi Iwata, Koichi Kise
    • Organizer
      Augmented Humans International Conference 2024
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] In-the-Wild Exploration of the Impact of the Lunar Cycle on Sleep in a University Cohort with Oura Rings2024

    • Author(s)
      Shota Arai, Andrew Vargo, Benjamin Tag, Koichi Kise
    • Organizer
      Augmented Humans International Conference 2024
    • Related Report
      2023 Annual Research Report
  • [Presentation] Augmenting Sleep Behavior with a Wearable: Can Self-Reflection Help?2024

    • Author(s)
      Hannah R. Nolasco, Andrew Vargo, Marc Moreeuw, Toma Hara, Koichi Kise
    • Organizer
      Augmented Humans International Conference 2024
    • Related Report
      2023 Annual Research Report
  • [Presentation] Perception Versus Reality: How User Self-reflections Compare to Actual Data2023

    • Author(s)
      Hannah R. Nolasco, Andrew Vargo, Yusuke Komatsu, Motoi Iwata, Koichi Kise
    • Organizer
      IFIP Conference on Human-Computer Interaction 2023
    • Related Report
      2023 Annual Research Report
  • [Presentation] Exploring Users’ Ability to Choose a Proper Fit in Smart-Rings: A Year-Long “In the Wild” Study2023

    • Author(s)
      Peter Neigel, Andrew Vargo, Yusuke Komatsu, Chris Blakely, Koichi Kise
    • Organizer
      IFIP Conference on Human-Computer Interaction 2023
    • Related Report
      2023 Annual Research Report
  • [Presentation] 錯乱肢の生成による英語多肢選択問題の適応的難易度調整2023

    • Author(s)
      内田 時央. Vargo Andrew, 黄瀬 浩一
    • Organizer
      第22回情報科学技術フォーラム
    • Related Report
      2023 Annual Research Report
  • [Presentation] 音読音声と視線情報を用いた英語漫画中の未知語を含んだ吹き出し推定2023

    • Author(s)
      髙池 太郎, 岩田 基, 黄瀬 浩一
    • Organizer
      第22回情報科学技術フォーラム
    • Related Report
      2023 Annual Research Report
  • [Presentation] 英単語学習を長期的に継続するための適応型学習システムの開発2023

    • Author(s)
      岩下 雄一郎, 岩田 基, Andrew W. Vargo, 黄瀬 浩一
    • Organizer
      2023年電子情報通信学会総合大会
    • Related Report
      2022 Research-status Report
  • [Presentation] バーチャルペット飼育型単語学習システムとその評価2023

    • Author(s)
      浦上 太一, 黄瀬 浩一
    • Organizer
      情報処理学会第202回ヒューマンコンピュータインタラクション研究発表会
    • Related Report
      2022 Research-status Report
  • [Presentation] バーチャルペット飼育型単語学習システムの提案2023

    • Author(s)
      浦上 太一, 黄瀬 浩一
    • Organizer
      情報処理学会第85回全国大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 個人に適した有酸素運動の単語記憶課題への効果2023

    • Author(s)
      大原健太郎, Andrew Vargo, 黄瀬浩一
    • Organizer
      情報処理学会第85回全国大会
    • Related Report
      2022 Research-status Report
  • [Presentation] text-to-imageモデルによる生成画像を用いた英単語学習の提案と画像で表現可能な英単語の調査2023

    • Author(s)
      中島 悠太,岩田 基,黄瀬 浩一
    • Organizer
      情報処理学会研究報告教育学習支援情報システム
    • Related Report
      2022 Research-status Report
  • [Presentation] Towards Guided-Breath as an Intervention Within Computer-Assisted Learning2022

    • Author(s)
      Kanta Yamaoka, Andrew W. Vargo, Motoi Iwata, Koichi Kise
    • Organizer
      2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 International Symposium on Wearable Computers
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sleep Quality Tracking and Alignment with a Simple In-the-Wild Task2022

    • Author(s)
      Andrew W. Vargo, Masayuki Fujimoto, Koichi Kise
    • Organizer
      2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 International Symposium on Wearable Computers
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Just the Right Amount of Exercise: Aerobic Exercise and Memory2022

    • Author(s)
      Andrew W. Vargo, Kentaro Ohara, Takumi Nakai, Koichi Kise
    • Organizer
      2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 International Symposium on Wearable Computers
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Evaluating Contrastive Learning for Fine-grained Reading Detection2022

    • Author(s)
      Md. Rabiul Islam, Andrew W. Vargo, Motoi Iwata, Masakazu Iwamura, and Koichi Kise
    • Organizer
      12th International Congress on Advanced Applied Informatics
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] モバイル学習者の読書行動に基づく未知単語推定2022

    • Author(s)
      東村 理功,Andrew W. Vargo,岩田 基,黄瀬 浩一
    • Organizer
      第21回情報科学技術フォーラム(FIT2022)f
    • Related Report
      2022 Research-status Report
  • [Presentation] 腕の動きとWebカメラを用いた英語問題の確信度推定2022

    • Author(s)
      田中 勢也, Andrew W. Vargo, 黄瀬 浩一
    • Organizer
      2022年 電子情報通信学会 総合大会
    • Related Report
      2021 Research-status Report
  • [Presentation] スマートフォンを用いた読書活動データからの未知単語推定2022

    • Author(s)
      東村 理功,岩田 基,黄瀬 浩一
    • Organizer
      2022年 電子情報通信学会 総合大会
    • Related Report
      2021 Research-status Report
  • [Presentation] マルチメディアVocabulometerによる動画の字幕を利用した英単語学習2022

    • Author(s)
      山口 航平, 岩田 基, Andrew Vargo, 黄瀬 浩一
    • Organizer
      情報処理学会教育学習支援情報システム研究会
    • Related Report
      2021 Research-status Report
  • [Presentation] Reading of "Reading" for "Actuating": Augmenting Human Learning by "Experiential Supplements"2022

    • Author(s)
      Koichi Kise
    • Organizer
      Workshop on Words/Machines #4
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Reading of "Reading" for "Actuating": Augmenting Human Learning by "Experiential Supplements"2022

    • Author(s)
      Koichi Kise
    • Organizer
      The 3rd International Conference on Activity and Behavior Computing
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Confidence Estimation via Wrist Movement2022

    • Author(s)
      Seiya Tanaka, Andrew W. Vargo, Motoi Iwata, Koichi Kise
    • Organizer
      2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Beyond Camera-Based Document Analysis and Recognition: Towards Camera-Based Human Document Interactions2021

    • Author(s)
      Koichi Kise
    • Organizer
      International Workshop on Document Analysis Systems
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Manga Vocabulometer, A new support system for extensive reading with Japanese mangatranslated into English2021

    • Author(s)
      Jin Kato, Motoi Iwata, Koichi Kise
    • Organizer
      MANPU2020, Pattern Recognition. ICPR International Workshops and Challenges
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] 視線情報と座圧情報を用いた多読時の漫画英訳本に対する興味度推定2021

    • Author(s)
      高池 太郎,岩田 基,黄瀬 浩一
    • Organizer
      第5回コミック工学研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] Reading Activity Classification Using Self-supervised Deep Learning2021

    • Author(s)
      Md. Rabiul Islam, Shuji Sakamoto, Yoshihiro Yamada, Andrew Vargo, Motoi Iwata, Masakazu Iwamura, Koichi Kise
    • Organizer
      情報処理学会ヒューマンコンピュータインタラクション研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] Mobile Vocabulometer: A Context-based Learning Mobile Application to Enhance English Vocabulary Acquisition2020

    • Author(s)
      Kohei Yamaguchi, Motoi Iwata, Andrew Vargo, and Koichi Kise
    • Organizer
      2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Handwriting Behavior as a Self-Confidence Discriminator2020

    • Author(s)
      Takanori Maruichi,Taichi Uragami,Andrew Vargo,Koichi Kise
    • Organizer
      2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Funded Workshop] NII Shonan Meeting "The Future of Education with AI "2024

    • Related Report
      2023 Annual Research Report
  • [Funded Workshop] IDAKS Workshop 20242024

    • Related Report
      2023 Annual Research Report
  • [Funded Workshop] International Workshop on Learning Cyclotron2022

    • Related Report
      2021 Research-status Report

URL: 

Published: 2020-10-29   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi