• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of formative evaluation method based on cognitive behavior for evaluation of program code reading comprehension ability

Research Project

Project/Area Number 20H01718
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 09070:Educational technology-related
Research InstitutionTokyo Institute of Technology

Principal Investigator

Nakayama Minoru  東京工業大学, 工学院, 教授 (40221460)

Co-Investigator(Kenkyū-buntansha) 宇都 雅輝  電気通信大学, 大学院情報理工学研究科, 准教授 (10732571)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥9,360,000 (Direct Cost: ¥7,200,000、Indirect Cost: ¥2,160,000)
Fiscal Year 2022: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2021: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2020: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Keywordsプログラムコード / 読解作成能力 / 認知行動 / 形成的評価
Outline of Research at the Start

本研究では、プログラムコードの読み理解と作成スキルを中心として、学習行動に基づいた能力評価手法を確立し、効果的な指導法を開発することを目的とする。学習過程に応じた評価のために、プログラムコードの読解作成能力をコードの読み過程である眼の動きで評価する手法を確立する。そして、個人の読解作成能力を正確に測定するために、学習者の相互評価に基づくテスト理論を導入してプログラムコードに対する認知行動による形成的評価手法を確立する。これを基に、効果的な指導法を開発する。

Outline of Final Research Achievements

Formative evaluation methodologies for programing ability were established in order to develop reading and writing codes and these appropriate instructions. Eye movements as reading behavior including saccades and pupil reactions were introduced to estimate ability of program code comprehension and levels of expertiseness. The results showed a possibility to predict performance and temporal conditions such as level of attention during reading with modelling technique.
Another evaluation procedure of the ability was developed using peer assessment within learners, survey results at a university class provided a comparable performance ratings with instructors.

Academic Significance and Societal Importance of the Research Achievements

文書の読み行動を眼球運動で検討する研究を、コマンド記述で表現されるプログラムコードに応用し、能力評価が難しいプログラムの読解作成能力評価を検討した。読み行動を単語単位の注視行動でモデル化する手法が検討されており、事前に検討された属性を用いることでプログラミング能力の推定ができることを示した。また、読み過程での注意レベルの推定もできることを示した。
プログラミング能力の評価には、多様な観点が必要であることから、学習者同士による相互評価も有効である。そこで、その評価法の妥当性確立のために、学習者相互評価から教員評価に相当する評価値を推定する手法を開発した。

Report

(4 results)
  • 2023 Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (30 results)

All 2023 2022 2021 2020 Other

All Int'l Joint Research (7 results) Journal Article (10 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 10 results,  Open Access: 4 results) Presentation (12 results) (of which Int'l Joint Research: 9 results) Book (1 results)

  • [Int'l Joint Research] Sapienza University/University of Mercatorum(イタリア)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] University of Luxemburg(ルクセンブルク)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] University of Sapienza/University of Mercatorum(イタリア)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Sapienza University/Roma Tre University(イタリア)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Flinders University(オーストラリア)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] New York University Abu Dhabi(アラブ首長国連邦)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Warclaw University of S & T(ポーランド)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Symptoms of Dementia in Elderly Persons Using Waveform Features of Pupil Light Reflex2023

    • Author(s)
      Minoru Nakayama, Wioletta Nowak, Anna Zarowska
    • Journal Title

      Information Technology for Management: Approaches to Improving Business and Society

      Volume: LNBIP 471 Pages: 91-107

    • DOI

      10.1007/978-3-031-29570-6_5

    • ISBN
      9783031295690, 9783031295706
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Prediction Procedure for Dementia Levels based on Waveform Features of Binocular Pupil Light Reflex2023

    • Author(s)
      Minoru Nakayama, Wioletta Nowak, Anna Zarowska
    • Journal Title

      Proc. ETRA2023

      Volume: 16 Pages: 1-7

    • DOI

      10.1145/3588015.3588419

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Program Code Navigation Model for Individuals Based on LSTM with Co-Clustering2023

    • Author(s)
      Ming Sun, Minoru Nakayama
    • Journal Title

      Proc. ETRA2023

      Volume: 88 Pages: 1-6

    • DOI

      10.1145/3588015.3589192

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Modelling Attention Levels with Ocular Responses in a Speech-in-Noise Recall Task2023

    • Author(s)
      Mateusz Dubiel, Minoru Nakayama, Xin Wang
    • Journal Title

      Proc. ETRA2023

      Volume: 89 Pages: 1-7

    • DOI

      10.1145/3588015.3589665

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Estimation of Latent Attention Resources Using Microsaccade Frequency During a Dual Task2023

    • Author(s)
      Minoru Nakayama, Takahiro Ueno
    • Journal Title

      Proc. ETRA2023

      Volume: 41 Pages: 1-2

    • DOI

      10.1145/3588015.3590120

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Item Response Theory Approach to Enhance Peer Assessment Effectiveness in Massive Open Online Course2022

    • Author(s)
      Minoru Nakayama, Filippo Sciarrone, Marco Temperini, Masaki Uto.
    • Journal Title

      Int. J. Distance Education Technologies

      Volume: 20 Issue: 1 Pages: 1-19

    • DOI

      10.4018/ijdet.313639

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Effectiveness of viewer’s exeperience for features of eye movement in viewing football games2021

    • Author(s)
      篠田 瑞生、中山 実、伊藤 泉
    • Journal Title

      The Transactions of Human Interface Society

      Volume: 23 Issue: 1 Pages: 47-50

    • DOI

      10.11184/his.23.1_47

    • NAID

      130007991302

    • ISSN
      1344-7262, 2186-8271
    • Year and Date
      2021-02-25
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Evaluation of online team-based game development using SNS tools2021

    • Author(s)
      Akiko Teranishi, Minoru Nakayama, Theodor Wyeld, Mohamad A. Eid
    • Journal Title

      International Journal of Innovation and Learning

      Volume: 29(2) Pages: 181-206

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Influence of Task-evoked Mental Workloads on Oculo-motor indices and their connections2021

    • Author(s)
      Minoru Nakayama, Yoshiya Hayakawa
    • Journal Title

      EAI Trans. Context-aware Systems and Application

      Volume: 7(23) Issue: 23 Pages: 1-10

    • DOI

      10.4108/eai.4-2-2021.168649

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Detection procedures for patients of Alzheimer’s disease using waveform features of pupil light reflex in response to chromatic stimuli2020

    • Author(s)
      Wioletta Nowak, Minoru Nakayama, Tomasz Krecicki, Andrzej Hachol
    • Journal Title

      EAI Endorsed Transactions on Pervasive Health and Technology

      Volume: 6(23) Issue: 24 Pages: 1-11

    • DOI

      10.4108/eai.17-12-2020.167656

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Cognitive Load Estimation of Speech-in-Noise Recall Task with State-Space Models2023

    • Author(s)
      Mateusz Dubiel, Minoru Nakayama, Xin Wang
    • Organizer
      電子情報通信学会HIP研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 図形探索課題での眼球情報を用いた注意資源モデリングと実験要因の評価2023

    • Author(s)
      中山実, 岡野友美
    • Organizer
      HCGシンポジウム2023
    • Related Report
      2022 Annual Research Report
  • [Presentation] ポーカにおけるプレイヤ間での報酬期待が瞳孔運動に及ぼす影響2023

    • Author(s)
      安田凌, 中山実
    • Organizer
      HCGシンポジウム2023
    • Related Report
      2022 Annual Research Report
  • [Presentation] Research on Time Series Evaluation of Cognitive Load Factors using Features of Eye Movement2022

    • Author(s)
      Tomomi Okano, Minoru Nakayama
    • Organizer
      ACM ETRA 2022 / COGAIN workshop 2022
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Predicting individual sentiment for emotion-evoking pictures using metrics of oculo-motors,2022

    • Author(s)
      Minoru Nakayama
    • Organizer
      Invormation Visualisation
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Esitimation of reading ability of program codes using features of eye movements2021

    • Author(s)
      Hiroto Harada, Minoru Nakayama
    • Organizer
      ACM ETRA 2021 / EMIP workshop 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effects of measurement time and presentation size conditions on biometric identification using eye movements2021

    • Author(s)
      Yudai Niitsu, Minoru Nakayama
    • Organizer
      ACM ETRA 2021 / EyeSec workshop 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimating Ability of Programming Skills using IRT based Peer Assessments2021

    • Author(s)
      Minoru Nakayama, Masaki Uto, Marco Temperini, Filippo Sciarrone
    • Organizer
      ITHET / IEETel 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Eye movement features in response to comprehension performance during the reading of programs2020

    • Author(s)
      Hiroto Harada, Minoru Nakayama
    • Organizer
      ACM ETRA2020, EMIP-WS
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimating Student’s Performance Based on Item Response Theory in a MOOC Environment with Peer Assessment2020

    • Author(s)
      Minoru Nakayama, Filippo Sciarrone, Masaki Uto, Marco Temperini
    • Organizer
      Methodologies and Intelligent Systems for Technology Enhanced Learning (Mis4TEL)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Impact of the number of peers on a mutual assessment as learner’s performance in a simulated MOOC environment using the IRT model2020

    • Author(s)
      Minoru Nakayama, Filippo Sciarrone, Masaki Uto, Marco Temperini
    • Organizer
      Information Visualisation2020
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Deviations of eye movements and head rotation during response tasks using targets and HMD2020

    • Author(s)
      Taijiro Shiraishi, Minoru Nakayama
    • Organizer
      Information Visualisation2020
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Book] Pupil Reactions in Response to Human Mental Activity2021

    • Author(s)
      Minoru Nakayama
    • Total Pages
      106
    • Publisher
      Springer Singapore
    • ISBN
      9789811617218
    • Related Report
      2021 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi