• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on Appropriate Image Recommendation for Vocabulary Learning using Educational Big Data and Image Analysis

Research Project

Project/Area Number 19K20941
Project/Area Number (Other) 18H05745 (2018)
Research Category

Grant-in-Aid for Research Activity Start-up

Allocation TypeMulti-year Fund (2019)
Single-year Grants (2018)
Review Section :Education and related fields
Research InstitutionTokyo University of Agriculture and Technology (2019)
Kyoto University (2018)

Principal Investigator

Hasnine Nehal  東京農工大学, 工学(系)研究科(研究院), 特任助教 (30827720)

Project Period (FY) 2018-08-24 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2019: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Keywordsユビキタス学習 / ライフログ画像分析 / 教育ビッグデータ / 語彙学習 / Image recommendation / Learning analytics / Ubiquitous learning / Word-to-image / Society 5.0 / Cyber-physical space / Image Analytics / Educational Big Data / Vocabulary Learning / Learning Analytics / Language Learning / 単語学習 / 画像推薦 / ラーニングアナリテイクス / ユビキタス語彙学習 / 画帖推薦 / 教育ビッグデータ分析 / ラーニングアナリティクス
Outline of Research at the Start

本研究では,語学学習支援システムを用いて収集することができる教育ビッグデータを用いて,学習者の現在のコンテキストに応じた適切な画像を推薦する,Feature-based Context-specific AppropriateImages (FCAI)方式を提案する.このFCAI は,ユビキタス学習環境内で収集した教育ビッグデータ内に含まれる単語,時間,場所,語彙レベルや画像から,学習者のコンテキストに応じて,適切な学習教材を推薦することで,学習者の語彙能力向上を目指す.

Outline of Final Research Achievements

In this research, lifelog images are analyzed for recommending Feature-based Context-specific Appropriate Images (FCAI) images. FCAI images are determined according to the foreign language learners' current context by using educational big data that are collected from a language learning support system. We proposed a Distributed Semantic Model(DSM) for analyzing lifelog images. We also analyzed words, time, place, vocabulary level and images as the educational big data from SCROLL(System for Capturing and Reminding Learning Log) server. The outcomes of this project are- 1) the creation of a small-scale wordbank using NLP techniques, 2) the development of image analysis tools where AI-based methods are leveraged, and 3) the development of recommendation tools called LFO panels that can recommend authentic and partially-authentic logs to foreign language learners.

Academic Significance and Societal Importance of the Research Achievements

この研究は, CALL,mラーニング,ライフログ画像分析,ユビキタス学習,外国語語彙学習など研究分野に大きく貢献します. この研究は, 言語学習におけるapplied AIの採用を促進します. さらに、この研究は、Society 5.0言語学習のギャップを埋めるのに役立ちます. 関連する科学団体(APSEC,SOLAR,AACE, IIAI AAIなど)からこの研究について肯定的なフィードバックを受けました.

Report

(3 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Annual Research Report
  • Research Products

    (29 results)

All 2020 2019 2018

All Journal Article (3 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 3 results,  Open Access: 1 results) Presentation (26 results) (of which Int'l Joint Research: 25 results,  Invited: 2 results)

  • [Journal Article] Closing the Experiential Learning Loops using Learning Analytics Cycle: Towards Authentic Experience Sharing for Vocabulary Learning2020

    • Author(s)
      Mohammad Nehal Hasnine, Hiroaki Ogata, Gokhan Akcapinar, Kousuke Mouri, and Keiichi Kaneko
    • Journal Title

      International Journal of Distance Education Technologies

      Volume: 18 Pages: 1-23

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Developing an Early-Warning System for Spotting At-Risk Students by using eBook Interaction Logs2019

    • Author(s)
      Gokhan Akcapinar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan and Hiroaki Ogata
    • Journal Title

      Smart Learning Environments

      Volume: 6 Pages: 1-15

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] An Automatic Quiz Generation System Utilizing Digital Textbook Logs2019

    • Author(s)
      Kousuke Mouri, Noriko Uosaki, Mohammad Nehal Hasnine,Chengjiu Yin, Keiichi Kaneko and Hiroaki Ogata
    • Journal Title

      In the Journal of Interactive Learning Environment

      Volume: 27 Pages: 1-14

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Vocabulary Learning Support System based on Automatic Image Captioning Technology2019

    • Author(s)
      Mohammad Nehal Hasnine, Brendan Flanagan, Gokhan Akcapinar, Kousuke Mouri, and Hiroaki Ogata
    • Organizer
      HCI International 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] eamless Collaborative Learning Method to Learn Business Japanese with eBook and Chat System2019

    • Author(s)
      Noriko Uosaki, Kousuke Mouri, Mohammad Nehal Hasnine, Chengjiu Yin, and Hiroaki Ogata
    • Organizer
      HCI International 2019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Identifying Reading Styles from E-book Log Data2019

    • Author(s)
      Ivica Boticki, Hiroaki Ogata, Karla Tomiek, Gokhan Akcapinar, Brendan Flanagan, Rwitajit Majumdar and Mohammad Nehal Hasnine
    • Organizer
      27th Int’l Conference on Computer in Education (ICCE2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Exploring the Relationships between Students' Engagement and Academic Performance in the Digital Textbook System2019

    • Author(s)
      Gokhan Akcapinar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan and Hiroaki Ogata
    • Organizer
      27th Int’l Conference on Computer in Education (ICCE2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Supporting Ubiquitous Language Learning with Object and Text Detection Technologies2019

    • Author(s)
      Kousuke Mouri, Noriko Uosaki, Chengjiu Yin, Atsushi Shimada, Mohammad Nehal Hasnine, Keiichi Kaneko and Hiroaki Ogata
    • Organizer
      27th Int’l Conference on Computer in Education (ICCE2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Prototyping an Interactive Dashboard for Word-picture Association Visualization using Educational Big Data for Facilitating Picture-assisted Language Learning2019

    • Author(s)
      Mohammad Nehal Hasnine, Runyaporn Supharatraveekul, Gokhan Akcapinar, Mouri Kousuke, and Keiichi Kaneko
    • Organizer
      International Conference on Instructional Technology and Teacher Education
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] E-book Data Analysis In The Context Of Learning Analytics: The Example Of Bookroll2019

    • Author(s)
      Gokhan Akcapinar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan, Hiroaki Ogata
    • Organizer
      International Conference on Instructional Technology and Teacher Education
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Design of a Location-based Word Recommendation System based on Association Rule Mining Analysis2019

    • Author(s)
      Mohammad Nehal Hasnine, Gokhan Akcapinar, Brendan Flanagan, Kousuke Mouri, Hiroaki Ogata, Keiichi Kaneko and Noriko Uosaki
    • Organizer
      8th International Conference on Learning Technologies and Learning Environments (LTLE2019)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Bridging In-class and Real-life Vocabulary Learning using a Mobile Learner-generated Content Tool: A Case Study2019

    • Author(s)
      Yanjie Song, Ka Man Lung, Hiroaki Ogata, Yin Yang, Mohammad Nehal Hasnine and Kosuke Mouri
    • Organizer
      23rd Global Chinese Conference on Computers in Education (GCCCE)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Using Learning Analytics to Detect Off-Task Reading Behaviors2019

    • Author(s)
      Gokhan Akcapinar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan and Hiroaki Ogata
    • Organizer
      Workshop on Reading Behavior Analytics (EBELA-Asia)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Analyzing SCROLL Dataset to Discover Word Co-occurence Information using Text Mining Methods2019

    • Author(s)
      Mohammad Nehal Hasnine, Gokhan Akcapinar, Brendan Flanagan and Hiroaki Ogata
    • Organizer
      Workshop on Reading Behavior Analytics (EBELA-Asia)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Identification of the Vocabulary Needed to Foster Self-expression in Syrian Refugees in Lebanon2019

    • Author(s)
      Victoria Abou-Khalil, Brendan Flanagan, Mohammad Nehal Hasnine and Hiroaki Ogata
    • Organizer
      9th International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Using Learning Analytics to Detect Off-Task Student Behaviors in Classroom during the Reading Task2019

    • Author(s)
      Gokhan Akcapinar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan and Hiroaki Ogata
    • Organizer
      9th International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Learning Analytics to Share and Reuse Authentic Learning Experiences in a Seamless Learning Environment2019

    • Author(s)
      Mohammad Nehal Hasnine, Hiroaki Ogata, Gokhan Akcapinar, Kousuke Mouri and Noriko Uosaki
    • Organizer
      9th International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Platform for Image Recommendation in Foreign Word Learning2019

    • Author(s)
      Mohammad Nehal Hasnine, Brendan Flanagan, Masatoshi Ishikawa, Hiroaki Ogata, Kousuke Mouri and Keiichi Kaneko
    • Organizer
      9th International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2019 Annual Research Report
  • [Presentation] A Platform for Image Recommendation in Foreign Word Learning2019

    • Author(s)
      Mohammad Nehal Hasnine, Brendan Flanagan, Masatoshi Ishikawa, Hiroaki Ogata, Kousuke Mouri and Keiichi Kaneko
    • Organizer
      International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Learning Analytics to Share and Reuse Authentic Learning Experiences in a Seamless Learning Environment2019

    • Author(s)
      Mohammad Nehal Hasnine, Hiroaki Ogata, Gokhan Akcapinar, Kousuke Mouri and Noriko Uosaki
    • Organizer
      International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Identification of the Vocabulary Needed to Foster Self-expression in Syrian Refugees in Lebanon2019

    • Author(s)
      Victoria Abou-Khalil, Brendan Flanagan, Mohammad Nehal Hasnine and Hiroaki Ogata
    • Organizer
      International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Using Learning Analytics to Detect Off-Task Student Behaviors in Classroom during the Reading Task2019

    • Author(s)
      Gokhan Akcapinar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan and Hiroaki Ogata
    • Organizer
      International Conference on Learning Analytics & Knowledge (LAK19)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Distributional Semantics Model for Image Recommendation using Learning Analytics2018

    • Author(s)
      Mohammad Nehal Hasnine
    • Organizer
      International Conference on Computer in Education(ICCE2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Image Recommendation for Informal Vocabulary Learning in a Context-aware Learning Environment2018

    • Author(s)
      Mohammad Nehal Hasnine, Kousuke Mouri, Brendan Flanagan, Gokhan Akcapinar, Noriko Uosaki and Hiroaki Ogata
    • Organizer
      International Conference on Computer in Education(ICCE2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Final Scores Prediction over Clickstream Using Machine Learning Methods2018

    • Author(s)
      Mohammad Nehal Hasnine, Gokhan Akcapinar, Brendan Flanagan, Rwitajit Majumdar, Kousuke Mouri and Hiroaki Ogata
    • Organizer
      International Conference on Computer in Education(ICCE2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Beyond Learning Analytics: Research Pathway for Evidence-Based Education and Learning2018

    • Author(s)
      Hiroaki Ogata, Rwitajit Majumdar, Gokhan Akcapinar, Mohammad Nehal Hasnine and Brendan Flanagan
    • Organizer
      International Conference on Computer in Education(ICCE2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] SCROLL Dataset in the Context of Ubiquitous Language Learning2018

    • Author(s)
      Hiroaki Ogata, Noriko Uosaki, Kousuke Mouri, Mohammad Nehal Hasnine, Victoria Abou-Khalil, and Brendan Flanagan
    • Organizer
      International Conference on Computer in Education(ICCE2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Seamless Learning Infrastructure for Finding Relationships Between Lecture and Practical Training2018

    • Author(s)
      Kousuke Mouri, Mohammad Nehal Hasnine, Takafumi Tanaka, Noriko Uosaki and Hiroaki Ogata
    • Organizer
      International Conference on Computer in Education(ICCE2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Supporting Teaching and Learning with Automatically Generated Quiz System2018

    • Author(s)
      Kousuke Mouri, Noriko Uosaki, Mohammad Nehal Hasnine, Chengjiu Yin, Keiichi Kaneko and Hiroaki Ogata
    • Organizer
      World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2018-08-27   Modified: 2024-03-26  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi