• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Creation of a voice user interface for entering equations on smart devices

Research Project

Project/Area Number 16K16178
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Learning support system
Research InstitutionOsaka University (2018)
Mukogawa Women's University (2016-2017)

Principal Investigator

Shizuka Shirai  大阪大学, サイバーメディアセンター, 講師 (30757430)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2018: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2017: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2016: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywordseラーニング / オンラインテスト / 音声入力 / 数式入力 / 数学オンラインテスト / 学習支援システム / ユーザインタフェース / 音声等入力 / ユーザインターフェース / 音声等認識 / ユーザビリティ / インタフェース
Outline of Final Research Achievements

In this research project, we propose a voice input interface for entering equations into mathematics e-learning systems. Current input interfaces of mathematics e-learning systems are cumbersome, especially for novice learners. In addition, most existing equation editors have not been developed for use in smart devices. To improve this issue, we have developed an intelligent mathematical input interface for smart devices based on a math input method that allows users to input mathematical expressions by using colloquial-style linear strings. The results of the evaluation of usability show that the proposed input interface allows for a mean of approximately 1.3 times faster than the standard interfaces. Moreover, we also have developed a voice input feature and implemented it.

Academic Significance and Societal Importance of the Research Achievements

スマートデバイスにおける数式入力方法の改善のために,学習者の経験値を活かした自然な入力方法として音声入力に着目し,その実現可能性を示したことである。提案インタフェースはディスプレイサイズに影響されず数式入力が可能なため,従来は学習環境になり得なかった環境においても数学学習の機会を提供できるようになり,数学eラーニングの促進に繋がると考える。また,提案インタフェースを教育者・研究者へ提供することで,新たな学習モデルや教授法の開発研究にも寄与できると期待される。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (16 results)

All 2019 2018 2017 2016 Other

All Journal Article (6 results) (of which Peer Reviewed: 4 results,  Open Access: 2 results,  Acknowledgement Compliant: 1 results) Presentation (9 results) (of which Int'l Joint Research: 5 results) Remarks (1 results)

  • [Journal Article] 数式曖昧入力変換方式による音声入力機能の開発2019

    • Author(s)
      白井 詩沙香, 福井 哲夫
    • Journal Title

      教育学習支援情報システム(CLE)研究報告

      Volume: 2019-CLE-27 Pages: 1-4

    • Related Report
      2018 Annual Research Report
  • [Journal Article] Evaluation of Intelligent Input Interface for Entering Equations on Smartphone2019

    • Author(s)
      Shizuka Shirai, Tetsuo Fukui
    • Journal Title

      IUI '19: Proceedings of the 24th International Conference on Intelligent User Interfaces

      Volume: - Pages: 9-10

    • DOI

      10.1145/3308557.3308687

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 数式曖昧入力変換方式による数式入力インタフェースのスマートデバイス向けUIの試作2018

    • Author(s)
      白井 詩沙香, 福井 哲夫
    • Journal Title

      第43回教育システム情報学会 全国大会論文集

      Volume: - Pages: 277-278

    • Related Report
      2018 Annual Research Report
    • Open Access
  • [Journal Article] Intelligent Editor for Authoring Educational Materials in Mathematics e-Learning Systems2018

    • Author(s)
      Shizuka Shirai, Tetsuo Fukui, Kentaro Yoshitomi, Mitsuru Kawazoe, Takahiro Nakahara, Yasuyuki Nakamura, Katsuya Kato, Tetsuya Taniguchi
    • Journal Title

      International Congress on Mathematical Software 2018, Lecture Notes in Computer Science

      Volume: 10931 Pages: 431-437

    • DOI

      10.1007/978-3-319-96418-8_51

    • ISBN
      9783319964171, 9783319964188
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Predictive Algorithm for Converting Linear Strings to General Mathematical Formulae2017

    • Author(s)
      Tetsuo Fukui and Shizuka Shirai
    • Journal Title

      Human Interface and the Management of Information: Supporting Learning, Decision-Making and Collaboration, Lecture Notes in Computer Science, Springer

      Volume: 10274 Pages: 15-28

    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Journal Article] MathTOUCH: Mathematical Input Interface for E-Assessment Systems2016

    • Author(s)
      S. Shirai and T. Fukui
    • Journal Title

      MSOR Connections

      Volume: 15 Pages: 70-75

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] 数式曖昧入力変換方式による音声入力機能の開発2019

    • Author(s)
      白井 詩沙香, 福井 哲夫
    • Organizer
      第27回 情報処理学会教育学習支援情報システム(CLE)研究発表会
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Evaluation of intelligent input interface for entering equations on smartphone2019

    • Author(s)
      Shizuka Shirai and Tetsuo Fukui
    • Organizer
      IUI ’19
    • Related Report
      2018 Annual Research Report
  • [Presentation] 数式曖昧入力変換方式による数式入力インタフェースのスマートデバイス向けUIの試作2018

    • Author(s)
      白井 詩沙香, 福井 哲夫
    • Organizer
      第43回教育システム情報学会 全国大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Intelligent Editor for Authoring Educational Materials in Mathematics e-Learning Systems2018

    • Author(s)
      Shizuka Shirai, Tetsuo Fukui, Kentaro Yoshitomi, Mitsuru Kawazoe, Takahiro Nakahara, Yasuyuki Nakamura, Katsuya Kato and Tetsuya Taniguchi
    • Organizer
      International Congress on Mathematical Software 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 数式予測アルゴリズムを実装した数式入力インタフェースMathTOUCHの試作と評価2017

    • Author(s)
      白井詩沙香,福井哲夫
    • Organizer
      情報処理学会 コンピュータと教育研究会 139回研究発表会
    • Place of Presentation
      津田塾大学(東京都・小平市)
    • Year and Date
      2017-03-11
    • Related Report
      2016 Research-status Report
  • [Presentation] Predictive Algorithm for Converting Linear Strings to General Mathematical Formulae2017

    • Author(s)
      Tetsuo Fukui and Shizuka Shirai
    • Organizer
      HCI International 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] MATHTOUCH: Mathematical Input Interface for E-Assessment Systems2016

    • Author(s)
      S. Shirai and T. Fukui
    • Organizer
      The international conference on E-Assessment in Mathematical Sciences 2016 (EAMS 2016)
    • Place of Presentation
      Newcastle upon Tyne, United Kingdom
    • Year and Date
      2016-09-13
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 多種ある数式自動採点システムの統一的解答入力の提案2016

    • Author(s)
      白井詩沙香,福井哲夫
    • Organizer
      2016 PC Conference
    • Place of Presentation
      大阪大学(大阪府・吹田市)
    • Year and Date
      2016-08-10
    • Related Report
      2016 Research-status Report
  • [Presentation] MATHTOUCH WEB: ONLINE MATH INPUT EDITOR FOR INTERACTIVELY CONVERTING LINEAR STRINGS2016

    • Author(s)
      S. Shirai and T. Fukui
    • Organizer
      13th International Congress on Mathematical Education (ICME-13)
    • Place of Presentation
      Hamburg, Germany
    • Year and Date
      2016-07-24
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Remarks] MathTOUCH

    • URL

      http://math.mukogawa-u.ac.jp

    • Related Report
      2016 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi