• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on the Handwriting Trajectory Reconstruction and Recognition with Wearable Sensing Method

Research Project

Project/Area Number 18K11400
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 61020:Human interface and interaction-related
Research InstitutionThe University of Aizu

Principal Investigator

Jing Lei  会津大学, コンピュータ理工学部, 上級准教授 (30595509)

Co-Investigator(Kenkyū-buntansha) 裴 岩 (裴岩)  会津大学, コンピュータ理工学部, 准教授 (30736004)
Project Period (FY) 2018-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2021: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2020: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2019: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2018: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Keywords手書き認識 / wearable computing / handwriting tracking / data fusion / データグローブ / ウェアラブルデバイス / tracking / GNN / handwriting / segmentation
Outline of Final Research Achievements

A Wearable HandWriting Recognition (WHWR) System is developed.
1. Through continuous testing on the prototypes of the WHWR sensor node, we have successfully developed a tiny size wearable sensor node. Moreover, the powering issues, which arose from the deployment constrains on the finger nail, have been solved as well. 2. A database for the handwriting data management is developed, together with a visualization function of the data waveforms and the 3D demonstration on the handwriting trajectory, which greatly improve the efficiency of the data analysis. 3. DTW (CDP) is adopted for the segmentation on the continuous handwriting and kernal SVM is adopted for the handwriting characters recognition, which accuracy is about 97% on a 10 digits data set.

Academic Significance and Societal Importance of the Research Achievements

申請者はICDAR17に提案したウェアラブル手書き認識方式(WHWR)を指先に付けられる手書き動作記録装置、およびそれに適用できる認識手法の研究開発によって、発展させました。
「筆記」は、空間と時代を超えて、人間同士がコミュニケーションするために欠かせない手段である。 WHWRは既存の手書き認識手法と比べて、任意のペン、あるいは指だけで、自由なスペースで入力できること、さらに、アナログおよびデジタルの情報を同時に記録できることが独自の優れた特徴である。WHWRを発展させ、筆記データのシームレスなデジタル化を実現し、新たな筆記方式の創出に貢献することが期待できる。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • Research Products

    (29 results)

All 2022 2021 2020 2019 2018 Other

All Int'l Joint Research (2 results) Journal Article (3 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 3 results,  Open Access: 3 results) Presentation (19 results) (of which Int'l Joint Research: 16 results,  Invited: 3 results) Remarks (3 results) Patent(Industrial Property Rights) (2 results)

  • [Int'l Joint Research] Franhofer IPA(ドイツ)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Fraunhofer IPA(ドイツ)

    • Related Report
      2018 Research-status Report
  • [Journal Article] Pedestrian Dead Reckoning with Low-Cost Foot-Mounted IMU Sensor2022

    • Author(s)
      Yamagishi Shunsei、Jing Lei
    • Journal Title

      Micromachines

      Volume: 13 Issue: 4 Pages: 610-610

    • DOI

      10.3390/mi13040610

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Lightweight Long and Short-Range Spatial-Temporal Graph Convolutional Network for Skeleton-Based Action Recognition2021

    • Author(s)
      Chen Hongbo、Li Menglei、Jing Lei、Cheng Zixue
    • Journal Title

      IEEE Access

      Volume: 9 Pages: 161374-161382

    • DOI

      10.1109/access.2021.3131809

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Lightweight Extended Kalman Filter for MARG Sensors Attitude Estimation2021

    • Author(s)
      Dai Zeyang、Jing Lei
    • Journal Title

      IEEE Sensors Journal

      Volume: 21 Issue: 13 Pages: 14749-14758

    • DOI

      10.1109/jsen.2021.3072887

    • Related Report
      2021 Annual Research Report 2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Skeleton-Based Sign Language Recognition With Graph Convolutional Networks on Small Data2022

    • Author(s)
      Y. Nakamura and L. Jing
    • Organizer
      the 24th International Conference on Human-Computer Interaction
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Light-weight Enhanced Semantics-Guided Neural Networks for Skeleton-Based Human Action Recognition2021

    • Author(s)
      H. Chen and L. Jing
    • Organizer
      the 14th IEEE International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Real-Time Lightweight Method to Detect the Sixteen Brushing Regions Based on a 9-axis Inertial Sensor and Random Forest Classifier2021

    • Author(s)
      H. Li and L. Jing
    • Organizer
      The 9th International Conference on Information Technology: IoT and Smart City
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] E-Textile-Based Tactile Sensor to Detect the Hand Strength Distribution for Preach Harvesting Training2021

    • Author(s)
      D. Miyada and L. Jing
    • Organizer
      the 23rd International Conference on Human-Computer Interaction
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Haptic Finger Glove for the VR Keyboard Input, " the 23rd International Conference on Human-Computer Interaction2021

    • Author(s)
      Y. Hoshi, C. Lu and L. Jing
    • Organizer
      the 23rd International Conference on Human-Computer Interaction
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Operation Efficiency Study on a New Cooperative VR Whiteboard System2021

    • Author(s)
      J. Wang and L. Jing
    • Organizer
      the 23rd International Conference on Human-Computer Interaction
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Toothbrush Force Measurement and 3D Visualization2021

    • Author(s)
      K. Sakuma, H. Li and L. Jing
    • Organizer
      the 23rd International Conference on Human-Computer Interaction
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Hand motion capture system based on multiple inertial sensors2020

    • Author(s)
      Lu Chenghong、Wang Jiangkun、Jing Lei
    • Organizer
      ACM Proceedings of the 18th Conference on Embedded Networked Sensor Systems (SenSys '20).
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Time Drift Compensation Method on Multiple Wireless Motion Capture Nodes2020

    • Author(s)
      Dai Zeyang、Lu Chenghong、Jing Lei
    • Organizer
      13th International Conference on Human System Interaction (HSI)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Real-Time Attitude Estimation of Sigma-Point Kalman Filter via Matrix Operation Accelerator2019

    • Author(s)
      Z. Dai and L. Jing
    • Organizer
      2019 IEEE 13th International Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Novel AR Whiteboard System and Usability Study2019

    • Author(s)
      J. Wang, T. Endo, C. Lu, L. Jing
    • Organizer
      2019 IEEE 8th Global Conference on Consumer Electronics (GCCE)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Time Drift Compensation Method on Multiple Wireless Motion Capture Nodes2019

    • Author(s)
      Z. Dai, C. Lu, and L. Jing
    • Organizer
      13th International Conference on Human System Interaction HSI 2020
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] WonderEngine: Architecture, Applications, and Open Issues2019

    • Author(s)
      Lei Jing
    • Organizer
      LPIC-CNVFAB Symposium
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Selection Issues of Kernel Function and Its Parameters of Hard Margin Support Vector Machine in a Real-world Handwriting Device2018

    • Author(s)
      Y. Pei, L. Jing
    • Organizer
      The 7th International Conference on Frontier Computing(FC2018) (Best Paper Award)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Learn to Capture the Body Motion with Inertial Sensing Method2018

    • Author(s)
      Lei Jing
    • Organizer
      IEEE 13th Interaltional Symposium on Embedded Multicore/Many-core Systems-on-Chip (MCSoC2018)
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Motion Capture Glove: An Intuitive Wearable Input Device2018

    • Author(s)
      Y. Suzuki, L. Jing
    • Organizer
      the 7th IEEE Global Conference on Consumer Electronics (GCCE18)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Wearable Input Device and Motion Capture2018

    • Author(s)
      Lei Jing
    • Organizer
      the 2nd UoA and YU Cooperative Research Seminar
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] A Study on Feature extraction of handwriting data using kernel method-based autoencoder2018

    • Author(s)
      Van Quan Dang and Yan Pei
    • Organizer
      9th IEEE International Conference on Awareness Science and Technology (iCAST 2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Chaotic Evolution with Random Crossover Rate in Single Objective Optimization Problems2018

    • Author(s)
      Yan Pei, and Jianqiang Li
    • Organizer
      9th International Conference on Information Technology in Medicine and Education
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Remarks] 研究室ホームページ

    • URL

      https://u-aizu.ac.jp/~leijing/

    • Related Report
      2021 Annual Research Report
  • [Remarks] 研究室ホームページ(手書きプロジェクトを載せたページ)

    • URL

      https://www.u-aizu.ac.jp/~leijing/research/

    • Related Report
      2020 Research-status Report 2019 Research-status Report
  • [Remarks] 研究室ホームページ

    • URL

      http://www.u-aizu.ac.jp/~JLab/

    • Related Report
      2018 Research-status Report
  • [Patent(Industrial Property Rights)] 特許権2019

    • Inventor(s)
      荊雷
    • Industrial Property Rights Holder
      荊雷
    • Industrial Property Rights Type
      特許
    • Filing Date
      2019
    • Acquisition Date
      2020
    • Related Report
      2020 Research-status Report
  • [Patent(Industrial Property Rights)] 特許権2018

    • Inventor(s)
      荊 雷
    • Industrial Property Rights Holder
      荊 雷
    • Industrial Property Rights Type
      特許
    • Filing Date
      2018
    • Acquisition Date
      2021
    • Related Report
      2021 Annual Research Report

URL: 

Published: 2018-04-23   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi