• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Recognition of Cursive/Blind Kanji Handwriting Utilizing the Contuinous Speech Recognition Approach

Research Project

Project/Area Number 11480074
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionThe University of Tokyo (2001)
Japan Advanced Institute of Science and Technology (1999-2000)

Principal Investigator

SAGAYAMA Shigeki  Graduate School of Information Science and Technology, Professor, 大学院・情報理工学系研究科, 教授 (00303321)

Co-Investigator(Kenkyū-buntansha) TABARU Tetsuya  Graduate School of Information Science and Technology, Research Associate, 大学院・情報理工学系研究科, 助手 (90272393)
NAKAI Mitsuru  Japan Advanced Institute of Science and Technology, Graduate School of Information Science, Research Associate, 情報科学研究科, 助手 (60283149)
SHIMODAIRA Hiroshi  Japan Advanced Institute of Science and Technology, Graduate School of Information Science, Associate Professor, 情報科学研究科, 助教授 (30206239)
Project Period (FY) 1999 – 2001
Project Status Completed (Fiscal Year 2001)
Budget Amount *help
¥10,600,000 (Direct Cost: ¥10,600,000)
Fiscal Year 2001: ¥1,200,000 (Direct Cost: ¥1,200,000)
Fiscal Year 2000: ¥3,200,000 (Direct Cost: ¥3,200,000)
Fiscal Year 1999: ¥6,200,000 (Direct Cost: ¥6,200,000)
KeywordsOnline Handwriting Recognition / Cursive, Blind Writing / Continuous Speech Recognition Approach / Hidden Markov Model / Stroke-based Modeling / Hierarchical Kanji Structure Lexicon / Viterbi Algorithm / Handwritten by the Blind / 漢字データベース
Research Abstract

In this project, continuous speech recognition (CSR) approach was successfully applied to online handwriting recognition and produced enormous results. Replacing phonemes and grammar in CSR with 25 basic strokes and Kanji structure lexicon and utilizing highly advanced CSR techniques to make an efficient search in the solution space, the newly developed technology is able to recognize cursive and blind hand-written Kanji characters. By observing the velocity vector sequence of the pen movements, this technology estimates the intension of what Kanji character is being written instead of recognizing the drawn figure so that it may recognize heavily deformed characters even human can not read.
After establishing the above fundamental structure of the technology, we investigated a number of research items such as velocity-based features (comparing several feature parameters), pen pressure as a feature, stroke context-dependent modeling (considering stroke deformation caused by previous and following strokes), stroke macro model (adjacent strokes are combined to form a macro-stroke), adaptation to writers (adapting HMMs to the writer's characteristics), recognition of blind writing (written without seeing), recognizing overlapped writing (multiple characters on the same area), acceleration of recognition speed (improved search algorithm), curved strokes for numerics and Hirakana, and collection of cursive, blind writing and ones from blind people.
Utilizing the research results, our R&D proposal of "Handwritten Communication for the Blind" was approved by Ishikawa Prefecture with a support of 100 million yen. The two projects cooperated well with each other so that more than 1 million handwritten character data were collected including cursive, blind, and sight-impaired characters.

Report

(3 results)
  • 2001 Annual Research Report   Final Research Report Summary
  • 2000 Annual Research Report
  • Research Products

    (24 results)

All Other

All Publications (24 results)

  • [Publications] Mitsuru Nakai, Takashi Sudo, Hiroshi Shimodaira, Shigeki Sagayama: "Pen Pressure Features for Writer-Independent On-Line Handwriting Recognition Based on Substroke HMM"Proceedings of 2002 International Conference on Pattern Recognition (ICPR2002). Vol.III. 220-223 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Junko Tokuno, Nobuhito Inami, Shigeki Matsuda, Mitsuru Nakai, Hiroshi Shimodaira, Shigeki Sagayama: "Context-Dependent Substroke Model for HMM-based On-line Handwriting Recognition"Proceedings of 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR-8). (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 須藤 隆, 中井 満, 下平 博, 嵯峨山 茂樹: "ストロークHMMを用いたオンライン重ね書き文字列認識"電子情報通信学会技術研究報告. PRMU2001-265. 163-170 (2002)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Mitsuru Nakai, Naoto Akira, Hiroshi Shimodaira, Shigeki Sagayama: "Substroke Approach to HMM-based On-line Kanji Handwriting Recognition"Proceedings of 2001 International Conference on Document Analysis and Recognition (ICDAR'01). 491-495 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 秋良 直人, 中井 満, 下平 博, 嵯峨山 茂樹: "ストロークHMMを用いたオンライン非目視手書き文字認識の性能評価"電子情報通信学会技術研究報告. PRMU2000-206. 39-46 (2001)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 嵯峨山 茂樹, 中井 満, 下平 博: "ストロークHMMに基づくオンライン手書き文字認識方式"電子情報通信学会技術研究報告. PRMU2000-35. 1-8 (2000)

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Mitsuru Nakai, Takashi Sudo, Hiroshi Shimodaira, and Shigeki Sagayama: "Pen Pressure Features for Writer-Independent On-Line Handwriting Recognition Based on Substroke HMM"Proceedings of 2002 International Conference on Pattern Recognition (ICPR2002). III. 220-223 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Junko Tokuno, Nobuhito Inami, Shigeki Matsuda, Mitsuru Nakai, Hiroshi Shimodaira, and Shigeki Sagayama: "Context-Dependent Substroke Model for HMM-based On-line Handwriting Recognition"Proceedings of 8th International Workshop on Frontiers ia Handwriting Recognition (IWFHR-8). in CD-ROM. (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Takashi Sudo, Mitsuru Nakai, Hiroshi Shimodaira, Shigeki Sagayama: "On-line Overlapped Handwriting Recognition Based on Substroke HMM"IEICE Technical Report. PRMU2001-265. 163-170 (2002)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Mitsuru Nakai, Naoto Akira, Hiroshi Shimodaira, and Shigeki Sagayama: "Substroke Approach to HMM-based On-line Kanji Handwriting Recognition"Proceedings of 2001 International Conference on Document Analysis and Recognition (ICDAR'01). in CD-ROM. (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Naoto Akira, Mitsuru Nakai, Hiroshi Shimodaira, and Shigeki Sagayama: "On-line Handwritten Character Recognition based on Stroke-HMM in non Visual-feedback Writing Condition"IEICE Technical Report. PRMU2000-206. 39-46 (2001)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] Shigeki Sagayama, Mitsuru Nakai, and Hiroshi Shimodaira: "Online Hand-Written Character Recognition Based on Stroke HMMs"IEICE Technical Report. PRMU2000-35. 1-8 (2000)

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2001 Final Research Report Summary
  • [Publications] 秋良 直人, 中井 満, 下平 博, 嵯峨山 茂樹: "ストロークHMMを用いたオンライン非目視手書き文字認識の性能評価"電子情報通信学会技術報告 PRMU2000-206, Mar 2001. 39-46 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 徳野 淳子, 中井 満, 下平 博, 嵯峨山 茂樹, 細川 啓子: "視覚障害者を対象にしたストロークHMMオンライン文字認識方式の性能評価"電子情報通信学会技術報告 WIT2001-13, Aug 2001. 19-24 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] M.Nakai, N.Akira, H.Shimodaira, S.Sagayama: "Substroke Approach to HMM-based On-line Kanji Handwriting Recognition"Proceedings of ICDAR'01, Sep 2001. 491-495 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 須藤 隆, 中井 満, 下平 博, 嵯峨山 茂樹: "筆圧を利用したストロークHMMに基づくオンライン走り書き文字認識"平成13年電気関係学会北陸支部大会講演論文集, F-67, Oct 2001. 407-407 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 須藤 隆, 中井 満, 下平 博, 嵯峨山 茂樹: "筆圧情報を併用したストロークHMMに基づくオンライン文字認識"電子情報通信学会技術報告 PRMU2001-189, Dec 2001. 93-100 (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 須藤 隆, 中井 満, 下平 博, 嵯峨山 茂樹: "ストロークHMMを用いたオンライン重ね書き文字列認識"電子情報通信学会技術報告 PRMU2001-, Mar 2002. (2002)

    • Related Report
      2001 Annual Research Report
  • [Publications] 井波暢人,松田繁樹,中井満,下平博,嵯峨山茂樹: "環境依存型ストロークHMMを用いたオンライン手書き文字認識"信学技報,PRMU2000-135. 39-46 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 秋良直人,中井満,下平博,嵯峨山茂樹: "ストロークHMMに基づくオンライン手書き文字認識の特徴量の検討"信学技報,PRMU2000-134. 31-38 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 井波暢人,松田繁樹,中井満,下平博,嵯峨山茂樹: "環境依存型ストロークHMMによるオンライン手書き文字認識"平成12年電気関係学会北陸支部大会講演論文集,F-93. 394 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 秋良直人,中井満,下平博,嵯峨山茂樹: "ストロークHMMによるオンライン文字認識の特徴量の検討"平成12年電気関係学会北陸支部大会講演論文集,F-92. 393 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 嵯峨山茂樹,中井満,下平博: "ストロークHMMに基づくオンライン手書き文字認識方式"信学技報,PRMU2000-35. 1-8 (2000)

    • Related Report
      2000 Annual Research Report
  • [Publications] 中井満,嵯峨山茂樹,秋良直人,小場久雄,下平博: "ストロークHMMによるオンライン手書き文字認識の性能評価"信学技報,PRMU2000-36. 9-16 (2000)

    • Related Report
      2000 Annual Research Report

URL: 

Published: 1999-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi