• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Small-sample Deep Learning Method Based on Analytic Initialization of Convolutional Layers

Research Project

Project/Area Number 26730085
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionThe University of Tokyo

Principal Investigator

Nakayama Hideki  東京大学, 情報理工学(系)研究科, 講師 (00643305)

Project Period (FY) 2014-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2015: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2014: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Keywords深層学習 / ディープラーニング / 画像認識 / 畳み込みニューラルネットワーク / 表現学習 / 人工知能 / 少サンプル学習
Outline of Final Research Achievements

We proposed a new deep learning methodology that enable fast and stable learning from limited amount training examples. We stacked convolutional layers using discriminative analytic solutions obtained by Fisher weight map to build multi-layer convolutional neural networks. Then we further fine tune the entire network by means of the standard backpropagation to quickly reach better local minima. Proposed method achieved state-of-the-art classification accuracy on some standard benchmarks, namely MNIST and STL-10.

Report

(3 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Research-status Report
  • Research Products

    (14 results)

All 2016 2015 2014

All Journal Article (3 results) (of which Peer Reviewed: 3 results,  Acknowledgement Compliant: 3 results,  Open Access: 1 results) Presentation (10 results) (of which Int'l Joint Research: 2 results,  Invited: 3 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Efficient Two-Step Middle-Level Part Feature Extraction for Fine-Grained Visual Categorization2016

    • Author(s)
      Hideki Nakayama, Tomoya Tsuda
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E99.D Issue: 6 Pages: 1626-1634

    • DOI

      10.1587/transinf.2015EDP7358

    • NAID

      130005154735

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Image-mediated Learning for Zero-shot Cross-lingual Document Retrieval2015

    • Author(s)
      Ruka Funaki, Hideki Nakayama
    • Journal Title

      Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP)

      Volume: 1 Pages: 585-590

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Multimodal Gesture Recognition using Multi-stream Recurrent Neural Network2015

    • Author(s)
      Noriki Nishida, Hideki Nakayama
    • Journal Title

      Image and Video Technology, Lecture Notes in Computer Science (LNCS)

      Volume: 9431 Pages: 682-694

    • DOI

      10.1007/978-3-319-29451-3_54

    • ISBN
      9783319294506, 9783319294513
    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 正準重みマップを用いたCNNによる画像領域分割2016

    • Author(s)
      福田竣,指田岳彦,中山英樹
    • Organizer
      第22回画像センシングシンポジウム(SSII)
    • Place of Presentation
      パシフィコ横浜,神奈川県横浜市
    • Year and Date
      2016-06-08
    • Related Report
      2015 Annual Research Report
  • [Presentation] Zero-Shot 言語横断文書検索のための画像媒介学習2016

    • Author(s)
      舟木類佳,中山英樹
    • Organizer
      情報処理学会第78回全国大会
    • Place of Presentation
      慶應義塾大学矢上キャンパス,神奈川県横浜市
    • Year and Date
      2016-03-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] 深層一般化正準相関分析2016

    • Author(s)
      岩瀬智亮,中山英樹
    • Organizer
      情報処理学会第78回全国大会
    • Place of Presentation
      慶應義塾大学矢上キャンパス,神奈川県横浜市
    • Year and Date
      2016-03-10
    • Related Report
      2015 Annual Research Report
  • [Presentation] Multimodal Gesture Recognition using Multi-stream Recurrent Neural Network2015

    • Author(s)
      Noriki Nishida, Hideki Nakayama
    • Organizer
      Pacific Rim Symposium on Image and Video Technology
    • Place of Presentation
      オークランド,ニュージーランド
    • Year and Date
      2015-11-23
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Image-mediated Learning for Zero-shot Cross-lingual Document Retrieval2015

    • Author(s)
      Ruka Funaki, Hideki Nakayama
    • Organizer
      Conference on Empirical Methods in Natural Language Processing (EMNLP)
    • Place of Presentation
      リスボン,ポルトガル
    • Year and Date
      2015-09-17
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 深層畳み込みニューラルネットによる画像特徴抽出と転移学習2015

    • Author(s)
      中山英樹
    • Organizer
      情報処理学会 音声言語情報処理研究会
    • Place of Presentation
      上諏訪温泉
    • Year and Date
      2015-07-16 – 2015-07-17
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Deep Learningによる画像認識革命 -歴史・最新理論から実践応用まで-2015

    • Author(s)
      中山英樹
    • Organizer
      第21回 画像センシングシンポジウム (SSII) チュートリアルセッション
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2015-06-10 – 2015-06-12
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Extreme Learning Machineによる特徴抽出を用いた決定木とセマンティックセグメンテーションへの応用2015

    • Author(s)
      岩本恵太,中山英樹
    • Organizer
      第21回 画像センシングシンポジウム (SSII)
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2015-06-10 – 2015-06-12
    • Related Report
      2014 Research-status Report
    • Invited
  • [Presentation] Stacked local autocorrelation features2014

    • Author(s)
      Hideki Nakayama
    • Organizer
      Meeting on Image Recognition and Understanding (MIRU)
    • Place of Presentation
      岡山コンベンションセンター
    • Year and Date
      2014-07-28 – 2014-07-31
    • Related Report
      2014 Research-status Report
  • [Presentation] 階層フィッシャー重みマップを用いた識別的初期化による深層畳み込みニューラルネットワーク構築法2014

    • Author(s)
      中山英樹
    • Organizer
      第20回 画像センシングシンポジウム (SSII)
    • Place of Presentation
      パシフィコ横浜
    • Year and Date
      2014-06-11 – 2014-06-13
    • Related Report
      2014 Research-status Report
  • [Patent(Industrial Property Rights)] 画像を媒介した異言語文書間の学習法及び装置、言語横断文書検索方法及2015

    • Inventor(s)
      中山英樹,舟木類佳
    • Industrial Property Rights Holder
      東京大学
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2015-220107
    • Filing Date
      2015-11-10
    • Related Report
      2015 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2017-05-10  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi