• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Developing Fast Machine Learning Algorithm based on Auxiliary Function-based Optimization Approach

Research Project

Project/Area Number 26540090
Research Category

Grant-in-Aid for Challenging Exploratory Research

Allocation TypeMulti-year Fund
Research Field Perceptual information processing
Research InstitutionNational Institute of Informatics

Principal Investigator

ONO Nobutaka  国立情報学研究所, 情報学プリンシプル研究系, 准教授 (80334259)

Project Period (FY) 2014-04-01 – 2016-03-31
Project Status Completed (Fiscal Year 2015)
Budget Amount *help
¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2015: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2014: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords深層学習 / 補助関数法 / ニューラルネットワーク / 最適化 / パターン認識 / バックプロパゲーション / 補助関数
Outline of Final Research Achievements

We derived a quadratic auxiliary function with a look-up table for 2-layer neural network with a tangent hyperbolic activation function. Also, for training multi-layer neural network, we showed the auxiliary function could be designed from the output to the input recursively, and improved the algorithm based on a new concept of “back propagation of target”. By experiments with MIST handwritten digit database, we showed the derived algorithm needed much less iterations for convergence than a conventional adaptive gradient method.

Report

(3 results)
  • 2015 Annual Research Report   Final Research Report ( PDF )
  • 2014 Research-status Report
  • Research Products

    (3 results)

All 2016 2015 Other

All Int'l Joint Research (1 results) Journal Article (2 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 1 results,  Acknowledgement Compliant: 2 results)

  • [Int'l Joint Research] INRIA-NANCY(フランス)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] 二次補助関数を用いたニューラルネットワークの高速学習則の検討2016

    • Author(s)
      小野順貴
    • Journal Title

      電子情報通信学会技術研究報告

      Volume: IEICE-115 Pages: 361-366

    • Related Report
      2015 Annual Research Report
    • Acknowledgement Compliant
  • [Journal Article] Fast DNN Training Based on Auxiliary Function Technique2015

    • Author(s)
      Dung Tran, Nobutaka Ono and Emmanuel Vincent
    • Journal Title

      Proc. ICASSP

      Volume: - Pages: 2160-2164

    • DOI

      10.1109/icassp.2015.7178353

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant

URL: 

Published: 2014-04-04   Modified: 2017-05-10  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi