• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on model selection of multi-layer perceptron

Research Project

Project/Area Number 21500215
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionMie University

Principal Investigator

HAGIWARA Katsuyuki  三重大学, 教育学部, 准教授 (60273348)

Project Period (FY) 2009 – 2011
Project Status Completed (Fiscal Year 2011)
Budget Amount *help
¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Fiscal Year 2011: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2010: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2009: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords多層パーセプトロン / 特異モデル / モデル選択 / 可変基底 / ノンパラメトリック回帰 / 基底可変型関数 / 極値理論 / 汎化誤差 / 学習理論 / 学習誤差 / Hard-thresholding法
Research Abstract

In this research, we focus on a variability of basis functions in multi-layer perceptron and establish a model selection method for the case where basis functions are selected from a finite set of functions, in which the number of candidates is equal to the number of data. In the proposed method, functions in the set are orthogonalized and their coefficients are estimated. Inefficient coefficients are set to zero by thresholding. Then inverse transform yields the weights of original basis functions. The threshold level in this method is theoretically reasonable since it derived based on the variability of basis functions. We can obtain a smooth output and/or sparse representation depending on the method of orthogonalization. The method is applicable to multi-layer perceptron under a certain training algorithm.

Report

(4 results)
  • 2011 Annual Research Report   Final Research Report ( PDF )
  • 2010 Annual Research Report
  • 2009 Annual Research Report
  • Research Products

    (9 results)

All 2011 2010 2009 Other

All Journal Article (5 results) (of which Peer Reviewed: 5 results) Presentation (3 results) Remarks (1 results)

  • [Journal Article] Nonparametric regression method based on orthogonalization and thresholding2011

    • Author(s)
      K. Hagiwara
    • Journal Title

      IEICE Trans. INF. & SYST.

      Volume: E94-D Pages: 1610-1619

    • NAID

      10030192519

    • Related Report
      2011 Final Research Report
    • Peer Reviewed
  • [Journal Article] Nonparametric Regression Method Based on Orthogonalization and Thresholding2011

    • Author(s)
      Katsuyuki Hagiwara
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E94-D Issue: 8 Pages: 1610-1619

    • DOI

      10.1587/transinf.E94.D.1610

    • NAID

      10030192519

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] On a training scheme based on orthogonalization and thresholding for a nonparametric regression problem2010

    • Author(s)
      Katsuyuki Hagiwara
    • Journal Title

      Proc.of WCCI 2010 IEEE World Congress on Computational Intelligence

      Pages: 3131-3138

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Orthogonalization and thresholding method for a nonparametric regression problem2009

    • Author(s)
      K. Hagiwara
    • Journal Title

      Adovances in Neuro-Information Processing, Lecture Notes in Computer Science

      Volume: 5507 Pages: 187-194

    • NAID

      110008096179

    • Related Report
      2011 Final Research Report
    • Peer Reviewed
  • [Journal Article] Orthogonalization and Thresholding Method for a Nonparametric Regression Problem'2009

    • Author(s)
      Hagiwara, K
    • Journal Title

      Lecture Notes in Computer Science 5507

      Pages: 187-194

    • NAID

      110008096179

    • Related Report
      2009 Annual Research Report
    • Peer Reviewed
  • [Presentation] Orthogonalization and thresholding method for a nonparametric regression problem2010

    • Author(s)
      萩原克幸
    • Organizer
      電子情報通信学会 情報論的学習理論と機械学習
    • Place of Presentation
      東京大学 生産技術研究所
    • Year and Date
      2010-06-14
    • Related Report
      2010 Annual Research Report
  • [Presentation] Orthogonalization and thresholding method for a nonparameteric regression problem2010

    • Author(s)
      萩原克幸
    • Organizer
      電子情報通信学会技術研究報告
    • Related Report
      2011 Final Research Report
  • [Presentation] On a training scheme based on orthogonalization and thresholding for a nonparametric regression problem2010

    • Author(s)
      K. Hagiwara
    • Organizer
      Proc. of IJCNN 2010
    • Place of Presentation
      Barcelona, Spain
    • Related Report
      2011 Final Research Report
  • [Remarks]

    • URL

      http://sunflower.edu.mie-u.ac.jp/~hagi

    • Related Report
      2011 Final Research Report

URL: 

Published: 2009-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi