• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2010 Fiscal Year Final Research Report

Development of Learning Theory based on Information Measure

Research Project

  • PDF
Project/Area Number 19300051
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionKyushu University

Principal Investigator

TAKEUCHI Junichi  Kyushu University, 大学院・システム情報科学研究院, 教授 (80432871)

Co-Investigator(Kenkyū-buntansha) TAKAHASHI Norikazu  九州大学, 大学院・システム情報科学研究院, 准教授 (60284551)
JITSUMATSU Yutaka  九州大学, 大学院・システム情報科学研究院, 准教授 (60336063)
川端 勉  電気通信大学, 電気通信学部, 教授 (50152997)
川喜田 雅則  九州大学, 大学院・システム情報科学研究院, 助教 (90435496)
香田 徹  九州大学, 大学院・システム情報科学研究院, 特任教授 (20038102)
Project Period (FY) 2007 – 2010
Keywords学習理論 / 情報量 / 情報幾何 / 機械学習
Research Abstract

We studied machine learning, information theory, and other related topics from a unified viewpoint of minimum description length principle (MDL principle). In particular, we obtained the new sight on the relation between geometrical structure of tree models and stochastic complexity (SC) and that between communication channel capacity and SC. We also studied ensemble learning and kernel method, and obtained efficient learning method for them. Further, on the basis of the fundamental knowledge obtained in this research, we proposed new learning based methods for incident detection in network security, universal portfolio, super resolution etc., and showed their efficiency.

  • Research Products

    (26 results)

All 2011 2010 2009 2008 2007 Other

All Journal Article (6 results) Presentation (17 results) Book (1 results) Remarks (1 results) Patent(Industrial Property Rights) (1 results)

  • [Journal Article] Stochastic complexity, channel capacity, and universal portfolio2010

    • Author(s)
      Takeuchi
    • Journal Title

      Journal of Math-for-Industry Vol.2, No.B

      Pages: 213-225

  • [Journal Article] Sufficient Conditions for One-Dimensional Cellular Neural Networks to Perform Connected Component Detection2010

    • Author(s)
      Takahashi, Ishitobi, Nishi
    • Journal Title

      Nonlinear Analysis : Real World Applications Vol.11

      Pages: 4202-4213

  • [Journal Article] Earthquake onset detection using spectro-ratio on multi-threshold time-frequency sub-band2009

    • Author(s)
      Hafez, Khan, Kohda
    • Journal Title

      Digital Signal Processing : A Review Journal Vol.19

      Pages: 118-126

  • [Journal Article] Global Convergence of SMO Algorithm for Support Vector Regression2008

    • Author(s)
      Takahashi, Guo, Nishi
    • Journal Title

      IEEE Trans. Neural Networks Vol.19

      Pages: 971-982

  • [Journal Article] Boosting method for local learning in statistical pattern recognition2008

    • Author(s)
      Kawakita, Eguchi
    • Journal Title

      Neural Computation Vol.20

      Pages: 2792-2838

  • [Journal Article] Properties of Jeffreys mixture for Markov sources

    • Author(s)
      Takeuchi, Kawabata, Barron
    • Journal Title

      IEEE trans. Inform. Theory 2007年受理

  • [Presentation] ベイズ超解像におけるSIFTを用いたパラメタ推定手法の提案2011

    • Author(s)
      清田、奥村、川喜田、高橋、竹内
    • Organizer
      電子情報通信学会技術研究報告 IE2010-168
    • Place of Presentation
      長崎県
    • Year and Date
      20110000
  • [Presentation] A note on model selection for small sample regression2010

    • Author(s)
      Kawakita, Oie, Takeuchi
    • Organizer
      International Symposium on Information Theory and its Applications
    • Place of Presentation
      Taichung, Taiwan
    • Year and Date
      20100000
  • [Presentation] A Revisit to The Muroga Method of Computing Channel Capacity2010

    • Author(s)
      Kawabata
    • Organizer
      International Symposium on Information Theory and its Applications
    • Place of Presentation
      Taichung, Taiwan
    • Year and Date
      20100000
  • [Presentation] Semi-supervised learning in view of estimating functions2010

    • Author(s)
      川喜田, 竹内
    • Organizer
      Information Geometry And Its Applications III
    • Place of Presentation
      Leipzig, Germany
    • Year and Date
      20100000
  • [Presentation] 通信路容量に関する情報幾何学的考察2010

    • Author(s)
      竹内、池田
    • Organizer
      第33回情報理論とその応用シンポジウム
    • Place of Presentation
      長野県
    • Year and Date
      20100000
  • [Presentation] ポートフォリオのFisher情報量について2010

    • Author(s)
      鶴崎、竹内
    • Organizer
      第33回情報理論とその応用シンポジウム
    • Place of Presentation
      長野県
    • Year and Date
      20100000
  • [Presentation] 揺らぎのあるニューラルネットワークにおける連想記憶2010

    • Author(s)
      前島、實松、香田
    • Organizer
      第33回情報理論とその応用シンポジウム
    • Place of Presentation
      長野県
    • Year and Date
      20100000
  • [Presentation] 特異事前分布をもつユニバーサル情報源符号の冗長度解析2010

    • Author(s)
      橋本, 川端
    • Organizer
      電子情報通信学会情報理論研究会
    • Place of Presentation
      長野県長野市
    • Year and Date
      20100000
  • [Presentation] β展開を用いたAD/DA変換の量子化誤差2010

    • Author(s)
      香田, 深江
    • Organizer
      電子情報通信学会情報理論研究会
    • Place of Presentation
      長野県長野市
    • Year and Date
      20100000
  • [Presentation] Fisher Information determinant and stochastic complexity for Markov Models2009

    • Author(s)
      竹内
    • Organizer
      Proc. of 2009 IEEE Intl Symp on Inform Theory
    • Place of Presentation
      韓国ソウル市
    • Year and Date
      20090600
  • [Presentation] A new method of improving predictive distribution without Bayes estimation2009

    • Author(s)
      川喜田, 竹内
    • Organizer
      第32回情報理論とその応用シンポジウム
    • Place of Presentation
      山口県山口市
    • Year and Date
      20090000
  • [Presentation] An Incident Analysis System nicter and Its Analysis engines Based on Data Mining Techniques2008

    • Author(s)
      Inoue, Yoshioka, Eto, Yamagata, Nishino, Takeuchi, Ohkouchi, Nakao
    • Organizer
      the 15th Int. Conf. on Neural Information Processing
    • Place of Presentation
      Auckland, New Zealand
    • Year and Date
      20080000
  • [Presentation] ウェーブレット変換を用いた旅行時間時系列の予測2008

    • Author(s)
      柿原, 竹内, 藤田, 姚, 岡
    • Organizer
      第11回情報論的学習理論ワークショップ
    • Place of Presentation
      宮城県仙台市
    • Year and Date
      20080000
  • [Presentation] Enumerative Implementation of Lempel-Ziv 77 Algorithm2008

    • Author(s)
      Kawabata
    • Organizer
      Proc. of 2008 IEEE International Symposium on Information Theory
    • Place of Presentation
      Ontario, Canada
    • Year and Date
      20080000
  • [Presentation] Global Convergence Analysis of Decomposition Methods for Support Vector Regression2008

    • Author(s)
      Guo, Takahashi
    • Organizer
      2008 Int. Sympo. on Neural Networks
    • Place of Presentation
      Beijing, China
    • Year and Date
      20080000
  • [Presentation] Exponential curvature of Markov models2007

    • Author(s)
      Takeuchi, Kawabata
    • Organizer
      Proc. of 2007 IEEE Intl Symp. Inform. Theory
    • Place of Presentation
      Nice, France.
    • Year and Date
      20070600
  • [Presentation] スパース構造学習を用いたボットネット検知法の提案とダークネットデータへの適用

    • Author(s)
      濱崎、川喜田、竹内、井上、衛藤、中尾
    • Organizer
      2011年暗号と情報セキュリティシンポジウム
    • Place of Presentation
      福岡県北九州市
  • [Book] 統計的モデリング/情報理論と学習理論,若山正人(編)2008

    • Author(s)
      小西貞則, 竹内純一(著,分担執筆)
    • Total Pages
      63-116
    • Publisher
      講談社
  • [Remarks] ウェブサイト

    • URL

      http://www-kairo.csce.kyushu-u.ac.jp/~tak/homepage.ja.html

  • [Patent(Industrial Property Rights)] 変化点検出装置,変化点検出方法および変化点検出用プログラム2009

    • Inventor(s)
      竹内純一,山西健司
    • Industrial Property Rights Holder
      日本電気株式会社
    • Industrial Property Number
      特許,特許公開2005-004568
    • Acquisition Date
      2009-01-27

URL: 

Published: 2012-01-26   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi