• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2013 Fiscal Year Final Research Report

Nonlinear modeling based on high-dimensional data

Research Project

  • PDF
Project/Area Number 21300106
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Statistical science
Research InstitutionChuo University (2010-2013)
Kyushu University (2009)

Principal Investigator

KONISHI Sadanori  中央大学, 理工学部, 教授 (40090550)

Co-Investigator(Kenkyū-buntansha) NISHI Ryuei  九州大学, MI 研究所, 教授 (40127684)
MAESONO Yoshihiko  九州大学, 大学院・数理学研究院, 教授 (30173701)
Co-Investigator(Renkei-kenkyūsha) NINOMIYA Yoshiyuki  九州大学, MI 研究所, 准教授 (50343330)
MASUDA Hiroki  九州大学, MI 研究所, 准教授 (10380669)
Project Period (FY) 2009-04-01 – 2014-03-31
Keywords非線形モデリング / スパースモデリング / 高次モデル評価基準 / 正則化法 / ベイズモデリング
Research Abstract

The development of electronic measurement and instrumentation technologies enables us to accumulate a huge amount of data with complex structure and/or high-dimensional data. Through this research project we have investigated the problem of analyzing such datasets, and proposed various statistical modeling strategies including nonlinear regression modeling via L1 regularization, model evaluation and selection criteria, and Bayesian statistical modeling. Various regularization methods with L1 norm penalty have been investigated both in theoretical and numerical aspects. The problem of evaluating statistical models is a crucial issue in model building process. We proposed various types of model evaluation and selection criteria from both an information-theoretic point of view and a Bayesian approach. The proposed techniques may be used in the extraction of useful information and patterns from data with complex structure in the life sciences, systems engineering, and other fields.

  • Research Products

    (51 results)

All 2014 2013 2012 2011 2010 2009

All Journal Article (28 results) (of which Peer Reviewed: 28 results) Presentation (21 results) Book (2 results)

  • [Journal Article] Robust sparse regression modeling and tuning parameter selection via the efficient bootstrap information criteria2014

    • Author(s)
      Park, H., Sakaori, F. and Konishi, S
    • Journal Title

      Journal of Statistical Computation and Simulation

      Volume: 84-7 Pages: 1596-1607

    • Peer Reviewed
  • [Journal Article] Tuning parameter selection in sparse regression modeling2013

    • Author(s)
      Hirose, K., Tateishi, S. and Konishi, S
    • Journal Title

      Computational Statistics and Data Analysis

      Volume: 59 Pages: 28-40

    • Peer Reviewed
  • [Journal Article] Selection of tuning parameters in robust sparse regression modeling2012

    • Author(s)
      Park, H., Sakaori, F. and Konishi, S
    • Journal Title

      Proceedings of COMPSTAT 2012

      Pages: 713-723

    • Peer Reviewed
  • [Journal Article] Semi-supervised logistic discrimination for functional data2012

    • Author(s)
      Kawano, S. and Konishi, S
    • Journal Title

      Bulletin of Informatics and Cybernetics

      Volume: 44 Pages: 1-15

    • Peer Reviewed
  • [Journal Article] Predictive information criteria for Bayesian nonlinear regression models2012

    • Author(s)
      Kim, D., Kawano, S. and Konishi, S
    • Journal Title

      Bulletin of Informatics and Cybernetics

      Volume: 44 Pages: 17-28

    • Peer Reviewed
  • [Journal Article] Variable selection via the weighted group lasso for factor analysis models2012

    • Author(s)
      Hirose, K. and Konishi, S
    • Journal Title

      Canadian Journal of Statistics

      Volume: 40 Pages: 345-361

    • Peer Reviewed
  • [Journal Article] Semi-supervised logistic discrimination via graph-based regularization2012

    • Author(s)
      Kawano, S., Misumi, T. and Konishi, S
    • Journal Title

      Neural Processing Letters

      Volume: 36(3) Pages: 203-216

    • Peer Reviewed
  • [Journal Article] Variable selection for functional regression models via the L_1 regularization2011

    • Author(s)
      Matsui, H. and Konishi, S
    • Journal Title

      Computational Statistics and Data Analysis

      Volume: 55 Pages: 3304-3310

    • Peer Reviewed
  • [Journal Article] Nonlinear regression modeling and detecting change points via the relevance vector machine2011

    • Author(s)
      Tateishi, S. and Konishi, S
    • Journal Title

      Computational Statistics

      Volume: 26 Pages: 477-490

    • Peer Reviewed
  • [Journal Article] Multiclass functional discriminant analysis and its application to gesture recognition2011

    • Author(s)
      Matsui, H., Araki, T. and Konishi, S
    • Journal Title

      Journal of Classification

      Volume: 28 Pages: 227-243

    • Peer Reviewed
  • [Journal Article] Semi-supervised logistic discrimination via regularized Gaussian basis expansions2011

    • Author(s)
      Kawano, S. and Konishi, S
    • Journal Title

      Communications in Statistics-Theory and Methods

      Volume: 40 Pages: 2412-2423

    • Peer Reviewed
  • [Journal Article] Bias and variance reduction techniques for bootstrap information criteria2010

    • Author(s)
      Kitagawa, G. and Konishi, S
    • Journal Title

      Annals of the Institute of Statistical Mathematics

      Volume: 62 Pages: 209-234

    • Peer Reviewed
  • [Journal Article] Hyper-parameter selection in Bayesian structural equation models2010

    • Author(s)
      Hirose, K., Kawano, S., Miike, D. and Konishi, S
    • Journal Title

      Bulletin of Informatics and Cybernetics

      Volume: 42 Pages: 55-70

    • Peer Reviewed
  • [Journal Article] Functional cluster analysis via orthonormalized Gaussian basis expansions and its application2010

    • Author(s)
      Kayano, M., Dozono, K. and Konishi, S
    • Journal Title

      Journal of Classification

      Volume: 27 Pages: 211-230

    • Peer Reviewed
  • [Journal Article] Nonlinear regression modeling via the lasso-type regularization2010

    • Author(s)
      Tateishi, S., Matui, H. and Konishi, S
    • Journal Title

      Journal of Statistical Planning and Inference

      Volume: 140 Pages: 1125-1134

    • Peer Reviewed
  • [Journal Article] 回帰モデリングとL_1 型正則化法の最近の展開2010

    • Author(s)
      川野秀一, 廣瀬慧, 立石正平, 小西貞則
    • Journal Title

      日本統計学会誌

      Volume: 39巻2号 Pages: 211-242

    • Peer Reviewed
  • [Journal Article] Selection of ARX models estimated by the penalized weighted least squares method2010

    • Author(s)
      Pan, Q. and Nishii, R
    • Journal Title

      Bulletin of Informatics and Cybernetics

      Volume: 42 Pages: 35-43

    • Peer Reviewed
  • [Journal Article] ARX models for time-varying systems estimated by recursive penalized weighted least squares method2010

    • Author(s)
      Pan, Q., Nishii, R., Nakagawa, T. and Nakamoto, T
    • Journal Title

      Journal of Math-for-Industry

      Volume: 2 Pages: 109-114

    • Peer Reviewed
  • [Journal Article] Edgeworth Expansion and Normalizing Transformation of Ratio Statistics and their Application2010

    • Author(s)
      Maesono, Y
    • Journal Title

      Communications in Statistics-Theory and Methods

      Volume: Vol.39 Pages: 1344-1358

    • Peer Reviewed
  • [Journal Article] Functional regression modeling via regularized Gaussian basis expansions2009

    • Author(s)
      Araki, Y., Konishi, S., Kawano, S. and Matsui, H
    • Journal Title

      Annals of the Institute of Statistical Mathematics

      Volume: 61-4 Pages: 811-833

    • Peer Reviewed
  • [Journal Article] Functional logistic discrimination via regularized basis expansions2009

    • Author(s)
      Araki, Y., Konishi, S., Kawano, S. and Matsui, H
    • Journal Title

      Communications in Statistics - Theory & Methods

      Pages: 2944-2957

    • Peer Reviewed
  • [Journal Article] Nonlinear logistic discrimination via regularized Gaussian basis expansions2009

    • Author(s)
      Kawano, S. and Konishi, S
    • Journal Title

      Communications in Statistics - Theory & Methods

      Volume: 38 Pages: 1414-1425

    • Peer Reviewed
  • [Journal Article] Functional principal component analysis via regularized Gaussian basis expansions and its application to unbalanced data2009

    • Author(s)
      Kayano, M. and Konishi, S
    • Journal Title

      Journal of Statistical Planning and Inference

      Volume: 139 Pages: 2388-2398

    • Peer Reviewed
  • [Journal Article] Regularized functional regression modeling for functional response and predictors2009

    • Author(s)
      Matsui, H., Kawano, S. and Konishi, S
    • Journal Title

      Journal of Math-for-Industry

      Volume: 1 Pages: 17-25

    • Peer Reviewed
  • [Journal Article] Non-linear regression models to identify functional forms of deforestation in East Asia2009

    • Author(s)
      Tanaka, S. and Nishii, R
    • Journal Title

      IEEE Transactions on Geoscience and Remote Sensing

      Volume: 47(8) Pages: 2617-2626

    • Peer Reviewed
  • [Journal Article] Joint estimation of discretely observed stable Levy processes with symmetric Levy density2009

    • Author(s)
      Masuda, H
    • Journal Title

      J. Japan Statist

      Volume: 39, No.1 Pages: 49-75

    • Peer Reviewed
  • [Journal Article] Empirical analysis on jump detection in high-frequency data. (in Japanese)2009

    • Author(s)
      Masuda, H. and Morimoto, T
    • Journal Title

      J. Japan Statist

      Volume: 39, No.1 Pages: 33-63

    • Peer Reviewed
  • [Journal Article] Notes on estimating inverse-Gaussian and gamma subordinators under high-frequency sampling2009

    • Author(s)
      Masuda, H
    • Journal Title

      Ann. Inst. Statist

      Volume: 61, No.1 Pages: 181-195

    • Peer Reviewed
  • [Presentation] Tuning parameter selection in elastic net regularization via the generalized Bayesian information criterion2014

    • Author(s)
      保科架風, 小西貞則
    • Organizer
      第8回日本統計学会春季集会
    • Place of Presentation
      同志社大学
    • Year and Date
      20140300
  • [Presentation] Model selection for Cox model via sparse regularization2013

    • Author(s)
      土居正明, 小西貞則
    • Organizer
      2013年度統計関連学会連合大会
    • Place of Presentation
      大阪大学
    • Year and Date
      20130900
  • [Presentation] 変分ベイズ法による非線形回帰モデリング2013

    • Author(s)
      松田和己, 川野秀一, 小西貞則
    • Organizer
      2013年度統計関連学会連合大会
    • Place of Presentation
      大阪大学
    • Year and Date
      20130900
  • [Presentation] Mixed effects historical varying coefficient model for evaluating dose response in flexible dose trials2013

    • Author(s)
      Misumi,T. and Konishi, S
    • Organizer
      2013 Joint Statistical Meeting
    • Place of Presentation
      Montreal
    • Year and Date
      20130800
  • [Presentation] Tuning parameter selection in sparse regression modeling2012

    • Author(s)
      Hirose, K., Tateishi, S. and Konishi, S
    • Organizer
      2012 Joint Statistical Meetings
    • Place of Presentation
      San Diego, USA
    • Year and Date
      20120800
  • [Presentation] Algorithm for constructing model selection criteria in sparse regression modeling2012

    • Author(s)
      Hoshina, I. and Konishi, S
    • Organizer
      2012 Joint Statistical Meetings
    • Place of Presentation
      San Diego, USA
    • Year and Date
      20120800
  • [Presentation] Sparse Bayesian regression modeling via the relevance vector machine2012

    • Author(s)
      Matsuda, K. and Konishi, S
    • Organizer
      2012 Joint Statistical Meetings
    • Place of Presentation
      San Diego, USA
    • Year and Date
      20120800
  • [Presentation] Nonlinear statistical modeling via the relevance vector machine and its application to change point analysis2012

    • Author(s)
      Matsuda, K. and Konishi, S
    • Organizer
      ISBA 2012 World Meeting
    • Place of Presentation
      Kyoto
    • Year and Date
      20120600
  • [Presentation] Algorithm for constructing sparse regression models via Bayesian lasso2012

    • Author(s)
      Hoshina, I. and Konishi, S
    • Organizer
      ISBA 2012 World Meeting
    • Place of Presentation
      Kyoto
    • Year and Date
      20120600
  • [Presentation] Bayesian lassoとモデル選択2011

    • Author(s)
      保科架風, 小西貞則
    • Organizer
      2011年度統計関連学会連合大会
    • Place of Presentation
      九州大学
    • Year and Date
      20110900
  • [Presentation] L1 型正則化法におけるチューニングパラメータの選択2011

    • Author(s)
      廣瀬慧, 立石正平, 小西貞則
    • Organizer
      2011年度統計関連学会連合大会
    • Place of Presentation
      九州大学
    • Year and Date
      20110900
  • [Presentation] Fused lasso に基づく非線形回帰モデリング2011

    • Author(s)
      立石正平, 小西貞則
    • Organizer
      2010年度統計関連学会連合大会
    • Place of Presentation
      早稲田大学
    • Year and Date
      20110900
  • [Presentation] Echo State Networks with Non-Monotonous Activation Functions2010

    • Author(s)
      Jan Dolinsky, 廣瀬慧, 小西貞則
    • Organizer
      2010年度統計関連学会連合大会
    • Place of Presentation
      早稲田大学
    • Year and Date
      20100900
  • [Presentation] Variable selection via the lasso-type regularization for structural equation models2010

    • Author(s)
      Hirose, K. and Konishi, S
    • Organizer
      2010Joint Statistical Meetings
    • Place of Presentation
      Vancouver Canada
    • Year and Date
      20100800
  • [Presentation] Nonlinear regression modeling and detecting change points via regularized basis expansions2010

    • Author(s)
      Tateishi, S. and Konishi, S
    • Organizer
      2010 Joint Statistical Meetings
    • Place of Presentation
      Vancouver Canada
    • Year and Date
      20100800
  • [Presentation] 関連ベクターマシンに基づく非線形回帰モデルと変化点探索2009

    • Author(s)
      立石正平, 小西貞則
    • Organizer
      2009統計関連学会連合大会
    • Place of Presentation
      同志社大学
    • Year and Date
      20090900
  • [Presentation] 関数データに基づく半教師あり識別・判別問題2009

    • Author(s)
      川野秀一, 小西貞則
    • Organizer
      2009統計関連学会連合大会
    • Place of Presentation
      同志社大学
    • Year and Date
      20090900
  • [Presentation] Group Lasso に基づく因子分析モデリング2009

    • Author(s)
      廣瀬慧, 小西貞則
    • Organizer
      2009統計関連学会連合大会
    • Place of Presentation
      同志社大学
    • Year and Date
      20090900
  • [Presentation] Semi-supervised learning via regularized logistic discrimination2009

    • Author(s)
      Kawano, S. and Konishi, S
    • Organizer
      2009 Joint Statistical Meeting in Washington
    • Place of Presentation
      Washington
    • Year and Date
      20090800
  • [Presentation] Nonlinear regression modeling via Bayesian regularization with Lasso-type penalties2009

    • Author(s)
      Tateishi, S. and Konishi, S
    • Organizer
      2009 Joint Statistical Meeting in Washington
    • Place of Presentation
      Washington
    • Year and Date
      20090800
  • [Presentation] A choice of the number of factors and hyper-parameter selection in Bayesian factor analysis model2009

    • Author(s)
      Hirose, K., Ichikawa,M. and Konishi, S
    • Organizer
      2009 Joint Statistical Meeting in Washington
    • Place of Presentation
      Washington
    • Year and Date
      20090800
  • [Book] Introduction to Multivariate Analysis: Linear and Nonlinear Modeling. CRC2014

    • Author(s)
      Konishi, S
    • Publisher
      Chapman & Hall, New York
  • [Book] 多変量解析入門-線形から非線形へ-2010

    • Author(s)
      小西貞則
    • Publisher
      岩波書店

URL: 

Published: 2015-06-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi