• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

High-accuracy parameter estimation using constrained variable selection based on mixed-integer optimization

Research Project

Project/Area Number 17K12983
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Social systems engineering/Safety system
Research InstitutionUniversity of Tsukuba

Principal Investigator

Takano Yuichi  筑波大学, システム情報系, 准教授 (40602959)

Project Period (FY) 2017-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2020: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2019: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2018: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2017: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Keywords数理最適化 / 機械学習 / アルゴリズム / 計算機統計 / 変数選択 / 正則化 / 最適化 / 分類 / 多重共線性 / 数理工学 / 統計数学
Outline of Final Research Achievements

Mixed-integer optimization has been attracting attention in recent years as an exact solution for variable selection in regression and discriminant analyses. On the other hand, variable selection based on mixed-integer optimization has the disadvantage that multicollinearity often remains in the set of selected explanatory variables, and the prior knowledge inherent in the data is not utilized. Thus, in this study we combined "mixed-integer optimization" with "removal of multicollinearity" and "structured regularization (model construction using prior information)" to propose constrained variable selection methods that enable high-accuracy parameter estimation. Numerical experiments using synthetic and actual data were conducted to verify the effectiveness of the proposed methods.

Academic Significance and Societal Importance of the Research Achievements

回帰分析や判別分析における変数選択の先行研究では、発見的解法が用いられる場合が多く、パラメータ推定の精度に着目した変数選択の厳密解法は先駆的かつ実用上重要な研究だと言える。多重共線性を除去する制約条件は扱いが難しく、有効な求解アルゴリズムを考案することは最適化理論の観点からも意義がある。本研究の目的である高精度パラメータ推定は、データ分析の信頼性向上に直結し、多くの企業や行政機関の意思決定に寄与することが期待される。

Report

(5 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (29 results)

All 2021 2020 2019 2018 2017

All Journal Article (19 results) (of which Peer Reviewed: 15 results,  Open Access: 12 results) Presentation (10 results) (of which Int'l Joint Research: 7 results,  Invited: 6 results)

  • [Journal Article] Best Subset Selection for Linear Regression Models via Mixed-Integer Optimization2021

    • Author(s)
      高野 祐一、宮代 隆平
    • Journal Title

      Journal of the Japan Statistical Society, Japanese Issue

      Volume: 50 Issue: 2 Pages: 343-362

    • DOI

      10.11329/jjssj.50.343

    • NAID

      130007995099

    • ISSN
      0389-5602, 2189-1478
    • Year and Date
      2021-03-05
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Sparse Poisson regression via mixed-integer optimization2021

    • Author(s)
      Hiroki Saishu, Kota Kudo, and Yuichi Takano
    • Journal Title

      PLOS ONE

      Volume: 16 Issue: 4 Pages: 1-17

    • DOI

      10.1371/journal.pone.0249916

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 時間付加グラフのベクトル表現を用いたタクシー軌跡データの解析2021

    • Author(s)
      河上佳太, 西村直樹, 白鳥友風, 工藤晃太, 松岡雄大, 最首大輝, 渡邊彰久, 高野祐一
    • Journal Title

      オペレーションズ・リサーチ:経営の科学

      Volume: 66 Pages: 246-254

    • NAID

      40022547688

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Stochastic Discrete First-Order Algorithm for Feature Subset Selection2020

    • Author(s)
      Kudo Kota、Takano Yuichi、Nomura Ryo
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E103.D Issue: 7 Pages: 1693-1702

    • DOI

      10.1587/transinf.2019EDP7274

    • NAID

      130007867764

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2020-07-01
    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Prediction of hierarchical time series using structured regularization and its application to artificial neural networks2020

    • Author(s)
      Shiratori Tomokaze、Kobayashi Ken、Takano Yuichi
    • Journal Title

      PLOS ONE

      Volume: 15 Issue: 11 Pages: e0242099-e0242099

    • DOI

      10.1371/journal.pone.0242099

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Multi-objective Optimization Models for Many-to-one Matching Problems2020

    • Author(s)
      Shimada Natsumi、Yamazaki Natsuki、Takano Yuichi
    • Journal Title

      Journal of Information Processing

      Volume: 28 Issue: 0 Pages: 406-412

    • DOI

      10.2197/ipsjjip.28.406

    • NAID

      130007887729

    • ISSN
      1882-6652
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Best subset selection via cross-validation criterion2020

    • Author(s)
      Takano Yuichi, Miyashiro Ryuhei
    • Journal Title

      TOP

      Volume: - Issue: 2 Pages: 475-488

    • DOI

      10.1007/s11750-020-00538-1

    • Related Report
      2020 Annual Research Report 2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] サポートベクトルマシンとカーネル法2020

    • Author(s)
      高野 祐一
    • Journal Title

      オペレーションズ・リサーチ:経営の科学

      Volume: 65 Pages: 304-309

    • Related Report
      2020 Annual Research Report
    • Open Access
  • [Journal Article] 形状制約モデルによる顧客の商品選択行動の予測2020

    • Author(s)
      西村直樹, 鮏川矩義, 高野祐一, 岩永二郎
    • Journal Title

      オペレーションズ・リサーチ:経営の科学

      Volume: 65 Pages: 328-333

    • Related Report
      2020 Annual Research Report
    • Open Access
  • [Journal Article] A branch-and-cut algorithm for solving mixed-integer semidefinite optimization problems2020

    • Author(s)
      Ken Kobayashi and Yuichi Takano
    • Journal Title

      Computational Optimization and Applications

      Volume: 75 Issue: 2 Pages: 493-513

    • DOI

      10.1007/s10589-019-00153-2

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Smoothness-constrained model for nonparametric item response theory2020

    • Author(s)
      Toshiki Sato and Yuichi Takano
    • Journal Title

      Information Science and Applied Mathematics

      Volume: 印刷中

    • NAID

      120006879252

    • Related Report
      2019 Research-status Report
  • [Journal Article] Feature Subset Selection for Ordered Logit Model via Tangent-Plane-Based Approximation2019

    • Author(s)
      Mizuho Naganuma, Yuichi Takano, and Ryuhei Miyashiro
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E102.D Issue: 5 Pages: 1046-1053

    • DOI

      10.1587/transinf.2018EDP7188

    • NAID

      130007641148

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2019-05-01
    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Improving collaborative filtering recommendations by estimating user preferences from clickstream data2019

    • Author(s)
      Jiro Iwanaga, Naoki Nishimura, Noriyoshi Sukegawa, and Yuichi Takano
    • Journal Title

      Electronic Commerce Research and Applications

      Volume: 37 Pages: 1-12

    • DOI

      10.1016/j.elerap.2019.100877

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Estimating product-choice probabilities from sequences of page views2019

    • Author(s)
      Naoki Nishimura, Noriyoshi Sukegawa, Yuichi Takano, and Jiro Iwanaga
    • Journal Title

      Proceedings of the 2019 International Symposium on Nonlinear Theory and Its Applications

      Volume: - Pages: 25-28

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Feature subset selection for the multinomial logit model via mixed-integer optimization2019

    • Author(s)
      Shunsuke Kamiya, Ryuhei Miyashiro, and Yuichi Takano
    • Journal Title

      Proceedings of the 2019 International Symposium on Nonlinear Theory and Its Applications

      Volume: 89 Pages: 1254-1263

    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Mixed integer quadratic optimization formulations for eliminating multicollinearity based on variance inflation factor2019

    • Author(s)
      R. Tamura, K. Kobayashi, Y. Takano, R. Miyashiro, K. Nakata, T. Matsui
    • Journal Title

      Journal of Global Optimization

      Volume: 73 Issue: 2 Pages: 431-446

    • DOI

      10.1007/s10898-018-0713-3

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Investigating consumers’ store-choice behavior via hierarchical variable selection2019

    • Author(s)
      Toshiki Sato, Yuichi Takano, and Takanobu Nakahara
    • Journal Title

      Advances in Data Analysis and Classification

      Volume: 印刷中 Issue: 3 Pages: 621-639

    • DOI

      10.1007/s11634-018-0327-0

    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] 多重共線性を考慮した回帰式の変数選択問題の定式化2018

    • Author(s)
      田村隆太, 小林健, 高野祐一, 宮代隆平, 中田和秀, 松井知己
    • Journal Title

      オペレーションズ・リサーチ:経営の科学

      Volume: 63 Pages: 128-133

    • Related Report
      2017 Research-status Report
    • Open Access
  • [Journal Article] BEST SUBSET SELECTION FOR ELIMINATING MULTICOLLINEARITY2017

    • Author(s)
      R. Tamura, K. Kobayashi, Y. Takano, R. Miyashiro, K. Nakata, T. Matsui
    • Journal Title

      Journal of the Operations Research Society of Japan

      Volume: 60 Issue: 3 Pages: 321-336

    • DOI

      10.15807/jorsj.60.321

    • NAID

      130005874223

    • ISSN
      0453-4514, 2188-8299
    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Best subset selection for linear regression models via mixed-integer optimization2021

    • Author(s)
      Yuichi Takano
    • Organizer
      NUS-Tsukuba Joint-Online-Workshop on "Sustainable Management and Data Sciences"
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Stochastic discrete first-order algorithm for feature subset selection2020

    • Author(s)
      Kota Kudo, Yuichi Takano, and Ryo Nomura
    • Organizer
      INFORMS 2020 Annual Meeting
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Dynamic portfolio selection with linear control policies for coherent risk minimization2020

    • Author(s)
      Yuichi Takano and Jun-ya Gotoh
    • Organizer
      Webinars of Quantitative Finance Program, Stony Brook University
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Dynamic portfolio selection with linear control policies for coherent risk minimization2019

    • Author(s)
      Yuichi Takano and Jun-ya Gotoh
    • Organizer
      INFORMS 2019 Annual Meeting
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Best subset selection via cross-validation criterion2019

    • Author(s)
      Yuichi Takano and Ryuhei Miyashiro
    • Organizer
      International Conference on Nonlinear Analysis and Convex Analysis -- International Conference on Optimization Techniques and Applications
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] コヒレントリスク指標に基づくポートフォリオの線形制御政策最適化2019

    • Author(s)
      高野祐一, 後藤順哉
    • Organizer
      日本オペレーションズ・リサーチ学会「評価のOR」研究部会
    • Related Report
      2019 Research-status Report
    • Invited
  • [Presentation] Recent Advances in Mixed-integer Optimization Approaches to Feature Subset Selection2018

    • Author(s)
      Yuichi Takano and Ryuhei Miyashiro
    • Organizer
      INFORMS 2018 Annual Meeting
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] 混合整数最適化によるロジットモデルの変数選択2018

    • Author(s)
      高野祐一
    • Organizer
      科研費「新時代の最適化モデルに基づく意思決定支援プラットフォームの研究と開発」2018年度ワークショップ
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] 多重共線性を考慮した最良部分集合選択2017

    • Author(s)
      高野祐一
    • Organizer
      第29回RAMPシンポジウム
    • Related Report
      2017 Research-status Report
    • Invited
  • [Presentation] Mixed-Integer Quadratic Optimization Formulations for Eliminating Multicollinearity Based on Variance Inflation Factor2017

    • Author(s)
      Ryuta Tamura, Ken Kobayashi, Yuichi Takano, Ryuhei Miyashiro, Kazuhide Nakata, Tomomi Matsui
    • Organizer
      INFORMS 2017 Annual Meeting
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi