• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Theory and algorithms for ill-conditioned conic linear programming

Research Project

Project/Area Number 20H04145
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 60020:Mathematical informatics-related
Research InstitutionThe University of Electro-Communications

Principal Investigator

Muramatsu Masakazu  電気通信大学, 大学院情報理工学研究科, 教授 (70266071)

Co-Investigator(Kenkyū-buntansha) 山下 真  東京工業大学, 情報理工学院, 教授 (20386824)
奥野 貴之  成蹊大学, 理工学部, 准教授 (70711969)
蛯原 義雄  九州大学, システム情報科学研究院, 教授 (80346080)
Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000)
Fiscal Year 2023: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2022: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2021: ¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Keywords半正定値計画 / 錐線形計画 / 2次錐計画 / 数理最適化 / 錐線形計画問題 / 半正定値計画問題 / 共正値錐 / 2次錐 / 退化 / 悪条件 / 制御 / 非負システム / 半正定値制約つき非線形半無限計画 / リーマン多様体 / 2次制約2次計画 / 面的削減法 / 共正値計画 / 悪条件問題 / 面削減法 / 双対理論
Outline of Research at the Start

錐線形計画の実用化において大きな障害となっているのが「悪条件な問題」 の存在である。悪条件の極限として退化がある。悪条件あるいは退化した錐線形計画問題 は実用において頻繁に出現するにもかかわらず、従来のアルゴリズムでは解くことができない。本研究は、錐線形計画問題における悪条件性に関してその理解を深め、またそのような問 題に対応する新しいアルゴリズムを開発することにより、錐線形計画の裾野を広げ、実用に足る段階へと高める。

Outline of Final Research Achievements

A small-gain theorem leveraging the characteristics of the Rectified Linear Unit, commonly used in machine learning, was derived. Next, the semidefinite programming (SDP) relaxation conditions for quadratic constrained quadratic programming (QCQP) were analyzed, demonstrating applicability to forest structures and simultaneously tridiagonalizable cases. Additionally, an algorithm guaranteeing convergence to points satisfying strong optimality conditions (SOSP points) under ill-conditioned SDP was developed, enhancing local convergence compared to traditional methods. Other research also included stability analysis of recurrent neural networks, improvements in constrained optimization problems on the positive semidefinite cone, and QCQP analysis using bipartite graphs. Furthermore, a theory for the complete solving ill-conditioned SDPs was established.

Academic Significance and Societal Importance of the Research Achievements

本研究は、機械学習や最適化理論において進展をもたらすものである。例えば、Rectified Linear Unitを用いたスモールゲイン定理の導出により、安定性解析がより正確かつ効率的になる。また、QCQPに関する研究は、従来より大きなQCQPを高速に安定的に解くことを可能にしたので、応用の幅が広がった。SOSPへの収束の証明や悪条件の錐線形計画問題を厳密に解く研究は、理論を深めるものとして重要なものであり、今後の進展が待たれる。全体として、錐線形計画に関連するこれらの技術は、最適化問題の理論的な深まりと実践的応用を促進するものである。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (42 results)

All 2024 2023 2022 2021 2020 Other

All Journal Article (18 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 15 results,  Open Access: 9 results) Presentation (23 results) (of which Int'l Joint Research: 12 results,  Invited: 3 results) Remarks (1 results)

  • [Journal Article] Local convergence of primal-dual interior point methods for nonlinear semi-definite optimization using the family of Monteiro-Tsuchiya directions2024

    • Author(s)
      Takayuki Okuno
    • Journal Title

      Computational Optimization and Applications

      Volume: 17 Issue: 2 Pages: 677-718

    • DOI

      10.1007/s10589-024-00562-y

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Stable Linear System Identification with Prior Knowledge by Riemannian Sequential Quadratic Optimization2024

    • Author(s)
      Mitsuaki Obara , Kazuhiro Sato , Hiroki Sakamoto , Takayuki Okuno , Akiko Takeda
    • Journal Title

      IEEE Transactions on Automatic Control

      Volume: 69 Issue: 3 Pages: 2060-2066

    • DOI

      10.1109/tac.2023.3318195

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Stability Analysis of Continuous-Time Recurrent Neural Networks by IQC with Copositive Multipliers2023

    • Author(s)
      Takao Ryota、Fujii Tatsuki、Motooka Hayato、Ebihara Yoshio
    • Journal Title

      Transactions of the Institute of Systems, Control and Information Engineers

      Volume: 36 Issue: 1 Pages: 17-25

    • DOI

      10.5687/iscie.36.17

    • ISSN
      1342-5668, 2185-811X
    • Year and Date
      2023-01-15
    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Complexity analysis of interior-point methods for second-order stationary points of nonlinear semidefinite optimization problems2023

    • Author(s)
      Shun Arahata , Takayuki Okuno , Akiko Takeda
    • Journal Title

      Computational Optimization and Applications

      Volume: 86 Issue: 2 Pages: 555-598

    • DOI

      10.1007/s10589-023-00501-3

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Majorization-minimization-based Levenberg--Marquardt method for constrained nonlinear least squares2023

    • Author(s)
      Naoki Marumo, Takayuki Okuno, Akiko Takeda
    • Journal Title

      Computational Optimization and Applications

      Volume: 84 Issue: 3 Pages: 833-874

    • DOI

      10.1007/s10589-022-00447-y

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Primal-dual path following method for nonlinear semi-infinite programs with semi-definite constraints2023

    • Author(s)
      Takayuki Okuno, Masao Fukushima
    • Journal Title

      Mathematical Programming

      Volume: 199 Issue: 1-2 Pages: 251-303

    • DOI

      10.1007/s10107-022-01827-2

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] The l<sub>q</sub>/l<sub>p</sub> Hankel norms of discrete-time positive systems across switching2022

    • Author(s)
      Ebihara Y.
    • Journal Title

      SICE Journal of Control, Measurement, and System Integration

      Volume: 15 Issue: 2 Pages: 109-118

    • DOI

      10.1080/18824889.2022.2090801

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A limiting analysis on regularization of singular SDP and its implication to infeasible interior-point algorithms2022

    • Author(s)
      Tsuchiya Takashi、Lourenco Bruno F.、Muramatsu Masakazu、Okuno Takayuki
    • Journal Title

      Mathematical Programming

      Volume: - Issue: 1 Pages: 531-568

    • DOI

      10.1007/s10107-022-01891-8

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A stabilized sequential quadratic semidefinite programming method for degenerate nonlinear semidefinite programs2022

    • Author(s)
      Yuya Yamakawa, Takayuki Okuno
    • Journal Title

      Computational Optimization and Applications

      Volume: 83 Issue: 3 Pages: 1027-1064

    • DOI

      10.1007/s10589-022-00402-x

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Exploiting aggregate sparsity in second-order cone relaxations for quadratic constrained quadratic programming problems2021

    • Author(s)
      Heejune Sheen, Makoto Yamashita
    • Journal Title

      Optimization Methods and Software

      Volume: - Issue: 2 Pages: 753-771

    • DOI

      10.1080/10556788.2020.1827256

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A stabilized sequential quadratic semidefinite programming method for degenerate nonlinear semidefinite programs.2021

    • Author(s)
      Yuya Yamakawa and Takayuki Okuno
    • Journal Title

      arXiv

      Volume: 1909.13544

    • Related Report
      2021 Annual Research Report
    • Open Access
  • [Journal Article] 非負値入力に対するL2 誘導ノルムの解析と再帰型ニューラルネットワークの安定性解析への応用2021

    • Author(s)
      本岡駿人,蛯原義雄
    • Journal Title

      システム制御情報学会論文誌

      Volume: 35 Pages: 29-37

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Exact SDP relaxations of quadratically constrained quadratic programs with forest structures2021

    • Author(s)
      Azuma Godai、Fukuda Mituhiro、Kim Sunyoung、Yamashita Makoto
    • Journal Title

      Journal of Global Optimization

      Volume: 82 Issue: 2 Pages: 243-262

    • DOI

      10.1007/s10898-021-01071-6

    • NAID

      40022730889

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Solving SDP completely with an interior point oracle2021

    • Author(s)
      Lourenco Bruno F.、Muramatsu Masakazu、Tsuchiya Takashi
    • Journal Title

      Optimization Methods and Software

      Volume: 36 Issue: 2-3 Pages: 425-471

    • DOI

      10.1080/10556788.2020.1850720

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] l2 induced norm analysis of discrete-time LTI systems for nonnegative input signals and its application to stability analysis of recurrent neural networks2021

    • Author(s)
      Ebihara Yoshio、Waki Hayato、Magron Victor、Mai Ngoc Hoang Anh、Peaucelle Dimitri、Tarbouriech Sophie
    • Journal Title

      European Journal of Control

      Volume: 62 Pages: 99-104

    • DOI

      10.1016/j.ejcon.2021.06.022

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Local convergence of primal-dual interior point methods for nonlinear semi-definite optimization using the family of Monteiro-Tsuchiya directions.2020

    • Author(s)
      Takayuki Okuno
    • Journal Title

      arXiv

      Volume: 2009.03020

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Sequential quadratic optimization for nonlinear optimization problems on riemannian manifolds.2020

    • Author(s)
      Mitsuaki Obara, Takayuki Okuno, and Akiko Takeda
    • Journal Title

      arXiv

      Volume: 2009.07153

    • Related Report
      2020 Annual Research Report
  • [Journal Article] Development of Artificial Intelligence to Classify Quality of Transmission Shift Control Using Deep Convolutional Neural Networks2020

    • Author(s)
      Kawakami Takefumi、Ide Takanori、Moriyama Eiji、Hoki Kunihito、Muramatsu Masakazu
    • Journal Title

      IEEE Transactions on Vehicular Technology

      Volume: 69 Issue: 12 Pages: 16168-16172

    • DOI

      10.1109/tvt.2020.3032191

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Tight Semidefinite Relaxations for Sign-Indefinite Qcqps with Bipartite Structures2023

    • Author(s)
      Godai Azuma*, Mituhiro Fukuda, Sunyoung Kim, Makoto Yamashita
    • Organizer
      SIAM Conference on Optimization 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Tightness conditions of SDP relaxation for QCQPs with bipartite graph structure2023

    • Author(s)
      Godai Azuma, Mituhiro Fukuda, Sunyoung Kim, Makoto Yamashita*
    • Organizer
      10th International Congress on Industrial and Applied Mathematics
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 正確なランク1行列補完のための二乗和緩和の疎性構造2023

    • Author(s)
      東悟大*, Sunyoung Kim, 山下真
    • Organizer
      シンポジウム:錐線形計画とその周辺
    • Related Report
      2023 Annual Research Report
  • [Presentation] Generalized Levenberg-Marquardt method with oracle complexity bound and local convergence2023

    • Author(s)
      Naoki Marumo,Takayuki Okuno, Akiko Takeda
    • Organizer
      ICIAM2023Tokyo
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Lp+ Induced Norm Analysis of Linear Systems2023

    • Author(s)
      Y. Ebihara
    • Organizer
      Workshop on Uncertain Dynamical Systems
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Local Lipschitz Constant Computation of ReLU-FNNs: Upper Bound Computation with Exactness Verification2023

    • Author(s)
      Y. Ebihara, X. Dai, T. Yuno, V. Magron, D. Peaucelle, and S. Tarbouriech
    • Organizer
      The 22nd European Control Conference
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Domain-space conversion と Block factor-width-2 decomposition による疎な半正定値計画問題の高速化2023

    • Author(s)
      正木崚雅, 山下真
    • Organizer
      日本経営工学会関東支部2022年度学生論文発表会
    • Related Report
      2022 Annual Research Report
  • [Presentation] An Adaptation of Dual Spectral Projected Gradient Method2022

    • Author(s)
      Namchaisiri Charles, Liu Tianxiang, Makoto Yamashita
    • Organizer
      International Workshop on Continuous Optimization
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Exactly Solving a class of QCQPs via Semidefinite Relaxation with Bipartite Sparsity Patterns2022

    • Author(s)
      Godai Azuma, Mituhiro Fukuda, Sunyoung Kim, Makoto Yamashita
    • Organizer
      International Workshop on Continuous Optimization
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Conic Optimization for Drone Ship Routing Problem2022

    • Author(s)
      Ning-Wen Yang, Makoto Yamashita
    • Organizer
      International Guest Lecture, World Class Professo
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] L2+ Induced Norm Analysis of Continuous-Time LTI Systems Using Positive Filters and Copositive Programming2022

    • Author(s)
      Y. Ebihara, H. Waki, N. Sebe, V. Magron, D. Peaucelle, and S. Tarbouriech
    • Organizer
      Proc. of the 18th European Control Conference
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] L2+ 誘導ノルムの解析I: 上界値解析2022

    • Author(s)
      本岡駿人,蛯原義雄,脇隼人,瀬部昇
    • Organizer
      第9 回計測自動制御学会制御部門マルチシンポジウム
    • Related Report
      2021 Annual Research Report
  • [Presentation] L2+ 誘導ノルムの解析II: 下界値解析2022

    • Author(s)
      蛯原義雄,本岡駿人,脇隼人,瀬部昇
    • Organizer
      第9 回計測自動制御学会制御部門マルチシンポジウム
    • Related Report
      2021 Annual Research Report
  • [Presentation] 緩和法とペナルティ法を用いた二次錐計画問題に対する安 定した解法の構築2022

    • Author(s)
      坂井祐太, 山下真
    • Organizer
      日本経営工学会関東支部2021年度学生論文発表会
    • Related Report
      2021 Annual Research Report
  • [Presentation] 二部グラフで表現可能な疎性を持つ二次制約付き二次計画問題と狭小な半正定値計画緩和の条件2022

    • Author(s)
      東悟大, 福田光浩, Kim Sunyoung, 山下真
    • Organizer
      日本オペレーションズ・リサーチ学会2022春季研究発表会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Stability Analysis of Dynamical Systems with Saturation Nonlinearities via IQC with Copositive Multipliers2022

    • Author(s)
      R. Saeki and Y. Ebihara
    • Organizer
      Proc. of the SICE Annual Conference, Kumamoto, Japan
    • Related Report
      2021 Annual Research Report
  • [Presentation] Exactness Conditions for Semidefinite Relaxation of Nonconvex QCQPS with Forest Structures2021

    • Author(s)
      Godai Azuma, Mituhiro Fukuda, Sunyoung Kim, Makoto Yamashita
    • Organizer
      SIAM Conference on Optimization 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Exact semidefinite relaxations for QCQPs with forest-structured matrices and its applications2021

    • Author(s)
      Godai Azuma, Mituhiro Fukuda, Sunyoung Kim, Makoto Yamashita
    • Organizer
      IFORS 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Stability Analysis of Recurrent Neural Networks by IQC with Copositive Mutipliers2021

    • Author(s)
      Y. Ebihara, H. Waki, V. Magron, N. H. A. Mai, D. Peaucelle, and S. Tarbouriech
    • Organizer
      Proc. of the 60th IEEE Conference on Decision and Control, Austin, USA
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 非線形半正定値最適化問題に対する2次の最適性保証付き主双対内点法2021

    • Author(s)
      新幡駿, 奥野貴之, 武田朗子
    • Organizer
      日本オペレーションズ・リサーチ学会春季研究発表会
    • Related Report
      2020 Annual Research Report
  • [Presentation] Sequential Quadratic Optimization for Nonlinear Optimization Problems on Riemannian Manifolds2021

    • Author(s)
      小原 光暁, 奥野 貴之, 武田 朗子
    • Organizer
      研究集会「最適化:モデリングとアルゴリズム」
    • Related Report
      2020 Annual Research Report
  • [Presentation] 非線形半正定値計画問題に対する安定化逐次二次半正定値計画法の大域的収束性について2020

    • Author(s)
      山川雄也, 奥野貴之
    • Organizer
      京都大学数理解析研究所 共同研究(グループ型) 数理最適化の理論・アルゴリズム・応用
    • Related Report
      2020 Annual Research Report
  • [Presentation] 三重対角性を持つ二次制約付き二次計画問題の狭小な半正定値計画緩和2020

    • Author(s)
      東悟大, 福田光浩, 山下真,Sunyoung Kim
    • Organizer
      京都大学数理解析研究所 共同研究(グループ型) 数理最適化の理論・アルゴリズム・応用
    • Related Report
      2020 Annual Research Report
  • [Remarks] 悪条件錐線形計画問題の理論とアルゴリズム

    • URL

      https://muramatsu-lab.jp/seminar/kakenb/

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report 2021 Annual Research Report 2020 Annual Research Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi