• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

New-generation optimization algorithms for engineering

Research Project

Project/Area Number 21K17710
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 60020:Mathematical informatics-related
Research InstitutionKyushu University

Principal Investigator

Themelis Andreas  九州大学, システム情報科学研究院, 准教授 (50898749)

Project Period (FY) 2021-04-01 – 2025-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
Fiscal Year 2023: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2022: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2021: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
KeywordsOptimization algorithms / Nonconvex optimization / Adaptive algorithms / Autonomous driving / Decentralized control / Open-source software
Outline of Research at the Start

The project is concerned with optimization algorithms for engineering, in compliance with the application challenges: efficiency, limited power of microprocessors, and nonconvexity of the problems. The final goal is to provide efficient open-source multi-purpose software with theoretical guarantees.

Outline of Annual Research Achievements

The candidate obtained a one-year extension to smoothly transition to the next project on "adaptive" algorithms. Supervising a PhD student, a merging point was established on the integration of quasi-Newton stepsizes (this project) in adaptive schemes (next project) [1].
The finalization of this project is being achieved through a new window on IP methods [2], as part of an international collaboration with UBW Munich (DE).
Similar developments are expected from a visit of a student from UBC (CA), scheduled from June to August 2024.

[1] H Ou and A Themelis. Safeguarding adaptive methods: global convergence of Barzilai-Borwein and other stepsize choices, arXiv:2404.09617, 2024
[2] A De Marchi and A Themelis. An interior proximal gradient method for nonconvex optimization, arXiv:2208.00799, 2023

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

The final deliverables of this project are being attained through an integration, not originally planned, of Newton-type proximal methods within a classical interior point framework [3]. The manuscript, based on the preliminary work [2], will be submitted to an international top-tier journal within the next month.
A new alley beyond local Lipschitz differentiability is also being investigated in the convex case [1, 4].
Several preprints have been published in the meantime.

[3] A De Marchi and A Themelis. A penalty barrier framework for nonconvex constrained optimization (work in progress, soon to be submitted)
[4] K Oikonomidis et al. Adaptive proximal gradient methods are universal without approximation, arXiv:2402.06271, 2024

Strategy for Future Research Activity

Apart from ultimating ongoing works mentioned above, the candidate intends to publish an extended monograph for the Foundations and Trends in Optimization about his main research. Given the accomplishments of the other goals, this pending work can now resume without impediments.

Report

(3 results)
  • 2023 Research-status Report
  • 2022 Research-status Report
  • 2021 Research-status Report
  • Research Products

    (30 results)

All 2024 2023 2022 2021 Other

All Int'l Joint Research (9 results) Journal Article (13 results) (of which Int'l Joint Research: 13 results,  Peer Reviewed: 13 results,  Open Access: 2 results) Presentation (8 results) (of which Int'l Joint Research: 4 results,  Invited: 4 results)

  • [Int'l Joint Research] University of British Columbia(カナダ)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] University of the Bundeswehr Munich(ドイツ)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] KU Leuven(ベルギー)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] University of Genova(イタリア)

    • Related Report
      2023 Research-status Report
  • [Int'l Joint Research] KU Leuven(ベルギー)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] UniBw Munich(ドイツ)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] University of British Columbia(カナダ)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] KU Leuven(ベルギー)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] Bundeswehr University, Munich(ドイツ)

    • Related Report
      2021 Research-status Report
  • [Journal Article] A mirror inertial forward-reflected-backward splitting: Convergence analysis beyond convexity and Lipschitz smoothness2024

    • Author(s)
      Ziyuan Wang, Andreas Themelis, Hongjia Ou, Xianfu Wang
    • Journal Title

      Journal of Optimization Theory and Applications

      Volume: - Issue: 2 Pages: 1127-1159

    • DOI

      10.1007/s10957-024-02383-9

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] SPIRAL: A superlinearly convergent incremental proximal algorithm for nonconvex finite sum minimization2024

    • Author(s)
      Pourya Behmandpoor, Puya Latafat, Andreas Themelis, Marc Moonen, Panagiotis Patrinos
    • Journal Title

      Computational Optimization and Applications

      Volume: - Issue: 1 Pages: 71-106

    • DOI

      10.1007/s10589-023-00550-8

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Dualities for non-Euclidean smoothness and strong convexity under the light of generalized conjugacy2023

    • Author(s)
      Emanuel Laude, Andreas Themelis, Panagiotis Patrinos
    • Journal Title

      SIAM Journal on Optimization

      Volume: 33 Issue: 4 Pages: 2721-2749

    • DOI

      10.1137/21m1465913

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Optimal grid layouts for hybrid offshore assets in the North Sea under different market designs2023

    • Author(s)
      Stephen Hardy, Andreas Themelis, Kaoru Yamamoto, Hakan Ergun, Dirk Van Hertem
    • Journal Title

      IEEE Transactions on Energy Markets, Policy and Regulation

      Volume: 1 Issue: 4 Pages: 468-479

    • DOI

      10.1109/tempr.2023.3289582

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Douglas-Rachford splitting and ADMM for nonconvex optimization: accelerated and Newton-type algorithms2022

    • Author(s)
      A. Themelis, L. Stella and P. Patrinos
    • Journal Title

      Computational Optimization and Applications

      Volume: 82 Issue: 2 Pages: 395-440

    • DOI

      10.1007/s10589-022-00366-y

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Proximal Gradient Algorithms under Local Lipschitz Gradient Continuity: A Convergence and Robustness Analysis of PANOC2022

    • Author(s)
      A. De Marchi and A. Themelis
    • Journal Title

      Journal of Optimization Theory and Applications

      Volume: 194 Issue: 3 Pages: 771-794

    • DOI

      10.1007/s10957-022-02048-5

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Bregman Finito/MISO for nonconvex regularized finite sum minimization without Lipschitz gradient continuity2022

    • Author(s)
      P. Latafat, A. Themelis, M. Ahookhosh and P. Patrinos
    • Journal Title

      SIAM Journal on Optimization

      Volume: 32 Issue: 3 Pages: 2230-2262

    • DOI

      10.1137/21m140376x

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Flock navigation with dynamic hierarchy and subjective weights using nonlinear MPC2022

    • Author(s)
      A. Nag, S. Huang, A. Themelis and Yamamoto, Kaoru
    • Journal Title

      IEEE Conference on Control Technology and Applications

      Volume: - Pages: 1135-1140

    • DOI

      10.1109/ccta49430.2022.9966067

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Douglas-Peucker piecewise affine approximation of an optimal fuel consumption problem to apply PANOC2022

    • Author(s)
      H. Ou, A. Themelis, T. Yuno and T. Kawabe
    • Journal Title

      SICE International Symposium on Control Systems

      Volume: - Pages: 34-38

    • DOI

      10.23919/siceiscs54350.2022.9754372

    • Related Report
      2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] QPALM: A proximal augmented Lagrangian method for nonconvex quadratic programs2022

    • Author(s)
      B. Hermans, A. Themelis, and P. Patrinos
    • Journal Title

      Mathematical Programming Computation

      Volume: - Issue: 3 Pages: 497-541

    • DOI

      10.1007/s12532-022-00218-0

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Bregman forward-backward linesearch algorithm for nonconvex composite optimization: Superlinear convergence to nonisolated local minima2021

    • Author(s)
      M. Ahookhosh, A. Themelis, and P. Patrinos
    • Journal Title

      SIAM Journal on Optimization

      Volume: 31 Issue: 1 Pages: 653-685

    • DOI

      10.1137/19m1264783

    • NAID

      120007029157

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Neural network training as an optimal control problem: An augmented Lagrangian approach2021

    • Author(s)
      B. Evens, P. Latafat, A. Themelis, J. Suykens, and P. Patrinos
    • Journal Title

      60th IEEE Conference on Decision and Control

      Volume: - Pages: 5136-5143

    • DOI

      10.1109/cdc45484.2021.9682842

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Lasry-Lions envelopes and nonconvex optimization: A homotopy approach2021

    • Author(s)
      M. Simoes, A. Themelis, and P. Patrinos
    • Journal Title

      29th IEEE European Signal Processing Conference

      Volume: - Pages: 2089-2093

    • DOI

      10.23919/eusipco54536.2021.9616167

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Adaptive proximal algorithms for convex optimization under local Lipschitz continuity of the gradient2023

    • Author(s)
      Andreas Themelis
    • Organizer
      10th International Congress on Industrial and Applied Mathematics
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Adaptive proximal gradient methods for convex bilevel optimization2023

    • Author(s)
      Andreas Themelis
    • Organizer
      Control & Optimisation Pisa 2023
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] Globalized Newton-type algorithms for nonsmooth nonconvex structured optimization2023

    • Author(s)
      Andreas Themelis
    • Organizer
      Invited event at Chongqing Normal University https://math.cqnu.edu.cn/info/1144/8877.htm
    • Related Report
      2023 Research-status Report
    • Invited
  • [Presentation] inertia and relative smoothness in nonconvex minimization a case study on the forward-reflected-backward algorithm2022

    • Author(s)
      Andreas Themelis
    • Organizer
      International Workshop on Continuous Optimization
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Splitting algorithms for nonconvex optimization: Unified analysis and Newton-type acceleration2022

    • Author(s)
      Andreas Themelis
    • Organizer
      NPU Optimization Seminar
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Douglas-Peucker piecewise affine approximation of an optimal fuel consumption problem to apply PANOC2022

    • Author(s)
      Hongjia Ou
    • Organizer
      2022 SICE International Symposium on Control Systems
    • Related Report
      2022 Research-status Report
  • [Presentation] Flock navigation with dynamic hierarchy and subjective weights using nonlinear MPC2022

    • Author(s)
      Kaoru Yamamoto
    • Organizer
      2022 IEEE Conference on Control Technology and Applications
    • Related Report
      2022 Research-status Report
    • Invited
  • [Presentation] Deadlock avoidance for robot navigation with potential field method in an unknown environment2022

    • Author(s)
      Ryota Kubo
    • Organizer
      Japan Joint Automatic Control Conference
    • Related Report
      2022 Research-status Report

URL: 

Published: 2021-04-28   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi