• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Establishing a practical learning theory based on the analysis of learning from easy data

Research Project

Project/Area Number 19H04067
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 60010:Theory of informatics-related
Research InstitutionKyushu University

Principal Investigator

Takimoto Eiji  九州大学, システム情報科学研究院, 教授 (50236395)

Co-Investigator(Kenkyū-buntansha) 畑埜 晃平  九州大学, 基幹教育院, 准教授 (60404026)
Project Period (FY) 2019-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥16,380,000 (Direct Cost: ¥12,600,000、Indirect Cost: ¥3,780,000)
Fiscal Year 2022: ¥3,250,000 (Direct Cost: ¥2,500,000、Indirect Cost: ¥750,000)
Fiscal Year 2021: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2020: ¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2019: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000)
Keywords計算学習理論 / オンライン意思決定 / 情報圧縮 / バンディット問題 / 決定ダイアグラム / 組合せ最適化 / 決定グラフ / ゲーム理論 / オンライン予測 / 行列補完問題 / 学習容易性解析 / センサーネットワーク / 計算量理論 / 負荷分散 / シェイプレット / ZDD / ブースティング / 大規模機械学習 / くずし字認識 / モデリング
Outline of Research at the Start

機械学習の分野では,優れた理論保証を持つ手法よりも,理論保証の無い/悪い発見的手法の方が,実データに対しては良い性能を示すことが良くある.本研究では,このような理論と実践の乖離現象を,データそのものの学習容易性/複雑性解析を通して解明し,実データに対する学習アルゴリズムの高精度な性能解析技法の開発を目指す.また,学習容易性の解析を通して,データ生成源に関する新しい自然科学的・人文科学的な解釈・知見を与える.

Outline of Final Research Achievements

Introduceing various easiness measures of data, we worked on various topics with the aim of establishing a theory that provides more precise theoretical guarantees for the performance of learning algorithms. We obtained the following main results. (1) Using the data compression rate as an easiness measure, we developed learning algorithms and combinatorial optimization algorithms that operate faster as the compression rate increases. (2) We developed various online decision making algorithms using matrix rank and margin as easiness measures. (3) We showed that any of a wide class of learning problems is reducible to a specific learning problem in the sense that generalization performance (that is, the easiness of data to learn) is preserved.

Academic Significance and Societal Importance of the Research Achievements

圧縮データ上の学習や最適化に関する成果は,圧縮が単にメモリの節約になるだけでなく,計算効率も向上することにつながることを示したという点で意義が高い.また,圧縮データに基づき拡張定式化を自動生成する手法は,極めて汎用性が高く,おそらく世界初のものである.オンライン意思決定に関する成果は,商品推薦システムにおいて,商品間の類似関係と顧客の購買傾向に相関がある場合に,高い確度で,顧客が欲する商品を提示することができることを意味しており,データ容易性に自然で有用な解釈を与えたという意味でも意義が高い.学習問題間の還元に関する成果は,学習容易性還元という新たな概念を生み出し,今後の展開が期待できる.

Report

(5 results)
  • 2023 Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • 2019 Annual Research Report
  • Research Products

    (48 results)

All 2023 2022 2021 2020 2019 2018 Other

All Int'l Joint Research (7 results) Journal Article (17 results) (of which Int'l Joint Research: 8 results,  Peer Reviewed: 17 results,  Open Access: 7 results) Presentation (24 results)

  • [Int'l Joint Research] Amazon/Idaho State University(米国)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Aswan University(エジプト)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Prince Sattam Bin Abdulaziz University(サウジアラビア)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Western University(カナダ)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] University of Rovira i Virgili(スペイン)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Microsoft(米国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Microsoft(米国)

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Load Balancing Multi-Player MAB Approaches for RIS-Aided mmWave User Association2023

    • Author(s)
      Mohamed Ehab Mahmoud、Hashima Sherief、Hatano Kohei、Takimoto Eiji、Abdel-Nasser Mohamed
    • Journal Title

      IEEE Access

      Volume: 11 Pages: 15816-15830

    • DOI

      10.1109/access.2023.3244781

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] On Enhancing WiGig Communications With A UAV-Mounted RIS System: A Contextual Multi-Armed Bandit Approach2023

    • Author(s)
      Sherief Hashima, Ehab Mahmoud Mohamed, Kohei Hatano, Eiji Takimoto, Mostafa M. Fouda, Zubair Md. Fadlullah
    • Journal Title

      Proceedings of the 34th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC 2023)

      Volume: - Pages: 1-7

    • DOI

      10.1109/pimrc56721.2023.10293924

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Budgeted Thompson Sampling for IRS Enabled WiGig Relaying2023

    • Author(s)
      Hashima Sherief、Hatano Kohei、Takimoto Eiji、Mohamed Ehab Mahmoud
    • Journal Title

      Electronics

      Volume: 12 Issue: 5 Pages: 1146-1146

    • DOI

      10.3390/electronics12051146

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Multi-Armed Bandit-Aided Near-Optimal Over-The-Air Updates in Multi-Band V2X Systems2023

    • Author(s)
      Sherief Hashima, Mostafa M Fouda, Kohei Hatano, Eiji Takimoto, Zubair Md Fadlullah
    • Journal Title

      5th International Conference on Computer Communication and the Internet (ICCCI 2023)

      Volume: 5 Pages: 179-184

    • DOI

      10.1109/iccci59363.2023.10210156

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Advanced Learning Schemes for Metaverse Applications in B5G/6G Networks2023

    • Author(s)
      Sherief Hashima, Mostafa M Fouda, Kohei Hatano, Eiji Takimoto
    • Journal Title

      IEEE International Conference on Metaverse Computing, Networking and Applications (MetaCom 2023)

      Volume: 2023 Pages: 799-804

    • DOI

      10.1109/metacom57706.2023.00150

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] An Online Semi-Definite Programming with a Generalized Log-Determinant Regularizer and Its Applications2022

    • Author(s)
      Liu Yaxiong、Moridomi Ken-ichiro、Hatano Kohei、Takimoto Eiji
    • Journal Title

      Mathematics

      Volume: 10 Issue: 7 Pages: 1055-1055

    • DOI

      10.3390/math10071055

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Simplified and Unified Analysis of Various Learning Problems by Reduction to Multiple-Instance Learning2022

    • Author(s)
      Daiki Suehiro, Eiji Takimoto
    • Journal Title

      Proceedings of the 38th Conference on Uncertainty in Artificial Intelligence (UAI 2022), PMLR

      Volume: 180 Pages: 1896-1906

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Expert advice problem with noisy low rank loss2021

    • Author(s)
      Yaxiong Liu, Xuanke Jiang, Kohei Hatano, Eiji Takimoto
    • Journal Title

      Proceedings of 13th Asian Conference on Machine Learning (ACML 2021), PMLR

      Volume: 157 Pages: 1097-1112

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] An online semi-definite programming with a generalised log-determinant regularizer and its applications2021

    • Author(s)
      Yaxiong Liu, Ken-ichiro Moridomi, Kohei Hatano, Eiji Takimoto
    • Journal Title

      Proceedings of 13th Asian Conference on Machine Learning (ACML 2021), PMLR

      Volume: 157 Pages: 1113-1128

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] WiGig Wireless Sensor Selection Using Sophisticated Multi Armed Bandit Schemes2021

    • Author(s)
      Sherief Hashima, Ehab Mahmoud Mohamed, Kohei Hatano, Eiji Takimoto
    • Journal Title

      Proceedings of 13th International Conference on Mobile Computing and Ubiquitous Network (ICMU 2021)

      Volume: - Pages: 1-6

    • DOI

      10.23919/icmu50196.2021.9638849

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Improved Algorithms for Online Load Balancing2021

    • Author(s)
      Liu Yaxiong、Hatano Kohei、Takimoto Eiji
    • Journal Title

      Proceedings of the 47th International Conference on Current Trends in Theory and Practice of Computer Science(SOFSEM 2021)

      Volume: LNCS 12607 Pages: 203-217

    • DOI

      10.1007/978-3-030-67731-2_15

    • NAID

      120007164565

    • ISBN
      9783030677305, 9783030677312
    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Minimax Optimal Stochastic Strategy (MOSS) For Neighbor Discovery and Selection In Millimeter Wave D2D Networks2020

    • Author(s)
      Hashima Sherief、Hatano Kohei、Takimoto Eiji、Mohamed Ehab Mahmoud
    • Journal Title

      Proceedings of the 23rd International Symposium on Wireless Personal Multimedia Communications (WPMC 2020)

      Volume: - Pages: 1-6

    • DOI

      10.1109/wpmc50192.2020.9309495

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Theory and Algorithms for Shapelet-Based Multiple-Instance Learning2020

    • Author(s)
      Suehiro Daiki、Hatano Kohei、Takimoto Eiji、Yamamoto Shuji、Bannai Kenichi、Takeda Akiko
    • Journal Title

      Neural Computation

      Volume: 32 Issue: 8 Pages: 1580-1613

    • DOI

      10.1162/neco_a_01297

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Neighbor Discovery and Selection in Millimeter Wave D2D Networks Using Stochastic MAB2020

    • Author(s)
      Hashima Sherief、Hatano Kohei、Takimoto Eiji、Mahmoud Mohamed Ehab
    • Journal Title

      IEEE Communications Letters

      Volume: 24 Issue: 8 Pages: 1840-1844

    • DOI

      10.1109/lcomm.2020.2991535

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Recognition of Japanese Historical Hand-Written Characters Based on Object Detection Methods2019

    • Author(s)
      Tang Yiping、Hatano Kohei、Takimoto Eiji
    • Journal Title

      Proceedings of the 2019 Workshop on Historical Document Imaging and Processing(HIP 2019)

      Volume: - Pages: 72-77

    • DOI

      10.1145/3352631.3352642

    • NAID

      120006770940

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Succinct Representation of Linear Extensions via MDDs and Its Application to Scheduling Under Precedence Constraints2019

    • Author(s)
      Fumito Miyake, Eiji Takimoto, Kohei Hatano
    • Journal Title

      Proceedings of the 30th International Workshop on Combinatorial Algorithms (IWOCA 2019)

      Volume: LNCS 11638 Pages: 365-377

    • DOI

      10.1007/978-3-030-25005-8_30

    • NAID

      120007164566

    • ISBN
      9783030250041, 9783030250058
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Boosting over non-deterministic ZDDs2018

    • Author(s)
      Takahiro Fujita, Kohei Hatano and Eiji Takimoto
    • Journal Title

      Theoretical Computer Science

      Volume: - Pages: 81-89

    • DOI

      10.1016/j.tcs.2018.11.027

    • NAID

      120006654944

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 差集合演算の導入による非決定性ZDDの拡張と集合間類似検索への応用2023

    • Author(s)
      鹿間 翔太,中山 寛文,畑埜 晃平,瀧本 英二
    • Organizer
      冬のLAシンポジウム
    • Related Report
      2022 Annual Research Report
  • [Presentation] Online Job Scheduling with K Servers2023

    • Author(s)
      Jiang Xuanke, Sherief Hashima, Kohei Hatano, Eiji Takimoto
    • Organizer
      冬のLAシンポジウム
    • Related Report
      2022 Annual Research Report
  • [Presentation] フランク・ウルフ法に基づく1-ノルム正則化ソフトマージン最適化2023

    • Author(s)
      三星 諒太朗, 畑埜 晃平, 瀧本 英二
    • Organizer
      日本オペレーションズ・リサーチ学会 2023 年春季研究発表会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 決定ダイアグラムに基づく線形制約付き最適化問題の拡張定式化2023

    • Author(s)
      黒河 祐太, 三星 諒太朗, 浜崎 晴輝, 畑埜 晃平, 瀧本 英二, Horakou Rahmanian
    • Organizer
      日本オペレーションズ・リサーチ学会 2023 年春季研究発表会
    • Related Report
      2022 Annual Research Report
  • [Presentation] ブースティングに基づく高速なメタラウンディング2023

    • Author(s)
      三星 諒太朗, 畑埜 晃平, 瀧本 英二
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2022 Annual Research Report
  • [Presentation] 非決定性ZDDに基づく整数計画問題の拡張定式化2022

    • Author(s)
      浜崎 晴輝,黒河 祐太,三星 諒太朗,畑埜 晃平,瀧本 英二
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2022 Annual Research Report
  • [Presentation] Compressed ERLPBoost2022

    • Author(s)
      Ryotaro Mitsuboshi, Kohei Hatano, Eiji Takimoto
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2022 Annual Research Report
  • [Presentation] フランク・ウルフ法としてのブースティング2022

    • Author(s)
      三星 諒太朗,畑埜 晃平,瀧本 英二
    • Organizer
      第25回情報論的学習理論ワークショップ(IBIS 2022)
    • Related Report
      2022 Annual Research Report
  • [Presentation] 決定ダイアグラムに基づく拡張定式化2022

    • Author(s)
      黒河 祐太,三星 諒太朗,浜崎 晴輝,畑埜 晃平,瀧本 英二,Horakou Rahmanian
    • Organizer
      第25回情報論的学習理論ワークショップ(IBIS 2022)
    • Related Report
      2022 Annual Research Report
  • [Presentation] 2次元空間上の線形閾値関数2022

    • Author(s)
      三星 諒太朗, 畑埜 晃平, 瀧本 英二
    • Organizer
      冬のLAシンポジウム
    • Related Report
      2021 Annual Research Report
  • [Presentation] Blackwell ゲームへの帰着に基づく一般化順列のオンライン予測2022

    • Author(s)
      大塚 玲, 小永吉 健太, 畑埜 晃平, 瀧本 英二
    • Organizer
      冬のLAシンポジウム
    • Related Report
      2021 Annual Research Report
  • [Presentation] Expert advice problem with noisy low rank loss2021

    • Author(s)
      Yaxiong Liu, Xuanke Jiang, Kohei Hatano, Eiji Takimoto
    • Organizer
      第24回情報論的学習理論ワークショップ(IBIS 2021)
    • Related Report
      2021 Annual Research Report
  • [Presentation] An online semi-definite programming with a generalised log-determinant regularizer and its applications2021

    • Author(s)
      Yaxiong Liu, Ken-ichiro Moridomi, Kohei Hatano, Eiji Takimoto
    • Organizer
      第24回情報論的学習理論ワークショップ(IBIS 2021)
    • Related Report
      2021 Annual Research Report
  • [Presentation] O(m log m) 時間で更新するブースティングの枠組み2021

    • Author(s)
      三星 諒太朗, 畑埜 晃平, 瀧本 英二
    • Organizer
      STRセミナー
    • Related Report
      2020 Annual Research Report
  • [Presentation] 一般化された順列集合上での線形近似可能関数のブラックボックス最適化2021

    • Author(s)
      平 理輝, 畑埜 晃平, 瀧本 英二
    • Organizer
      STRセミナー
    • Related Report
      2020 Annual Research Report
  • [Presentation] 順列ベクトルに対するBlackwell ゲームに基づくオンライン線形最適化2021

    • Author(s)
      小永吉 健太, 畑埜 晃平, 瀧本 英二
    • Organizer
      STRセミナー
    • Related Report
      2020 Annual Research Report
  • [Presentation] あるオンラインスケジューリング問題に対する Blackwell ゲームに基づくアプローチ2021

    • Author(s)
      飯田 一樹, 畑埜 晃平, 瀧本 英二
    • Organizer
      STRセミナー
    • Related Report
      2020 Annual Research Report
  • [Presentation] データの決定ダイアグラム表現に基づく1ノルム正則化ソフトマージン最適化2020

    • Author(s)
      黒河 祐太, 三星 諒太朗,畑埜 晃平,瀧本 英二, Holakou Rahmanian
    • Organizer
      第23回情報論的学習理論ワークショップ(IBIS2020)
    • Related Report
      2020 Annual Research Report
  • [Presentation] ZDD圧縮データ上のマージン最大化2020

    • Author(s)
      黒河 祐太,畑埜 晃平,瀧本 英二
    • Organizer
      冬のLAシンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] 乱択と線形計画法に基づくソフトマージン最適化2020

    • Author(s)
      三星 諒太朗,畑埜 晃平,瀧本 英二
    • Organizer
      電子情報通信学会IBISML研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 非線形損失に対するオンライン組合せ最適化2019

    • Author(s)
      早田 圭吾,瀧本 英二,畑埜 晃平
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] Improved algorithms for online load balancing2019

    • Author(s)
      Yaxiong Liu, Kohei Hatano, Eiji Takimoto
    • Organizer
      情報処理学会アルゴリズム研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 線形計画法に基づくブースティング手法の収束性解析2019

    • Author(s)
      三星 諒太朗,畑埜 晃平,瀧本 英二
    • Organizer
      第22回情報論的学習理論ワークショップ(IBIS2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 第23回PRMU研究会アルゴリズムコンテスト実施報告 ~ くずし字認識チャレンジ2019 ~2019

    • Author(s)
      唐 一平,畑埜 晃平,瀧本 英二
    • Organizer
      電子情報通信学会PRMU研究会
    • Related Report
      2019 Annual Research Report

URL: 

Published: 2019-04-18   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi