• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Online Decision Making Based on Random Sampling

Research Project

Project/Area Number 15H02667
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Theory of informatics
Research InstitutionKyushu University

Principal Investigator

Takimoto Eiji  九州大学, システム情報科学研究院, 教授 (50236395)

Co-Investigator(Kenkyū-buntansha) 畑埜 晃平  九州大学, 基幹教育院, 准教授 (60404026)
Project Period (FY) 2015-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥12,350,000 (Direct Cost: ¥9,500,000、Indirect Cost: ¥2,850,000)
Fiscal Year 2018: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2017: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
Fiscal Year 2016: ¥2,600,000 (Direct Cost: ¥2,000,000、Indirect Cost: ¥600,000)
Fiscal Year 2015: ¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Keywords計算学習理論 / オンライン予測 / オンラインアルゴリズム / 組合せ最適化 / ブースティング / 時系列データ / ZDD / 競合比解析 / メトリカルタスクシステム問題
Outline of Final Research Achievements

We proposed high accuracy and efficient algorithms for various problems of online decision making, machine learning and combinatorial optimization, by using the methodology of random sampling. Among them we give two main achievements below. (1) We showed that the metrical task system problem over a combinatorial decision space can be reduced to the problem of random sampling over the decision space, and using the reduction we succeeded to give, for the first time, high accuracy and efficient algorithms for various combinatorial decision spaces such as paths of a graph. (2) We proposed a new approach toward large scale machine learning: compress the given training data into a ZDD, and simulate Boosting efficiently over the ZDD (without decompression), based on an online prediction method over the set of accepting paths as the decision space.

Academic Significance and Societal Importance of the Research Achievements

メトリカルタスクシステム(MTS)問題は,組合せ集合を決定空間とする場合,効率の良いアルゴリズムの統一的で有用な設計法は知られていなかった.本研究は,この問題に対し,ランダムサンプリングの設計問題に落とし込むという,世界初の統一的・現実的な設計指針を与えたといえる.また,大規模機械学習の問題に対し,従来は,確率的勾配降下法などのランダムサンプリングに基づくアプローチが主流であったが,本研究では,圧縮データ上の機械学習という新しいアプローチを提案している.計算時間とメモリ効率の向上を同時に達成する画期的な手法であるだけでなく,圧縮データ上の最適化という新たな研究の方向性を示唆している.

Report

(5 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Annual Research Report
  • 2016 Annual Research Report
  • 2015 Annual Research Report
  • Research Products

    (52 results)

All 2018 2017 2016 2015 Other

All Int'l Joint Research (5 results) Journal Article (12 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 12 results,  Open Access: 9 results,  Acknowledgement Compliant: 4 results) Presentation (34 results) (of which Int'l Joint Research: 4 results,  Invited: 1 results) Book (1 results)

  • [Int'l Joint Research] Technion(イスラエル)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] CWI(オランダ)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] University of California, Santa Cruz/University of California, Berkeley(米国)

    • Related Report
      2015 Annual Research Report
  • [Int'l Joint Research] Queensland University of Technology(オーストラリア)

    • Related Report
      2015 Annual Research Report
  • [Int'l Joint Research] 天津科技大学(中国)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] Online Combinatorial Optimization with Multiple Projections and Its Application to Scheduling Problem2018

    • Author(s)
      FUJITA Takahiro, HATANO Kohei, KIJIMA Shuji, TAKIMOTO Eiji
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E101.A Issue: 9 Pages: 1334-1343

    • DOI

      10.1587/transfun.E101.A.1334

    • NAID

      130007479529

    • ISSN
      0916-8508, 1745-1337
    • Year and Date
      2018-09-01
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Tighter Generalization Bounds for Matrix Completion Via Factorization Into Constrained Matrices2018

    • Author(s)
      MORIDOMI Ken-ichiro, HATANO Kohei, TAKIMOTO Eiji
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101.D Issue: 8 Pages: 1997-2004

    • DOI

      10.1587/transinf.2017EDP7339

    • NAID

      130007429268

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2018-08-01
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Online Linear Optimization with the Log-Determinant Regularizer2018

    • Author(s)
      MORIDOMI Ken-ichiro, HATANO Kohei, TAKIMOTO Eiji
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101.D Issue: 6 Pages: 1511-1520

    • DOI

      10.1587/transinf.2017EDP7317

    • NAID

      130007382405

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2018-06-01
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Decision Diagrams for Solving a Job Scheduling Problem Under Precedence Constraints2018

    • Author(s)
      Kosuke Matsumoto, Kohei Hatano, Eiji Takimoto
    • Journal Title

      SEA 2018

      Volume: -

    • DOI

      10.4230/LIPIcs.SEA.2018.5

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Boosting over non-deterministic ZDDs2018

    • Author(s)
      Takahiro Fujita, Kohei Hatano and Eiji Takimoto
    • Journal Title

      Proceedings of the 12th International Conference of International Workshop on Algorithms and Computation(WALCOM 2018)

      Volume: LNCS 10755 Pages: 195-206

    • DOI

      10.1007/978-3-319-75172-6_17

    • NAID

      120006654944

    • ISBN
      9783319751719, 9783319751726
    • Related Report
      2017 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Efficient Reformulation of 1-Norm Ranking SVM2018

    • Author(s)
      Daiki Suehiro, Kohei Hatano, Eiji Takimoto
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E101-D (3) Pages: 719-729

    • NAID

      130006414035

    • Related Report
      2017 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Bandit Online Optimization Over the Permutahedron2016

    • Author(s)
      Nir Ailon, Kohei Hatano, Eiji Takimoto
    • Journal Title

      Theoretical Computer Science

      Volume: 650 Pages: 92-108

    • DOI

      10.1016/j.tcs.2016.07.033

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] A Combinatorial Metrical Task System Problem Under the Uniform Metric2016

    • Author(s)
      Takumi Nakazono, Ken-ichiro Moridomi, Kohei Hatano, Eiji Takimoto
    • Journal Title

      Proc. 27th International Conference on Algorithmic Learning Theory (ALT 2016), Lecture Notes in Artificial Intelligence

      Volume: 9925 Pages: 1577-1586

    • DOI

      10.1007/978-3-319-46379-7_19

    • NAID

      120006654945

    • ISBN
      9783319463780, 9783319463797
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] An Online Policy Gradient Algorithm for Continuous State and Action Markov Decision Processes2015

    • Author(s)
      Yao Ma, Tingting Zhao, Kohei Hatano, Masashi Sugiyama
    • Journal Title

      Neural Computation

      Volume: 28 Issue: 3 Pages: 563-593

    • DOI

      10.1162/neco_a_00808

    • Related Report
      2016 Annual Research Report 2015 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Online Linear Optimization for Job Scheduling under Precedence Constraints2015

    • Author(s)
      Takahiro Fujita, Kohei Hatano, Shuji Kijima, Eiji Takimoto
    • Journal Title

      Proc. 26th International Conference on Algorithmic Learning Theory (ALT 2015), Lecture Notes in Computer Science

      Volume: 9355 Pages: 332-346

    • DOI

      10.1007/978-3-319-24486-0_22

    • NAID

      120006654679

    • ISBN
      9783319244853, 9783319244860
    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Minimax Fixed-Design Linear Regression2015

    • Author(s)
      Peter Bartlett, Wouter Koolen, Alan Malek, Eiji Takimoto, Manfred Warmuth
    • Journal Title

      Proceedings of The 28th Conference on Learning Theory (COLT 2015), JMLR: Workshop and Conference Proceedings

      Volume: 40 Pages: 226-239

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Online Density Estimation of Bradley-Terry Models2015

    • Author(s)
      Issei Matsumoto, Kohei Hatano, Eiji Takimoto
    • Journal Title

      Proceedings of The 28th Conference on Learning Theory (COLT 2015), JMLR: Workshop and Conference Proceedings

      Volume: 40 Pages: 1343-1359

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Presentation] MDDの拡張による線形順序拡大集合の省領域表現とスケジューリング問題への応用2018

    • Author(s)
      三宅 郁人,瀧本 英二,畑埜 晃平
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] MDDの拡張による線形順序拡大集合の省領域表現とスケジューリング問題への応用2018

    • Author(s)
      三宅 郁人,瀧本 英二,畑埜 晃平
    • Organizer
      アルゴリズム研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Frank-Wolfe型ブースティングの高速化2018

    • Author(s)
      三星 諒太朗,畑埜 晃平,瀧本 英二
    • Organizer
      第21回情報論的学習理論ワークショップ(IBIS2018)
    • Related Report
      2018 Annual Research Report
  • [Presentation] Improved Mistake Bounds for Binary Matrix Completion2018

    • Author(s)
      Liu Yaxiong, Ken-ichiro Moridmomi, Kohei Hatano, Eiji Takimoto
    • Organizer
      第21回情報論的学習理論ワークショップ(IBIS2018)
    • Related Report
      2018 Annual Research Report
  • [Presentation] Shapelet-based Multiple-Instance Learning2018

    • Author(s)
      Daiki Suehiro, Kohei Hatano, Eiji Takimoto, Shuji Yamamoto, Kenichi Bannai, Akiko Takeda
    • Organizer
      情報論的学習理論と機械学習研究会(IBISML)
    • Related Report
      2018 Annual Research Report
  • [Presentation] Frank-Wolfe型ブースティング2018

    • Author(s)
      三星諒太朗,畑埜晃平,瀧本英二
    • Organizer
      冬のLAシンポジウム
    • Related Report
      2017 Annual Research Report
  • [Presentation] Combinatorial bandit prediction with relaxation-based approximation algorithms2018

    • Author(s)
      Ryohei Nagaura, Kohei Hatano, Eiji Takimoto
    • Organizer
      アルゴリズム研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 正規化マージンを用いたしきい値回路の性能評価2017

    • Author(s)
      坂口慶介, 内澤啓,瀧本英二
    • Organizer
      電子情報通信学会総合大会COMP-ELC学生シンポジウム
    • Place of Presentation
      名城大学(愛知県・名古屋市)
    • Year and Date
      2017-03-23
    • Related Report
      2016 Annual Research Report
  • [Presentation] ノルム制約付き行列分解に基づいた行列補完問題に対する汎化誤差の導出2017

    • Author(s)
      森富賢一郎, 畑埜晃平, 瀧本英二
    • Organizer
      電子情報通信学会IBISML研究会
    • Place of Presentation
      東京工業大学(東京都)
    • Year and Date
      2017-03-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] FPLを用いた組合せ集合に対するオンライン予測2017

    • Author(s)
      森富賢一郎, 畑埜晃平, 瀧本英二
    • Organizer
      冬のLAシンポジウム
    • Place of Presentation
      京都大学(京都府・京都市)
    • Year and Date
      2017-02-02
    • Related Report
      2016 Annual Research Report
  • [Presentation] LogDet正則化を用いた二値行列補完2017

    • Author(s)
      森富賢一郎,畑埜晃平,瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2017 Annual Research Report
  • [Presentation] 段階的平滑化と確率的MM法を用いた非凸最適化2017

    • Author(s)
      三宅郁人,畑埜晃平,瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2017 Annual Research Report
  • [Presentation] BDD/ZDD上のブースティング2017

    • Author(s)
      藤田隆寛,畑埜晃平,瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Related Report
      2017 Annual Research Report
  • [Presentation] Boosting over ZDDs2017

    • Author(s)
      Takahiro Fujita, Kohei Hatano, Eiji Takimoto
    • Organizer
      The 20th Korea-Japan Joint Workshop on Algorithms and Computation
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Online decision making over combinatorial sets2017

    • Author(s)
      Eiji Takimoto
    • Organizer
      The 20th Korea-Japan Joint Workshop on Algorithms and Computation
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Learning theory and algorithms for shapelets and other local features2017

    • Author(s)
      Daiki Suehiro, Kohei Hatano, Eiji Takimoto, Shuji Yamamoto, Kenichi Bannai, Akiko Takeda
    • Organizer
      第20回情報論的学習理論ワークショップ(IBIS 2017)
    • Related Report
      2017 Annual Research Report
  • [Presentation] LogDet正則化を用いた二値行列補完2017

    • Author(s)
      森富賢一郎,畑埜晃平,瀧本英二
    • Organizer
      第20回情報論的学習理論ワークショップ(IBIS 2017)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Learning theory and algorithms for shapelets and other local features2017

    • Author(s)
      Daiki Suehiro, Kohei Hatano, Eiji Takimoto, Shuji Yamamoto, Kenichi Bannai, Akiko Takeda
    • Organizer
      情報論的学習理論と機械学習研究会(IBISML)
    • Related Report
      2017 Annual Research Report
  • [Presentation] Learning theory and algorithms for shapelets and other local features2017

    • Author(s)
      Daiki Suehiro, Kohei Hatano, Eiji Takimoto, Shuji Yamamoto, Kenichi Bannai, Akiko Takeda
    • Organizer
      NIPS 2017 Time Series Workshop
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Optimal mistake bounds for binary matrix completion via the log-determinant regularization2017

    • Author(s)
      Ken-ichiro Moridomi, Kohei Hatano, Eiji Takimoto
    • Organizer
      情報系Winter Festa Episode 3
    • Related Report
      2017 Annual Research Report
  • [Presentation] Time Series Classification Based on Random Shapelets2016

    • Author(s)
      Daiki Suehiro, Kengo Kuwahara, Kohei Hatano, Eiji Takimoto
    • Organizer
      Time Series Workshop in NIPS 2016
    • Place of Presentation
      バルセロナ(スペイン)
    • Year and Date
      2016-12-09
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 組合せ集合上のメトリカルタスクシステム問題2016

    • Author(s)
      中薗拓巳, 森富賢一郎, 畑埜晃平, 瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Place of Presentation
      かんぽの宿大和平群(奈良県・平群町)
    • Year and Date
      2016-07-21
    • Related Report
      2016 Annual Research Report
  • [Presentation] 正規化マージンを用いたしきい値回路の評価2016

    • Author(s)
      坂口慶介, 内澤啓, 瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Place of Presentation
      かんぽの宿大和平群(奈良県・平群町)
    • Year and Date
      2016-07-19
    • Related Report
      2016 Annual Research Report
  • [Presentation] 制約付きスケジューリング問題に対するπ-DDを用いた解法2016

    • Author(s)
      松本晃輔, 畑埜晃平, 瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Place of Presentation
      かんぽの宿大和平群(奈良県・平群町)
    • Year and Date
      2016-07-19
    • Related Report
      2016 Annual Research Report
  • [Presentation] 射影と分解に基づく敵対的バンディット予測2016

    • Author(s)
      永浦良平, 畑埜晃平, 瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Place of Presentation
      かんぽの宿大和平群(奈良県・平群町)
    • Year and Date
      2016-07-19
    • Related Report
      2016 Annual Research Report
  • [Presentation] k 集合に対する敵対的バンディット問題2016

    • Author(s)
      永浦良平, 畑埜晃平, 瀧本英二
    • Organizer
      電子情報通信学会IBISML研究会
    • Place of Presentation
      沖縄科学技術大学院大学(沖縄県・恩納村)
    • Year and Date
      2016-07-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] 相対評価に基づく協調ランキング問題2016

    • Author(s)
      森富賢一郎, 畑埜晃平, 瀧本英二
    • Organizer
      電子情報通信学会IBISML 研究会
    • Place of Presentation
      統計数理研究所(東京都・立川市)
    • Year and Date
      2016-03-17
    • Related Report
      2015 Annual Research Report
  • [Presentation] 累積的でない損失関数に対するオンライン予測2016

    • Author(s)
      森和香菜, 畑埜晃平, 瀧本英二
    • Organizer
      冬のLAシンポジウム
    • Place of Presentation
      京都大学(京都府・京都市)
    • Year and Date
      2016-01-26
    • Related Report
      2015 Annual Research Report
  • [Presentation] 相対評価に基づく協調ランキング問題2015

    • Author(s)
      森富賢一郎, 畑埜晃平, 瀧本英二
    • Organizer
      第18回情報論的学習理論ワークショップ (IBIS2015)
    • Place of Presentation
      つくば国際会議場(茨城県・つくば市)
    • Year and Date
      2015-11-26
    • Related Report
      2015 Annual Research Report
  • [Presentation] 特徴と標本の同時セーフスクリーニン グ2015

    • Author(s)
      柴垣篤志, 小川晃平, 畑埜晃平, 竹内一郎
    • Organizer
      第18回情報論的学習理論ワークショップ (IBIS2015)
    • Place of Presentation
      つくば国際会議場(茨城県・つくば市)
    • Year and Date
      2015-11-26
    • Related Report
      2015 Annual Research Report
  • [Presentation] しきい値回路による特徴写像2015

    • Author(s)
      坂口慶介, 内澤啓, 瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Place of Presentation
      ゆのくに天祥(石川県・加賀市)
    • Year and Date
      2015-07-16
    • Related Report
      2015 Annual Research Report
  • [Presentation] マハラノビス距離のオンライン予測2015

    • Author(s)
      森富賢一郎, 畑埜晃平, 瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Place of Presentation
      ゆのくに天祥(石川県・加賀市)
    • Year and Date
      2015-07-15
    • Related Report
      2015 Annual Research Report
  • [Presentation] 離散最適化問題に対するZDD構築2015

    • Author(s)
      松本晃輔, 畑埜晃平, 瀧本英二
    • Organizer
      夏のLAシンポジウム
    • Place of Presentation
      ゆのくに天祥(石川県・加賀市)
    • Year and Date
      2015-07-14
    • Related Report
      2015 Annual Research Report
  • [Presentation] Bradley-Terry モデルのオンライン密度推定2015

    • Author(s)
      松本一成, 畑埜晃平, 瀧本英二
    • Organizer
      電子情報通信学会IBISML 研究会
    • Place of Presentation
      沖縄科学技術大学院大学(沖縄県・恩納村)
    • Year and Date
      2015-06-25
    • Related Report
      2015 Annual Research Report
  • [Book] オンライン予測(機械学習プロフェッショナルシリーズ)2016

    • Author(s)
      畑埜晃平, 瀧本英二
    • Total Pages
      176
    • Publisher
      講談社サイエンティフィク
    • Related Report
      2016 Annual Research Report

URL: 

Published: 2015-04-16   Modified: 2022-02-02  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi