• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Design Principles of Learning and Inference Models with Optimal Latent Distributions

Research Project

Project/Area Number 15K16050
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Intelligent informatics
Research InstitutionToyohashi University of Technology

Principal Investigator

Watanabe Kazuho  豊橋技術科学大学, 工学(系)研究科(研究院), 講師 (10506744)

Project Period (FY) 2015-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥3,900,000 (Direct Cost: ¥3,000,000、Indirect Cost: ¥900,000)
Fiscal Year 2018: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2017: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2016: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2015: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywordsレート歪み関数 / 再構成分布 / イプシロン不感応損失 / ディリクレ過程平均法 / ミニマックス予測 / スパース回帰符号 / 経験ベイズ法 / 一般化事後分布 / 一般化ガウス情報源 / カーネル関数 / 漸近的ミニマックス性
Outline of Final Research Achievements

We evaluated the rate-distortion functions of practical loss functions such as epsilon-insensitive distortion measures and those defined with kernel functions, which demonstrate the performance of optimal lossy data compression systems under these distortion measures. We interpreted a recent clustering method to extract latent structure of data and the design of the prior distribution in Bayesian inference through the optimization of latent distributions, and provided their extensions and approximations. We developed a modified latent variable model for an interactive data analysis method based on data visualization, and examined its performance through its applications to some real datasets.

Academic Significance and Societal Importance of the Research Achievements

レート歪み関数は歪み有りデータ圧縮の限界を示すため、イプシロン不感応損失やカーネル関数を用いた損失などの有用性が知られている歪み尺度において、圧縮法の性能評価や改良を与える際の基準が得られた。また、クラスタリング手法やベイズ推論における事前分布の設計において得られた拡張や近似法により、既存手法の個々の問題におけるより柔軟な適用や効率的な計算が可能になった。

Report

(5 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • 2015 Research-status Report
  • Research Products

    (51 results)

All 2019 2018 2017 2016 2015 Other

All Int'l Joint Research (2 results) Journal Article (16 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 16 results,  Open Access: 9 results,  Acknowledgement Compliant: 5 results) Presentation (29 results) (of which Int'l Joint Research: 9 results,  Invited: 4 results) Book (1 results) Remarks (3 results)

  • [Int'l Joint Research] University of Helsinki(Finland)

    • Related Report
      2016 Research-status Report
  • [Int'l Joint Research] ヘルシンキ大学(フィンランド)

    • Related Report
      2015 Research-status Report
  • [Journal Article] Empirical Bayes Estimation for <i>L</i><sub>1</sub> Regularization: A Detailed Analysis in the One-Parameter Lasso Model2018

    • Author(s)
      Yoshida Tsukasa、Watanabe Kazuho
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E101.A Issue: 12 Pages: 2184-2191

    • DOI

      10.1587/transfun.E101.A.2184

    • NAID

      130007539073

    • ISSN
      0916-8508, 1745-1337
    • Year and Date
      2018-12-01
    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] TimeTubes: Visual Exploration of Observed Blazar Datasets2018

    • Author(s)
      Fujishiro Issei、Sawada Naoko、Nakayama Masanori、Wu Hsiang-Yun、Watanabe Kazuho、Takahashi Shigeo、Uemura Makoto
    • Journal Title

      Journal of Physics: Conference Series

      Volume: 1036 Pages: 012011-012011

    • DOI

      10.1088/1742-6596/1036/1/012011

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Sparse Regression Code with Sparse Dictionary for Absolute Error Criterion2018

    • Author(s)
      Konabe Ryota、Watanabe Kazuho
    • Journal Title

      Proc. of IEEE International Symposium on Information Theory (ISIT2018)

      Volume: - Pages: 1515-1519

    • DOI

      10.1109/isit.2018.8437556

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Automatic DNN Node Pruning Using Mixture Distribution-based Group Regularization2018

    • Author(s)
      Yoshida Tsukasa、Moriya Takafumi、Watanabe Kazuho、Shinohara Yusuke、Yamaguchi Yoshikazu、Aono Yushi
    • Journal Title

      Proc. of Interspeech2018

      Pages: 1269-1273

    • DOI

      10.21437/interspeech.2018-2062

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Generalized Dirichlet-Process-Means for Robust and Maximum Distortion Criteria2018

    • Author(s)
      Kobayashi Masahiro、Watanabe Kazuho
    • Journal Title

      Proc. of International Symposium on Information Theory and its Applications (ISITA2018)

      Pages: 45-49

    • DOI

      10.23919/isita.2018.8664260

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures2017

    • Author(s)
      Watanabe Kazuho
    • Journal Title

      Entropy

      Volume: 19 Issue: 6 Pages: 262-262

    • DOI

      10.3390/e19060262

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Rate-Distortion Bounds for Kernel-Based Distortion Measures2017

    • Author(s)
      Watanabe Kazuho
    • Journal Title

      Entropy

      Volume: 19 Issue: 7 Pages: 336-336

    • DOI

      10.3390/e19070336

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] ディリクレ過程平均法のレートひずみ理論による解釈2017

    • Author(s)
      小林真佐大,渡辺一帆
    • Journal Title

      電子情報通信学会論文誌A

      Volume: J100-A Pages: 475-486

    • NAID

      120006412529

    • Related Report
      2017 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] TimeTubes: Visualization of Polarization Variations in Blazars2016

    • Author(s)
      Uemura M., Itoh R., Xu L., Nakayama M., Wu H., Watanabe K., Takahashi S., and Fujishiro I.
    • Journal Title

      Galaxies

      Volume: 4 Issue: 3 Pages: 23-23

    • DOI

      10.3390/galaxies4030023

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Rate-distortion functions for gamma-type sources under absolute-log distortion measure2016

    • Author(s)
      Kazuho Watanabe, Shiro Ikeda
    • Journal Title

      IEEE Transactions on Information Theory

      Volume: 62 Issue: 10 Pages: 5496-5502

    • DOI

      10.1109/tit.2016.2602100

    • Related Report
      2016 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Rate-Distortion Bounds for <i>ε</i>-Insensitive Distortion Measures2016

    • Author(s)
      Kazuho Watanabe
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E99.A Issue: 1 Pages: 370-377

    • DOI

      10.1587/transfun.E99.A.370

    • NAID

      130005115271

    • ISSN
      0916-8508, 1745-1337
    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Data-driven approach to Type Ia supernovae: variable selection on the peak luminosity and clustering in visual analytics2016

    • Author(s)
      Makoto Uemura, Koji S. Kawabata, Shiro Ikeda, Keiichi Maeda, Hsiang-Yun Wu, Kazuho Watanabe, Shigeo Takahashi, Issei Fujishiro
    • Journal Title

      Journal of Physics: Conference Series

      Volume: 699 Pages: 012009-012009

    • DOI

      10.1088/1742-6596/699/1/012009

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Asymmetric biclustering with constrained von Mises-Fisher models2016

    • Author(s)
      Kazuho Watanabe, Hsiang-Yun Wu, Shigeo Takahashi, Issei Fujishiro
    • Journal Title

      Journal of Physics: Conference Series

      Volume: 699 Pages: 012028-012028

    • DOI

      10.1088/1742-6596/699/1/012018

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] スパースモデリングと情報可視化2016

    • Author(s)
      藤代一成,高橋成雄,渡辺一帆,Hsiang-Yun Wu
    • Journal Title

      電子情報通信学会誌

      Volume: 99 Pages: 466-470

    • Related Report
      2015 Research-status Report
    • Peer Reviewed
  • [Journal Article] Achievability of asymptotic minimax regret by horizon-dependent and horizon-independent strategies2015

    • Author(s)
      Kazuho Watanabe, Teemu Roos
    • Journal Title

      Journal of Machine Learning Research (JMLR)

      Volume: 16 Pages: 2357-2375

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] グラフスペクトル解析を用いた平行座標系の軸縮約2015

    • Author(s)
      能野琴,Hsiang-Yun Wu,渡辺一帆,高橋成雄,藤代一成
    • Journal Title

      画像電子学会誌

      Volume: 44 Pages: 447-456

    • NAID

      130005171479

    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] レート歪み関数と最適再構成分布2019

    • Author(s)
      渡辺一帆
    • Organizer
      電子情報通信学会総合大会
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] 混合分布に基づく正則化による DNN 音響モデルのサイズ削減2018

    • Author(s)
      森谷崇史,吉田司,渡辺一帆,篠原雄介,山口義和,青野裕司
    • Organizer
      日本音響学会2018年秋季研究発表会
    • Related Report
      2018 Annual Research Report
  • [Presentation] f平均によるディリクレ過程平均法の一般化と影響関数の解析2018

    • Author(s)
      小林真佐大,渡辺一帆
    • Organizer
      第21回情報論的学習理論ワークショップ
    • Related Report
      2018 Annual Research Report
  • [Presentation] ミニマックス戦略による変動ベルヌーイ過程のオンライン予測2018

    • Author(s)
      小永吉健太,渡辺一帆
    • Organizer
      第21回情報論的学習理論ワークショップ
    • Related Report
      2018 Annual Research Report
  • [Presentation] 3パラメータGroup Lassoモデルにおける経験ベイズ解の解析2018

    • Author(s)
      吉田司,渡辺一帆
    • Organizer
      第21回情報論的学習理論ワークショップ
    • Related Report
      2018 Annual Research Report
  • [Presentation] ディリクレ過程平均法のf分離可能ひずみ尺度への拡張とロバスト性の解析2018

    • Author(s)
      小林真佐大,渡辺一帆
    • Organizer
      第41回情報理論とその応用シンポジウム
    • Related Report
      2018 Annual Research Report
  • [Presentation] Sparse regression code with sparse dictionary for absolute error criterion2018

    • Author(s)
      Ryota Konabe, Kazuho Watanabe
    • Organizer
      IEEE International Symposium on Information Theory
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Rate-distortion tradeoffs under kernel-based distortion measures2017

    • Author(s)
      Kazuho Watanabe
    • Organizer
      2017 IEEE International Symposium on Information Theory (ISIT2017)
    • Place of Presentation
      Aachen, Germany
    • Year and Date
      2017-06-25
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Making many-to-many parallel coordinate plots scalable by asymmetric biclustering2017

    • Author(s)
      Hsiang-Yun Wu, Yusuke Niibe, Kazuho Watanabe, Shigeo Takahashi, Makoto Uemura, and Issei Fujishiro
    • Organizer
      10th IEEE Pacific Visualization Symposium (PacificVis 2017)
    • Place of Presentation
      Seoul, Korea
    • Year and Date
      2017-04-18
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 角転送行列を用いた格子状マルコフ確率場の厳密計算2017

    • Author(s)
      吉田智晴, 渡辺一帆, 梅村恭司
    • Organizer
      電子情報通信学会情報論的学習理論と機械学習研究会
    • Place of Presentation
      東京都目黒区
    • Year and Date
      2017-03-06
    • Related Report
      2016 Research-status Report
  • [Presentation] レート歪み理論と一般化事後分布2017

    • Author(s)
      渡辺一帆
    • Organizer
      統計的モデリングと計算アルゴリズムの数理と展開
    • Place of Presentation
      愛知県名古屋市
    • Year and Date
      2017-02-18
    • Related Report
      2016 Research-status Report
  • [Presentation] Making Many-to-Many Parallel Coordinate Plots Scalable by Asymmetric Biclustering2017

    • Author(s)
      Hsiang-Yun Wu, Yusuke Niibe, Kazuho Watanabe, Shigeo Takahashi, Makoto Uemura, Issei Fujishiro
    • Organizer
      10th IEEE Pacific Visualization Symposium
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Rate-distortion tradeoffs under kernel-based distortion measures2017

    • Author(s)
      Kazuho Watanabe
    • Organizer
      IEEE International Symposium on Information Theory
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Rate-distortion dimension and Bayesian learning coefficient2017

    • Author(s)
      Kazuho Watanabe
    • Organizer
      Workshop on Information Theoretic Methods in Science and Engineering
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] 角転送行列繰り込み群法を用いた格子状マルコフ確率場の計算手法の提案2017

    • Author(s)
      吉田智晴, 渡辺一帆, 梅村恭司
    • Organizer
      電子情報通信学会情報論的学習理論と機械学習研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] オンライン型t-SNEによる分布構造変化の抽出2017

    • Author(s)
      梶大介,小林真佐大,渡辺一帆
    • Organizer
      電子情報通信学会情報論的学習理論と機械学習研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] レート歪み理論に基づいた絶対誤差基準のためのスパース回帰符号2017

    • Author(s)
      小鍋涼太,渡辺一帆
    • Organizer
      第40回情報理論とその応用シンポジウム
    • Related Report
      2017 Research-status Report
  • [Presentation] ディリクレ過程平均法の最大歪みを含む一般化尺度への拡張2017

    • Author(s)
      小林真佐大,渡辺一帆
    • Organizer
      第40回情報理論とその応用シンポジウム
    • Related Report
      2017 Research-status Report
  • [Presentation] L1正則化における経験ベイズ推定解の解析2017

    • Author(s)
      吉田司,渡辺一帆
    • Organizer
      第40回情報理論とその応用シンポジウム
    • Related Report
      2017 Research-status Report
  • [Presentation] スパースな辞書を用いたL1誤差基準のための有歪圧縮2016

    • Author(s)
      小鍋涼太,渡辺一帆
    • Organizer
      第39回情報理論とその応用シンポジウム
    • Place of Presentation
      岐阜県高山市
    • Year and Date
      2016-12-13
    • Related Report
      2016 Research-status Report
  • [Presentation] ディリクレ過程平均法における歪み尺度の一般化2016

    • Author(s)
      小林真佐大,渡辺一帆
    • Organizer
      第39回情報理論とその応用シンポジウム
    • Place of Presentation
      岐阜県高山市
    • Year and Date
      2016-12-13
    • Related Report
      2016 Research-status Report
  • [Presentation] 変分ベイズ法を用いたクラスタ構造変化の抽出2016

    • Author(s)
      梶大介,渡辺一帆
    • Organizer
      情報論的学習理論ワークショップ
    • Place of Presentation
      京都府京都市
    • Year and Date
      2016-11-16
    • Related Report
      2016 Research-status Report
  • [Presentation] 角転送行列繰り込み群法の格子状マルコフ確率場への適用2016

    • Author(s)
      吉田智晴, 渡辺一帆, 梅村恭司
    • Organizer
      情報論的学習理論ワークショップ
    • Place of Presentation
      京都府京都市
    • Year and Date
      2016-11-16
    • Related Report
      2016 Research-status Report
  • [Presentation] Rate-distortion theoretic views of learning problems2016

    • Author(s)
      Kazuho Watanabe
    • Organizer
      2016 Workshop on Information Theoretic Methods in Science and Engineering
    • Place of Presentation
      Helsinki, Finland
    • Year and Date
      2016-09-19
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Constant-width rate-distortion bounds for power distortion measures2016

    • Author(s)
      Kazuho Watanabe
    • Organizer
      IEEE Information Theory Workshop (ITW2016)
    • Place of Presentation
      Cambridge, U.K.
    • Year and Date
      2016-09-11
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] レート歪み理論によるディリクレ過程平均法の閾値パラメータ解釈2016

    • Author(s)
      小林真佐大,渡辺一帆
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      九州大学
    • Year and Date
      2016-03-15
    • Related Report
      2015 Research-status Report
  • [Presentation] MDLの効率的計算のための事前分布設定2016

    • Author(s)
      渡辺一帆
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      九州大学
    • Year and Date
      2016-03-15
    • Related Report
      2015 Research-status Report
  • [Presentation] Rate-distortion bounds for distortion measures with kernel feature mapping2015

    • Author(s)
      渡辺一帆
    • Organizer
      第38回情報理論とその応用シンポジウム
    • Place of Presentation
      岡山県倉敷市
    • Year and Date
      2015-11-24
    • Related Report
      2015 Research-status Report
  • [Presentation] Rate-distortion analysis for kernel-based distortion measures2015

    • Author(s)
      Kazuho Watanabe
    • Organizer
      Workshop on Information Theoretic Methods in Science and Engineering
    • Place of Presentation
      Copenhagen, Denmark
    • Year and Date
      2015-06-24
    • Related Report
      2015 Research-status Report
    • Int'l Joint Research / Invited
  • [Book] Variational Bayesian Learning Theory2019

    • Author(s)
      Shinichi Nakajima, Kazuho Watanabe, Masashi Sugiyama
    • Total Pages
      560
    • Publisher
      Cambridge University Press
    • ISBN
      1107076153
    • Related Report
      2018 Annual Research Report
  • [Remarks] 豊橋技術科学大学情報・知能工学系学習推論システム研究室

    • URL

      http://www.lisl.cs.tut.ac.jp/

    • Related Report
      2018 Annual Research Report 2017 Research-status Report
  • [Remarks] 学習推論システム研究室ホームページ

    • URL

      http://www.lisl.cs.tut.ac.jp/

    • Related Report
      2016 Research-status Report
  • [Remarks] 研究代表者ホームページ

    • URL

      http://www.lisl.cs.tut.ac.jp/wkazuho/index-j.html

    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi