The Minimum Description Length Principle and Learning Theory
| Project/Area Number |
24500018
|
|---|
| Research Category |
Grant-in-Aid for Scientific Research (C)
|
| Allocation Type | Multi-year Fund |
|---|
| Section | 一般 |
|---|
| Research Field |
Fundamental theory of informatics
|
|---|
| Research Institution | Kyushu University |
|---|
Principal Investigator |
TAKEUCHI Junichi 九州大学, システム情報科学研究科(研究院, 教授 (80432871)
|
|---|
| Co-Investigator(Renkei-kenkyūsha) |
ONO Hirotaka 九州大学, 経済学研究院, 准教授 (00346826)
|
|---|
| Research Collaborator |
BARRON Andrew R. Yale University, Dept. of Statistics, 教授
|
|---|
| Project Period (FY) |
2012-04-01 – 2015-03-31
|
| Project Status |
Completed (Fiscal Year 2014)
|
| Budget Amount *help |
¥5,330,000 (Direct Cost: ¥4,100,000、Indirect Cost: ¥1,230,000)
Fiscal Year 2014: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2013: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2012: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
|
|---|
| Keywords | 記述長最小原理 / MDL / 確率的コンプレキシティ / 指数型分布族 / 木情報源モデル / 局所指数族バンドル / Jeffreys事前分布 / 木情報源 / Markovモデル / スパース重ね合わせ符号 / MDL原理 / Bayes符号 / ガウス通信路 / 混合型分布族 / ポートフォリオ |
|---|
| Outline of Final Research Achievements |
Concerning the minimum description length (MDL) principle, we performed the studies on evaluation of the stochastic complexity (SC) and the data compression and sequential prediction strategies which achieves the SC for various target models. Those algorithms performs as the minimax strategies with respect to logarithmic or coding regret. We obtained the minimax strategies when the target model is the i.i.d. general smooth families of probability distributions. Our strategy is a combination of the mixture of the target class with Jeffreys prior and a mixture of the local exponential family bundle of the target class. In particular, we succeeded to remove the restriction on the set of data sequences for the mixture family case and tree model case. We also studied sparse superposition code (Barron et al. 2011-), which is one of capacity achieving codes.
|
Report
(4 results)
Research Products
(28 results)
-
-
-
-
-
-
-
-
[Presentation] MDL原理入門2014
Author(s)
竹内純一
Organizer
第37回情報理論とその応用シンポジウム
Place of Presentation
富山県黒部市
Year and Date
2014-12-10 – 2014-12-12
Related Report
Invited
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
