• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2013 Fiscal Year Annual Research Report

時間依存型密度比推定による高次元変化検知

Research Project

Project/Area Number 13J03189
Research InstitutionTokyo Institute of Technology

Principal Investigator

柳 松  東京工業大学, 大学院情報理工学研究科, 特別研究員(DC2)

KeywordsChange Detection / Markov Network / Density Ratio Estimation / Machine Learning
Research Abstract

The main target of this research is to effectively detect changes in high-dimensional data under model free settings. We anticipated two major challenges in our original research scheme : a) The curse of dimensionality, b) the time-dependent data samples. During the first year, we have developed a novel method that tackles issue a) using the structure of variables and such method is also applicable in solving b) at the same time. Both conference and journal paper describing this methodology has been published in this year.
Although in the research plan, we have argued that the dimensionality reduction provides a shortcut in handling high-dimensional data. However, instead of searching for a subspace that "compresses" data, exploiting the internal structure of variables may also offer us a solution. The interaction between the random variables constructs a Markov Network, which can be regarded as a structure of interactions. When such additional information available (it is available in many applications), we are able to perform high-dimensional change detection more efficiently.
During this year, we have developed efficient algorithms that detect changes in high-dimensional Markov Networks. It has been a major leap toward developing an algorithm that solves challenge a) and b) directly at the same time, since the time-dependency can be regarded as a chain-shaped Markov Network. Without introducing any additional steps (such as dimensionality reduction), we are able to detect changes in high-dimensional time-series in just one shot.

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

We anticipated two challenges in our plan. However, the study in the last year demonstrated an elegant solution to both of the challenges, which is out of our expectation. We have started to investigate some applications of our methodology, which is the 2^<nd> year task in our original report. In general, the progress is nearly 65% finished.

Strategy for Future Research Activity

As it has been reported in the original plan, after developing the methodology, we are going to investigate several applications in the 2^<nd> year, so the performance of our method can be evaluated. Since we have already started doing experiments on gene expression and twitter datasets, we will continue to look into some more datasets in bioinformatics and social media.
On the other hand, we are also going to scale up our method on big data, with much larger dimensions (e. g. >500), and develop an efficient algorithm that solves such problem set within a reasonable amount of time.

  • Research Products

    (6 results)

All 2014 2013 Other

All Journal Article (2 results) (of which Peer Reviewed: 2 results) Presentation (3 results) Remarks (1 results)

  • [Journal Article] Direct Learning of Sparse Changes in Markov Networks by Density Ratio Estimation2014

    • Author(s)
      Liu, S., Quinn, J. A., Gutmann, M. U., Sugiyama, M.
    • Journal Title

      Journal Neural Computation

      Volume: (印刷中)

    • Peer Reviewed
  • [Journal Article] Direct Divergence Approximation between Probability Distributions and its Applications in Machine Learning.2013

    • Author(s)
      Sugiyama, M., Liu, S., du Plessis, M. C., Yamanaka, M., Yamad a, M., Suzuki, T., & Kanamori, T.
    • Journal Title

      Journal of Computing Science and Engineering

      Volume: Vol.7no.2 Pages: 99-111

    • DOI

      10.5626/JCSE.2013.7.2.99

    • Peer Reviewed
  • [Presentation] Bias Reduction and Metric Learng for Nearest-neighbor Estimation of Kullback-Leibler Divergence.2014

    • Author(s)
      Yung-Kyun Noh
    • Organizer
      Seventeenth International Conference on Artificial Intelligence and Statistics (AISTATS2014)
    • Place of Presentation
      Grand Hotel Reykjavik(発表確定)
    • Year and Date
      2014-04-24
  • [Presentation] Direct Learning of Sparse Changes in Markov Networks by Density Ratio Estimation2013

    • Author(s)
      Song Liu
    • Organizer
      European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases
    • Place of Presentation
      Congress Centre U HájkÜ, Prague, Czech.
    • Year and Date
      2013-09-27
  • [Presentation] Direct Learning of Sparse Changes in Markov Networks by Density Ratio Estimation2013

    • Author(s)
      Song Liu
    • Organizer
      情報論的学習理論と機械学習研究会(IBISML)
    • Place of Presentation
      早稲田大学 西早稲田キャンパス
    • Year and Date
      2013-07-18
  • [Remarks]

    • URL

      http://sugiyama-www.cs.titech.ac.jp/~song/

URL: 

Published: 2015-07-15  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi