• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Establishment of Statistical Estimation Principle for Super HighDimensional Data and Its Application to Large Scale Data Mining

Research Project

Project/Area Number 22300054
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionOsaka University

Principal Investigator

WASHIO Takashi  大阪大学, 産業科学研究所, 教授 (00192815)

Co-Investigator(Renkei-kenkyūsha) HIGUCHI Tomoyuki  統計数理研究所, モデリング研究系, 教授 (70202273)
INOKUCHI Akihiro  大阪大学, 産業科学研究所, 助教 (70452456)
KAWAHARA Yoshinobu  大阪大学, 産業科学研究所, 助教 (00514796)
SHIMIZU Shohei  大阪大学, 産業科学研究所, 助教 (10509871)
NAKANO Shinya  統計数理研究所, モデリング研究系, 助教 (40378576)
Project Period (FY) 2010 – 2012
Project Status Completed (Fiscal Year 2012)
Budget Amount *help
¥17,290,000 (Direct Cost: ¥13,300,000、Indirect Cost: ¥3,990,000)
Fiscal Year 2012: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
Fiscal Year 2011: ¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Fiscal Year 2010: ¥5,850,000 (Direct Cost: ¥4,500,000、Indirect Cost: ¥1,350,000)
Keywords知能発見 / データマイニング / 統計的推定 / 超高次元データ / ビッグデータ / 高次元データ / 次元の呪い / 粒子フィルタ / 統計数理 / 確率密度関数 / データ分布
Research Abstract

Upon analysis of dimensionality curse, we characterized “hyper-sphere concentration effect”, “probability concentration effect” and “sparsity effect”of super high dimensional data, and proposed an accurate and robust estimation method against the former two effects.

Report

(4 results)
  • 2012 Annual Research Report   Final Research Report ( PDF )
  • 2011 Annual Research Report
  • 2010 Annual Research Report
  • Research Products

    (44 results)

All 2013 2012 2011 2010

All Journal Article (13 results) (of which Peer Reviewed: 13 results) Presentation (30 results) Book (1 results)

  • [Journal Article] DEMass: a new density estimator for big data2013

    • Author(s)
      Kai Ming Ting, Takashi Washio, Jonathan R. Wells, Fei Tony Liu and Sunil Aryal
    • Journal Title

      Knowledge and Information Systems: An International Journal

      Volume: Vol.34, No.2 Issue: 3 Pages: 1-32

    • DOI

      10.1007/s10115-013-0612-3

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Learning a Common Substructure of Multiple Graphical Gaussian Models2013

    • Author(s)
      Satoshi Hara, Takashi Washio
    • Journal Title

      Neural Networks

      Volume: 38 Pages: 23-38

    • DOI

      10.1016/j.neunet.2012.11.004

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Fast and accurate PSD matrix estimation by row reduction2012

    • Author(s)
      H.Kuwajima, T.Washio, L.Ee-Peng
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems

      Volume: E95-D (11)

    • NAID

      10031142886

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Separation of stationary and non-stationary sources with a generalized eigenvalue problem2012

    • Author(s)
      S.Hara, Y.Kawahara, T.Washio, P.von Bunau, T.Tokunaga and K.Yumoto
    • Journal Title

      Neural Networks

      Volume: 33 Pages: 7-20

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] Fast and accurate PSD matrix estimation by row reduction2012

    • Author(s)
      Hiroshi KUWAJIMA, Takashi WASHIO, Ee-Peng LIM
    • Journal Title

      IEICE TRANSACTIONS on Information and Systems

      Volume: Vol.E95-D, No.11 Pages: 2599-2612

    • NAID

      10031142886

    • Related Report
      2012 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Estimating exogenous variables in data with more variables than observations2011

    • Author(s)
      Y.Sogawa, S.Shimizu, T.Shimamura, A.Hyvarinen, T.Washio and S.Imoto
    • Journal Title

      Neural Networks

      Volume: 24(8) Pages: 875-880

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] DirectLiNGAM : A Direct Method for Learning a Linear Non-Gaussian Structural Equation Model2011

    • Author(s)
      Shohei Shimizu, Takanori Inazumi, Yasuhiro Sogawa, Aapo Hyvarinen, Yoshinobu Kawahara, Takashi Washio, Patrik O.Hoyer, Kenneth Bollen
    • Journal Title

      Journal of Machine Learning Research

      Volume: Vol.12 Pages: 1225-1248

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analyzing relationships among ARMA processes based on non-Gaussianity of external influences2011

    • Author(s)
      Yoshinobu Kawahara, Shohei Shimizu, Takashi Washio
    • Journal Title

      Neurocomputing

      Volume: Vol.74,No.12-13 Pages: 2212-2221

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Estimating exogenous variables in data with more variables than observations2011

    • Author(s)
      Y. Sogawa, S. Shimizu, T. Shimamura, A. Hyvarinen, T. Washio, and S. Imoto
    • Journal Title

      Neural Networks

      Volume: 24(8) Issue: 8 Pages: 875-880

    • DOI

      10.1016/j.neunet.2011.05.017

    • Related Report
      2011 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Analyzing Relationships among ARMA Processes Based on Non-Gaussianity of External Influences2011

    • Author(s)
      Yoshinobu Kawahara, Shohei Shimizu, Takashi Washio
    • Journal Title

      Neurocomputing

      Volume: (Accepted)

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A new particle filter for high-dimensional state-space models based on intensive and extensive proposal distribution2010

    • Author(s)
      V.P.Nguyen, T.Washi o and T.Hi guchi
    • Journal Title

      Int. J. Knowledge Eng. and Soft Data Paradigms

      Volume: 2(4) Pages: 284-311

    • Related Report
      2012 Final Research Report
    • Peer Reviewed
  • [Journal Article] ユークリッド距離の高速高精度推定と範囲問合せへの応用2010

    • Author(s)
      城戸健太郎, 桑島洋, 鷲尾隆
    • Journal Title

      情報処理学会論文誌

      Volume: Vol.50, No.5 Pages: 1493-1505

    • NAID

      40019551214

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A new particle filter for high-dimensional state- space models based on intensive and extensive proposal distribution2010

    • Author(s)
      Viet Phuong Nguyen, Takashi Washio, Tomoyuki Higuchi
    • Journal Title

      International Journal of Knowledge Engineering and Soft Data Paradigms

      Volume: Vol.2, No.4 Pages: 284-311

    • Related Report
      2010 Annual Research Report
    • Peer Reviewed
  • [Presentation] A new approach to bayesian estimation over the curse of dimensionality2012

    • Author(s)
      T.Washio
    • Organizer
      Thirty-first SGAI International Conference on Artificial Intelligence (AI2011), Workshop on Machine Learning and Intelligent Autonomous Systems
    • Year and Date
      2012-12-12
    • Related Report
      2012 Final Research Report
  • [Presentation] Weighted likelihood policy search with model selection; Advances in Neural Information, Processing Systems 252012

    • Author(s)
      T.Ueno, K.Hayashi, T.Washio andY.Kawahara
    • Organizer
      Processing Systems 25, Proc. Neural Information Processing Systems Conference 2012 (NIPS2012)
    • Place of Presentation
      Lake Tahoe, USA)
    • Year and Date
      2012-12-05
    • Related Report
      2012 Final Research Report
  • [Presentation] Enhancing the Analysis of Large Multimedia Applications Execution Traces with FrameMiner2012

    • Author(s)
      Christiane Kamdem Kengne, Leon Constantin Fopa, Noha Ibrahim, Alexandre Termier, Marie-Christine Rousset and Takashi Washio
    • Organizer
      Proc. of PTDM: Workshop on Practical Theories of Data Mining, ICDM 2012. The IEEE International Conference on Data Mining, pp.595-602
    • Place of Presentation
      Brussels, Belgium
    • Related Report
      2012 Annual Research Report
  • [Presentation] Weighted likelihood Policy search with model selection2012

    • Author(s)
      Tsuyoshi Ueno, Yoshinobu Kawahara, Takashi Washio, Kohei Hayashi
    • Organizer
      Conference Book of Neural Information Processing Systems 2012, W89
    • Place of Presentation
      Lake Tahoe, Nevada, USA
    • Related Report
      2012 Annual Research Report
  • [Presentation] Robust Active Learning for Linear Regression via Density Power Divergence2012

    • Author(s)
      Yasuhiro Sogawa, Tsuyoshi Ueno, Yoshinobu Kawahara and Takashi Washio
    • Organizer
      Proc. of the 19th International Conference on Neural Information Processing (ICONIP2012), Neural Information Processing, Lecture Notes in Computer Science, Vol.7665, 2012, pp.594-602
    • Place of Presentation
      Doha, Qatar
    • Related Report
      2012 Annual Research Report
  • [Presentation] Estimation of Causal Orders in a Linear Non-Gaussian Acyclic Model: A Method Robust against Latent Confounders2012

    • Author(s)
      Tatsuya Tashiro, Shohei Shimizu, Aapo Hyv¨arinen, Takashi Washio
    • Organizer
      Artificial Neural Networks and Machine Learning – ICANN 2012, Part I, pp. 491-498
    • Place of Presentation
      Lausanne, Switzerland
    • Related Report
      2012 Annual Research Report
  • [Presentation] Density power divergenceを用いたロバスト能動学習2012

    • Author(s)
      十河 泰弘, 植野 剛, 河原 吉伸, 鷲尾 隆
    • Organizer
      2012年人工知能学会全国大会,3B1-R-2-5
    • Place of Presentation
      山口県山口市
    • Related Report
      2012 Annual Research Report
  • [Presentation] 多様体上での経路積分型制御2012

    • Author(s)
      植野 剛, 河原 吉伸, 鷲尾 隆
    • Organizer
      2012年人工知能学会全国大会,3B2-R-2-4
    • Place of Presentation
      山口県山口市
    • Related Report
      2012 Annual Research Report
  • [Presentation] 非ガウス性を用いた線形非巡回なデータ生成過程部分の発見と同定2012

    • Author(s)
      田代 竜也, 清水 昌平, 鷲尾 隆
    • Organizer
      2012年人工知能学会全国大会,4B1-R-2-6
    • Place of Presentation
      山口県山口市
    • Related Report
      2012 Annual Research Report
  • [Presentation] DAL-ADMMアルゴリズムによるスパース共分散選択2012

    • Author(s)
      原 聡, 鷲尾 隆
    • Organizer
      2012年人工知能学会全国大会,4B1-R-2-1
    • Place of Presentation
      山口県山口市
    • Related Report
      2012 Annual Research Report
  • [Presentation] 重み付き最尤推定に基づく方策探索法2012

    • Author(s)
      植野 剛, 林 浩平, 鷲尾 隆, 河原吉伸
    • Organizer
      第15回情報論的学習理論ワークショップ(IBIS2012)予原稿集, 電子情報通信学会技術研究報告, Vol.112, No.279, pp.165-170
    • Place of Presentation
      東京都文京区
    • Related Report
      2012 Annual Research Report
  • [Presentation] Density Power Divergenceを用いたノイジーろらくる存在下における能動学習2012

    • Author(s)
      十河泰弘, 植野剛, 河原吉伸, 鷲尾 隆
    • Organizer
      第87回人工知能基本問題研究会,人工知能学会研究会資料SIG-FPAI-B202,pp.33-38
    • Place of Presentation
      神奈川県横浜市
    • Related Report
      2012 Annual Research Report
  • [Presentation] Prismatic Algorithm for Discrete D.C.Programming Problem2011

    • Author(s)
      Yoshinobu Kawahara, Takashi Washio
    • Organizer
      NIPS2011 : Twenty-Fifth Annual Conference on Neural Information Processing Systems
    • Place of Presentation
      Granada, Spain
    • Year and Date
      2011-12-13
    • Related Report
      2011 Annual Research Report
  • [Presentation] A New Approach to Bayesian Estimation over the Curse of Dimensionality2011

    • Author(s)
      Takashi Washio
    • Organizer
      AI-2011 Thirty-first SGAI International Conference on Artificial Intelligence, Workshop on Machine Learning and Intelligent Autonomous Systems
    • Place of Presentation
      Chambridge, UK(招待講演)
    • Year and Date
      2011-12-12
    • Related Report
      2011 Annual Research Report
  • [Presentation] Density Estimation based on Mass2011

    • Author(s)
      Kai Ming Ting, Takashi Washio, Jonathan Wells, Tony Liu
    • Organizer
      ICDM2011 : The IEEE International Conference on Data Mining 2011
    • Place of Presentation
      Vancouver, Canada
    • Year and Date
      2011-12-12
    • Related Report
      2011 Annual Research Report
  • [Presentation] Density estimation based on mass2011

    • Author(s)
      K.M.Ting, T.Washio, J.Wells and T.Liu
    • Organizer
      Proc. 11th IEEE Int. Conf. on Data Mining (ICDM2011)
    • Place of Presentation
      Vancuver, Canada
    • Year and Date
      2011-12-11
    • Related Report
      2012 Final Research Report
  • [Presentation] Analysis of Residence Time in Shopping using RFID Data-An Application of the Kernel density estimation to RFID-2011

    • Author(s)
      Shinya Miyazaki, Takashi Washio, Katsutoshi Yada
    • Organizer
      Working note of DMS2011 : Workshop on Data Minig For Service : The IEEE International Conference on Data Mining series (ICDM2011)
    • Place of Presentation
      Vancouver, Canada
    • Year and Date
      2011-12-11
    • Related Report
      2011 Annual Research Report
  • [Presentation] Common Substructure Learning of Multiple Graphical Gaussian Models2011

    • Author(s)
      S.Hara and T.Washio
    • Organizer
      Proc. European Conf. on Machine Learning and Principle and Practice of Knowledge Discovery in Databases 2011 (ECML/PKDD2011), Lecture Notes in Computer Science
    • Place of Presentation
      Athens, Greece
    • Year and Date
      2011-09-07
    • Related Report
      2012 Final Research Report
  • [Presentation] Common Substructure Learning of Multiple Graphical Gaussian Models2011

    • Author(s)
      Satoshi Hara, Takashi Washio
    • Organizer
      ECML-PKDD2011 : European Conference on Machine Learning and Principle and Practice of Knowledge Discovery in Databases 2011
    • Place of Presentation
      Athens, Greece
    • Year and Date
      2011-09-07
    • Related Report
      2011 Annual Research Report
  • [Presentation] Discovering causal structures in binary exclusive-or skew acyclic models2011

    • Author(s)
      T.Inazumi, T.Washio, S.Shimizu, J.Suzuki, A.Yamamoto and Y.Kawahara
    • Organizer
      Proc. 27th Conf. on Uncertainty in Artificial Intelligence (UAI2011)
    • Place of Presentation
      Barcelona, Spain
    • Year and Date
      2011-07-16
    • Related Report
      2012 Final Research Report
  • [Presentation] Discovering Causal Structures in Binary Exclusive-or Skew Acyclic Models2011

    • Author(s)
      Takanori Inazumi, Takashi Washio, Shohei Shimizu, Joe Suzuki, Akihiro Yamamoto, Yoshinobu Kawahara
    • Organizer
      UAI2011 : The 27th Conference on Uncertainty in Artificial Intelligence
    • Place of Presentation
      Barcelona, Spain
    • Year and Date
      2011-07-16
    • Related Report
      2011 Annual Research Report
  • [Presentation] A Framework for Shopping Path Research2011

    • Author(s)
      Katsuyoshi Yada, Takashi Washio, Hiroshi Koga
    • Organizer
      Workshop on Data Mining Marketing, SIAM : SIAM Conference on Data Mining (SDM11)
    • Place of Presentation
      Phoenix, USA
    • Year and Date
      2011-04-30
    • Related Report
      2011 Annual Research Report
  • [Presentation] Application of DNA Sequence Alignment Algorithm to Classification of Shopping Paths through a Supermarket2011

    • Author(s)
      Kohei Ichikawa, Edward Ip, Katsuyoshi Yada, Takashi Washi
    • Organizer
      Workshop on Data Mining Marketing, SIAM : SIAM Conference on Data Mining (SDM11)
    • Place of Presentation
      Phoenix, USA
    • Year and Date
      2011-04-30
    • Related Report
      2011 Annual Research Report
  • [Presentation] Stationary subspace analysis as a generalized eigenvalue problem2010

    • Author(s)
      S.Hara, Y.Kawahara, T.Washio and P.Bunau
    • Organizer
      Lecture Note in Computer Science, 6443, Proc. of 17th Int. Conf. on Neural Information Processing (ICONIP2010)
    • Place of Presentation
      Sydney, Australia
    • Year and Date
      2010-11-23
    • Related Report
      2012 Final Research Report
  • [Presentation] Stationary Subspace Analysis as a Generalized Eigenvalue Problem2010

    • Author(s)
      Satoshi Hara, Yoshinobu Kawahara, Takashi Washio, Paul von Bunau
    • Organizer
      Proc.of ICONIP2010 : Neural Information Processing, Theory and Algorithms
    • Place of Presentation
      Sydney(Australia)
    • Year and Date
      2010-11-23
    • Related Report
      2010 Annual Research Report
  • [Presentation] Use of Prior Knowledge in a Non-Gaussian Method for Learning Linear Structural Equation Models2010

    • Author(s)
      Takanori Inazumi, Shohei Shimizu, Takashi Washio
    • Organizer
      Proc.of LVA/ICA2010 : Ninth International Conference on Latent Variable Analysis and Signal Separation
    • Place of Presentation
      Malo(France)
    • Year and Date
      2010-09-28
    • Related Report
      2010 Annual Research Report
  • [Presentation] Discovery of Exogenous Variables in Data with More Variables than Observations2010

    • Author(s)
      Yasuhiro Sogawa, Shohei Shimizu, Aapo Hyvarinen, Takashi Washio, Teppei Shimamura, Seiya Imoto
    • Organizer
      Proc.of ICANN2010 : 20th International Conference on Artificial Neural Networks
    • Place of Presentation
      Thessaloniki(Greece)
    • Year and Date
      2010-09-17
    • Related Report
      2010 Annual Research Report
  • [Presentation] An experimental comparison of linear non-Gaussian causal discovery methods and their variants2010

    • Author(s)
      Yasuhiro Sogawa, Shohei Shimizu, Yoshinobu Kawahara, Takashi Washio
    • Organizer
      Proc.of IJCNN2010 : WCCI 2010 IEEE World Congress on Computational Intelligence, Joint Conference on Neural Networks
    • Place of Presentation
      Barcelona, Spain
    • Year and Date
      2010-07-23
    • Related Report
      2010 Annual Research Report
  • [Presentation] GTRACE2 : Improving Performance Using Labeled Union Graphs2010

    • Author(s)
      Akihiro Inokuchi, Takashi Washio
    • Organizer
      Proc.of PAKDD2010 : The 14th Pacific-Asia Conference on Knowledge Discovery and Data Mining
    • Place of Presentation
      Hyderabad(India)
    • Year and Date
      2010-06-23
    • Related Report
      2010 Annual Research Report
  • [Presentation] 変数間因果関係に関するリレーショナルデータマイニングへの取り組み2010

    • Author(s)
      鷲尾隆
    • Organizer
      第1回情報論的学習理論と機械学習(IBISML)研究会,(社)電子情報通信学会
    • Place of Presentation
      東京大学(日本)
    • Year and Date
      2010-06-14
    • Related Report
      2010 Annual Research Report
  • [Book] Best papers from the 12th Pacific-Asia conference on knowledge discovery and data mining(PAKDD2008)2010

    • Author(s)
      Takashi Washio, Einoshin Suzuki, Kai Ming Ting
    • Total Pages
      212
    • Publisher
      Knowledge and Infor- mation Systems ; An International Journal
    • Related Report
      2010 Annual Research Report

URL: 

Published: 2010-08-23   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi