• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development and Application of Statistical Estimation and Simulation for Super High Dimensional Data Space

Research Project

Project/Area Number 25240036
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Research Field Intelligent informatics
Research InstitutionOsaka University

Principal Investigator

Washio Takashi  大阪大学, 産業科学研究所, 教授 (00192815)

Co-Investigator(Kenkyū-buntansha) 伊庭 幸人  統計数理研究所, 大学共同利用機関等の部局等, 教授 (30213200)
Michael E.Houle (MICHAEL E.Houle)  国立情報学研究所, 大学共同利用機関等の部局等, 教授 (90399270)
Co-Investigator(Renkei-kenkyūsha) SHIMIZU Shohei  滋賀大学, データサイエンス学部, 准教授 (10509871)
KAWAHARA Yoshinobu  大阪大学, 産業科学研究所, 准教授 (00514796)
INOGUCHI Akihiro  関西学院大学, 理工学部, 准教授 (70452456)
Research Collaborator Ting Kai Ming  Federation University Australia, Faculty of Science and Technology, Professor
Project Period (FY) 2013-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥45,760,000 (Direct Cost: ¥35,200,000、Indirect Cost: ¥10,560,000)
Fiscal Year 2016: ¥8,710,000 (Direct Cost: ¥6,700,000、Indirect Cost: ¥2,010,000)
Fiscal Year 2015: ¥13,390,000 (Direct Cost: ¥10,300,000、Indirect Cost: ¥3,090,000)
Fiscal Year 2014: ¥13,520,000 (Direct Cost: ¥10,400,000、Indirect Cost: ¥3,120,000)
Fiscal Year 2013: ¥10,140,000 (Direct Cost: ¥7,800,000、Indirect Cost: ¥2,340,000)
Keywords超高次元データ / 機械学習 / データマイニング / 人工知能 / 次元の呪い / シミュレーション / 希少事象 / 統計的推定 / 粒子フィルタ / 知識発見
Outline of Final Research Achievements

In this study, we aimed to develop (1) generic and robust principles of statistical estimation and scenario generation against super high dimensionality, (2) statistical estimation methods using super high dimensional data, (3) probabilistic scenario generation methods for super high dimensional space, (4) an application of these developed methods and simulation techniques, and (5) an international research community.
Throughout this project, we developed techniques of similarity measure, density evaluation, robust estimation, scenario search, retrieval and clustering, classification, anomaly detection, rare scenario generation, and frequent pattern derivation. We also organized two international conferences and seven international workshops/seminars.

Report

(5 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • 2013 Annual Research Report
  • Research Products

    (43 results)

All 2017 2016 2015 2014 2013 Other

All Int'l Joint Research (9 results) Journal Article (13 results) (of which Int'l Joint Research: 6 results,  Peer Reviewed: 12 results,  Acknowledgement Compliant: 6 results,  Open Access: 5 results) Presentation (20 results) (of which Int'l Joint Research: 7 results,  Invited: 4 results) Book (1 results)

  • [Int'l Joint Research] オーストラリア連邦大学(オーストラリア)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] 航空研究所ONERA-DCSD(フランス)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] ルドルフマクシミリアン大学ミュンヘン校/ハイデルベルク大学(ドイツ)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] シダンスク大学/アーハス大学(デンマーク)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] グーグルマウンテンビュー研究所/ニュージャージー工科大学(米国)

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research]

    • Related Report
      2016 Annual Research Report
  • [Int'l Joint Research] オーストラリア連邦大学/メルボルン大学(オーストラリア)

    • Related Report
      2015 Annual Research Report
  • [Int'l Joint Research] グーグルマウンテンビュー研究所/ニュージャージー工科大学(米国)

    • Related Report
      2015 Annual Research Report
  • [Int'l Joint Research] CNRS/IRISA レンヌ研究所/INRIA グルノーブル研究所(フランス)

    • Related Report
      2015 Annual Research Report
  • [Journal Article] Defying the gravity of learning curve: a characteristic of nearest neighbour anomaly detectors2017

    • Author(s)
      Kai Ming Ting, Takashi Washio, Jonathan R. Wells and Sunil Aryal
    • Journal Title

      Machine Learning

      Volume: 106 Issue: 1 Pages: 55-91

    • DOI

      10.1007/s10994-016-5586-4

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Dimensional Testing for Reverse k-Nearest Neighbor Search2017

    • Author(s)
      Guillaume Casanova, Elias Englmeier, Michael E. Houle, Peer Kroger, Michael Nett and Arthur Zimek
    • Journal Title

      The VLDB Endowment

      Volume: 10[7] Pages: 769-780

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Efficient Similarity Search within User-Specified Projective Subspaces2016

    • Author(s)
      Michael E. Houle, Xiguo Ma, Vincent Oria and Jichao Sun
    • Journal Title

      Information Systems

      Volume: 59 Pages: 2-14

    • DOI

      10.1016/j.is.2016.01.008

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] On the Evaluation of Unsupervised Outlier Detection: Measures, Datasets, and an Empirical Study2016

    • Author(s)
      Guilherme O. Campos, Arthur Zimek, Jorg Sander, Ricardo J. G. B. Campello, Barbora Micenkova, Erich Schubert, Ira Assent, Michael E. Houle
    • Journal Title

      Data Mining and Knowledge Discovery

      Volume: online Issue: 4 Pages: 1-37

    • DOI

      10.1007/s10618-015-0444-8

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Half-space mass: a maximally robust and efficient data depth method2015

    • Author(s)
      Bo Chen, Kai Ming Ting, Takashi Washio and Gholamreza Haffari
    • Journal Title

      Machine Learning

      Volume: 100(2) Issue: 2-3 Pages: 677-699

    • DOI

      10.1007/s10994-015-5524-x

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Michael E. Houle, Xiguo Ma, Vincent Oria2015

    • Author(s)
      Effective and Efficient Algorithms for Flexible Aggregate Similarity Search in High Dimensional Spaces
    • Journal Title

      IEEE Transactions on Knowledge and Data Engineering

      Volume: 27(12) Issue: 12 Pages: 3258-3273

    • DOI

      10.1109/tkde.2015.2475740

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Rank-based similarity search: Reducing the dimensional dependence2015

    • Author(s)
      Houle, M.E., and Nett, M.
    • Journal Title

      IEEE Trans. Pattern Analysis and Machine Intelligence

      Volume: 37(1) Issue: 1 Pages: 136-150

    • DOI

      10.1109/tpami.2014.2343223

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] Multicanonical MCMC for Sampling Rare Events: An Illustrative Review2014

    • Author(s)
      Iba Y., Saito N., and Akimasa K.
    • Journal Title

      Annals of the Institute of Statistical Mathematics

      Volume: 66(3) Issue: 3 Pages: 611-645

    • DOI

      10.1007/s10463-014-0460-2

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] 生体高分子の揺らぎとダイナミクス―シミュレーションと実験の統計解析2014

    • Author(s)
      伊庭幸人, 藤崎弘士, 松永康佑
    • Journal Title

      統計数理

      Volume: 62(2) Pages: 163-170

    • Related Report
      2014 Annual Research Report
    • Open Access
  • [Journal Article] ParceLiNGAM : A causal ordering method robust against latent confounders2014

    • Author(s)
      Tashiro, T., Shimizu, S., Hyvarinen, A. and Washio, T
    • Journal Title

      Neural Computation

      Volume: 26(1) Issue: 1 Pages: 57-83

    • DOI

      10.1162/neco_a_00533

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] LiNearN: A new approach to nearest neighbour density estimator2014

    • Author(s)
      Jonathan R. Wells, Kai Ming Ting and Takashi Washio
    • Journal Title

      Pattern Recognition

      Volume: Online Issue: 8 Pages: 1-1

    • DOI

      10.1016/j.patcog.2014.01.013

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Active learning for noisy oracle via density power divergence2013

    • Author(s)
      Sogawa, Y., Ueno, T., Kawahara, Y., and Washio, T.
    • Journal Title

      Neural Networks

      Volume: 46 Pages: 133-143

    • DOI

      10.1016/j.neunet.2013.05.007

    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Active Learning for Regression via Density Power Divergence2013

    • Author(s)
      十河泰弘, 植野剛, 河原吉伸, 鷲尾隆
    • Journal Title

      Transactions of the Japanese Society for Artificial Intelligence

      Volume: 28 Issue: 1 Pages: 13-21

    • DOI

      10.1527/tjsai.28.13

    • NAID

      130003362304

    • ISSN
      1346-0714, 1346-8030
    • Related Report
      2013 Annual Research Report
    • Peer Reviewed
  • [Presentation] Rare event sampling using multicanonical MCMC and time-reversed simulation2017

    • Author(s)
      Yukito Iba and Shinichi Takayanagi
    • Organizer
      Workshop on Simulations Encounter with Data Science - Data Assimilation, Emulators, Rare Events and Design
    • Place of Presentation
      統計数理研究所,東京都
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] NIPS 2016 Workshop on Adaptive and Scalable Nonparametric Methods in Machine Learning2016

    • Author(s)
      Yoshito Baba, Mahito Sugiyama and Takashi Washio
    • Organizer
      Finding Combinations of Binary Variables with Guaranteed Accuracy
    • Place of Presentation
      Barcelona, Spain
    • Year and Date
      2016-12-08
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Defying the Gravity of Learning Curves: Are More Samples Better for Nearest Neighbor Anomaly Detectors?2016

    • Author(s)
      Takashi Washio
    • Organizer
      SISAP 2016: 9th International Conference on Similarity Search and Applications,
    • Place of Presentation
      National Institute of Informatics (NII), Tokyo
    • Year and Date
      2016-10-24
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] サンプリングを用いた精度保証つき頻出パターンマイニング2016

    • Author(s)
      馬場 祥人, 杉山 麿人, 鷲尾 隆
    • Organizer
      第30回人工知能学会全国大会
    • Place of Presentation
      北九州市国際会議場, 福岡県
    • Year and Date
      2016-06-06
    • Related Report
      2016 Annual Research Report
  • [Presentation] Beyond tf-idf and cosine distance in documents dissimilarity measure2015

    • Author(s)
      Sunil Aryal, Kai Ming Ting, Gholamreza Haffari and Takashi Washio
    • Organizer
      AIRS2015: the 11th Asia Information Retrieval Societies Conference
    • Place of Presentation
      Brisbane, Australia
    • Year and Date
      2015-12-02
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Flexible Aggregate Similarity Search in High-Dimensional Data Sets2015

    • Author(s)
      Michael E. Houle, Xiguo Ma and Vincent Oria
    • Organizer
      SISAP2015: the 8th International Conference on Similarity Search and Applications
    • Place of Presentation
      Glasgow, UK
    • Year and Date
      2015-10-12
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Half-space Mass: A maximally robust and efficient data depth method2015

    • Author(s)
      Bo Chen, Kai Ming Ting, Takashi Washio and Gholamreza Haffari
    • Organizer
      ECML PKDD2015:Machine Learning and Knowledge Discovery in Databases
    • Place of Presentation
      Porto, Portugal
    • Year and Date
      2015-09-07
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Estimating Local Intrinsic Dimensionality2015

    • Author(s)
      Laurent Amsaleg, Oussama Chelly, Teddy Furon, Stephane Girard, Michael E. Houle, Ken-ichi Kawarabayashi and Michael Nett
    • Organizer
      KDD2015: the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
    • Place of Presentation
      Sydney, Australia
    • Year and Date
      2015-08-10
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] サンプリングを用いた高速頻出パターンマイニング2015

    • Author(s)
      馬場 祥人, 杉山 麿人, 鷲尾 隆
    • Organizer
      第9回人工知能学会全国大会
    • Place of Presentation
      函館未来大学,北海道
    • Year and Date
      2015-05-30
    • Related Report
      2015 Annual Research Report
  • [Presentation] Sampling time-reversed path ensembles using sequential Monte Carlo2015

    • Author(s)
      Takayanagi S., and Iba Y.
    • Organizer
      Rare Event Sampling and Related Topics II
    • Place of Presentation
      統計数理研究所(東京都立川市)
    • Year and Date
      2015-03-27
    • Related Report
      2014 Annual Research Report
  • [Presentation] Rare event sampling using Markov chain Monte Carlo and sequential Monte Carlo2015

    • Author(s)
      Iba Y.
    • Organizer
      Rare Event Sampling and Related Topics II
    • Place of Presentation
      統計数理研究所(東京都立川市)
    • Year and Date
      2015-03-27
    • Related Report
      2014 Annual Research Report
  • [Presentation] ビッグデータに基づくモデリング ―生体・医療への適用を例として―2015

    • Author(s)
      鷲尾 隆
    • Organizer
      SASユーザー総会2015
    • Place of Presentation
      東京大学伊藤国際学術研究センター,東京都
    • Related Report
      2015 Annual Research Report
    • Invited
  • [Presentation] mp-dissimilarity: A data dependent dissimilarity measure2014

    • Author(s)
      Aryal S., Ting K.M., Haffari G., and Washio T.
    • Organizer
      ICDM2014:IEEE International Conference on Data Mining
    • Place of Presentation
      深せん(中国)
    • Year and Date
      2014-12-17
    • Related Report
      2014 Annual Research Report
  • [Presentation] 粒子モンテカルロ法による時間逆転シミュレーション2014

    • Author(s)
      伊庭幸人, 高柳慎一
    • Organizer
      IBIS2014
    • Place of Presentation
      名古屋工業大学(愛知県名古屋市)
    • Year and Date
      2014-11-18
    • Related Report
      2014 Annual Research Report
  • [Presentation] Ecient algorithms for similarity search in axisaligned subspaces.2014

    • Author(s)
      Houle, M.E., Ma, X., Oria, V., and Sun, J.
    • Organizer
      7th Int. Conf. on Similarity Search and Applications (SISAP)
    • Place of Presentation
      ロスカボス(メキシコ)
    • Year and Date
      2014-10-29 – 2014-10-31
    • Related Report
      2014 Annual Research Report
  • [Presentation] Improving iForest with relative mass2014

    • Author(s)
      Aryal S., Ting K.M., Wells J., and Washio T.
    • Organizer
      PAKDD2014: The 18th Pacific-Asia Conference on Knowledge Discovery and Data Mining
    • Place of Presentation
      台南市(台湾)
    • Year and Date
      2014-05-14
    • Related Report
      2014 Annual Research Report
  • [Presentation] A performance comparison of generative and discriminative models in causal and anticausal problems2014

    • Author(s)
      Blobaum P., Shimizu S., and Washio T.
    • Organizer
      Seventeenth International Conference on Artificial Intelligence and Statistics
    • Place of Presentation
      レイキャビック(アイスランド)
    • Year and Date
      2014-04-22
    • Related Report
      2014 Annual Research Report
  • [Presentation] Estimation of Causal Structures in Longtudinal Data Using Non-Gaussianity2013

    • Author(s)
      Kento Kadowaki, Shohei Shimizu and Takashi Washio
    • Organizer
      Proc. of 2013 IEEE International Workshop on Machine Learning for Signal Processing
    • Place of Presentation
      Southermpton, United Kingdom
    • Related Report
      2013 Annual Research Report
  • [Presentation] Estimation of causal direction in the presence of latent confounders using a Bayesian LiNGAM mixture model2013

    • Author(s)
      Naoki Tanaka, Shouhei Shimizu and Takashi Washio
    • Organizer
      Causality: Perspectives from different disciplines
    • Place of Presentation
      Vals, Switzerland
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Presentation] Issues for Modeling from Big Data2013

    • Author(s)
      Takashi Washio
    • Organizer
      Workshop on Computation: Theory and Practice
    • Place of Presentation
      Diliman, Philippines
    • Related Report
      2013 Annual Research Report
    • Invited
  • [Book] ビッグデータ・マネージメント データサイエンティストのためのデータ利活用技術と事例 第2章第4節ビッグデータからのモデリング手法2014

    • Author(s)
      鷲尾 隆
    • Total Pages
      11
    • Publisher
      エヌ・ティ・エス社
    • Related Report
      2013 Annual Research Report

URL: 

Published: 2013-05-15   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi