• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Deep Learning for Imbalanced Data Stream

Research Project

Project/Area Number 17K00310
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionFuture University-Hakodate

Principal Investigator

Niimi Ayahiko  公立はこだて未来大学, システム情報科学部, 准教授 (80347179)

Project Period (FY) 2017-04-01 – 2020-03-31
Project Status Completed (Fiscal Year 2019)
Budget Amount *help
¥3,770,000 (Direct Cost: ¥2,900,000、Indirect Cost: ¥870,000)
Fiscal Year 2019: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2018: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2017: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Keywordsデータマイニング / 深層学習 / 不均一データ / 機械学習 / 不均一分布データ
Outline of Final Research Achievements

Due to the development of deep learning and IoT, there is an increasing need to build a knowledge discovery system by data mining of large-scale data with a time axis (stream data) in a short period of time. However, depending on the data to be handled, it is necessary to tune the parameters and to consider imbalanced dataset. The purpose of this research is to construct a data mining framework that considers imbalanced data when performing stream data mining by deep learning in a parallel and distributed environment. In this research, we examined the effect of imbalanced data in deep learning and proposed deep learning for imbalanced data.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的意義は、大規模並列分散環境での超巨大データ分析システムの開発の効率化につながるものとなる。現在、並列分散環境としてグリッド・コンピューティングが一般化してきた。また、動的に変化するストリームデータに対する分析要求も上がってきている。本研究の結果はこの動きを加速させ、分散マイニングシステムの扱いに関して実社会に還元できる可能性がある。特に、Twitter やセンサデータのリアルタイムデータ分析などに有用である。

Report

(4 results)
  • 2019 Annual Research Report   Final Research Report ( PDF )
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (25 results)

All 2020 2019 2018 2017

All Journal Article (5 results) (of which Peer Reviewed: 4 results,  Open Access: 1 results) Presentation (20 results) (of which Int'l Joint Research: 12 results)

  • [Journal Article] Attack Detection Approach by Packet Analysis Using Online Learning with Kernel Method and Correlation Change Method2020

    • Author(s)
      Niimi Ayahiko、Takahata Koki
    • Journal Title

      International Journal of Intelligent Computing Research

      Volume: 11 Issue: 1 Pages: 1033-1040

    • DOI

      10.20533/ijicr.2042.4655.2020.0125

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] 古くて新しいデータマイニング --- 不均衡データ問題とプライバシー保護データマイニングと画像処理によるデータ処理2020

    • Author(s)
      新美礼彦
    • Journal Title

      知能と情報

      Volume: 32 Pages: 9-12

    • NAID

      130008074611

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Data Anonymization Using Imbalanced Data for Deep Learning with Uppersampling and Undersampling2019

    • Author(s)
      Niimi Ayahiko
    • Journal Title

      International Journal of Intelligent Computing Research

      Volume: 10 Issue: 1 Pages: 971-976

    • DOI

      10.20533/ijicr.2042.4655.2019.0118

    • Related Report
      2019 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Majority Rule Approach to Deep Learning for Large Benchmark Data and Real Credit Card Transaction Data2018

    • Author(s)
      Ayahiko Niimi
    • Journal Title

      Journal of Internet Technology and Secured Transaction (JITST)

      Volume: 6 Issue: 1 Pages: 541-547

    • DOI

      10.20533/jitst.2046.3723.2018.0067

    • Related Report
      2018 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Proposal of a Man-hour Estimation Method Using the Past PBL Data2018

    • Author(s)
      齋藤 尊、新美 礼彦、伊藤 恵
    • Journal Title

      Computer Software

      Volume: 35 Issue: 1 Pages: 1_117-1_123

    • DOI

      10.11309/jssst.35.1_117

    • NAID

      130006356075

    • ISSN
      0289-6540
    • Related Report
      2017 Research-status Report
    • Peer Reviewed
  • [Presentation] 時系列データを用いたデータストリームマイニングアルゴリズムの性能評価手法の検討2020

    • Author(s)
      丸尾海月, 新美礼彦
    • Organizer
      第12回データ工学と情報マネジメントに関するフォーラム(第18回日本データベース学会年次大会),DEIM Forum 2020
    • Related Report
      2019 Annual Research Report
  • [Presentation] カテゴリカル属性の自動判別方法の提案2020

    • Author(s)
      鳴海雄登, 新美礼彦
    • Organizer
      第12回データ工学と情報マネジメントに関するフォーラム(第18回日本データベース学会年次大会),DEIM Forum 2020
    • Related Report
      2019 Annual Research Report
  • [Presentation] Generating Data to Alleviate Data Imbalance Problems in Machine Learning2019

    • Author(s)
      Ayahiko Niimi, Kosuke Sakamoto
    • Organizer
      The 5th International Conference on Fuzzy Systems and Data Mining (FSDM2019), Kitakyushu City, Japan,
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 画像分割と深層学習を用いた不動産外観画像からの築年数推定2019

    • Author(s)
      新美礼彦, 兼目 真生
    • Organizer
      第35回 ファジィ システム シンポジウム
    • Related Report
      2019 Annual Research Report
  • [Presentation] Attack Detection Method by Packet Analysis Using Online Learning Method and Correlation Change Method2019

    • Author(s)
      Ayahiko Niimi, Koki Takahata
    • Organizer
      World Congress on Internet Security (WorldCIS-2019), London, UK
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Data mining with generating data to improve data imbalance problem2019

    • Author(s)
      Ayahiko Niimi
    • Organizer
      International Conference on Big Data Analytics and Data Science, Las Vegas, USA
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Word Topic Prediction Model for Polysemous Words and Unknown Words Using a Topic Model2019

    • Author(s)
      Keisuke Tanaka, Ayahiko Niimi
    • Organizer
      Computing Conference 2019, London, UK
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Data Anonymization and Sampling Algorithms Using Imbalanced Datasets for Deep Learning2019

    • Author(s)
      Ayahiko Niimi
    • Organizer
      Proceedings of the 10th International Multi-Conference on Complexity, Informatics and Cybernetics: IMCIC 2019
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Study on Data Anonymization for Deep Learning2018

    • Author(s)
      Ayahiko Niimi
    • Organizer
      The 31st International Conference on Industrial, Engineering & Other Applications of Applied Intelligent Systems (IEA-AIE 2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Word Topic Prediction Model Using a Topic Model2018

    • Author(s)
      Ayahiko Niimi
    • Organizer
      The 4th International Conference on Fuzzy Systems and Data Mining (FSDM2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Similar Code Fragment Recommendation Using Word2Vec2018

    • Author(s)
      Takeru Uchiyama and Ayahiko Niimi
    • Organizer
      SCIS&ISIS with ISWS2018
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Data Anonymization Using Imbalanced Data for Deep Learning2018

    • Author(s)
      Ayahiko Niimi
    • Organizer
      World Congress on Internet Security (WorldCIS-2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] オートエンコーダを使用したサンプリング手法による不均衡データの再現度向上2018

    • Author(s)
      阪本 宏輔, 新美 礼彦
    • Organizer
      研究報告情報基礎とアクセス技術(IFAT)
    • Related Report
      2018 Research-status Report
  • [Presentation] 相関関係の変化を利用した内部ネットワークの異常検知手法2018

    • Author(s)
      高畑 孝輝 , 新美 礼彦
    • Organizer
      研究報告情報基礎とアクセス技術(IFAT)
    • Related Report
      2018 Research-status Report
  • [Presentation] Accelerated Bayesian Optimization For Deep Learning2017

    • Author(s)
      Ayahiko Niimi, Kousuke Sakamoto
    • Organizer
      6th International Conference on Advanced Information Technologies and Applications (ICAITA 2017), Sydney, Australia
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Deep Learning for Real Credit Card Data2017

    • Author(s)
      Ayahiko Niimi
    • Organizer
      Fuzzy Systems and Data Mining III, Proceedings of FSDM 2017, Hualien, Taiwan
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Majority Rule Approach of Deep Learning for Real Credit Card Transaction Data2017

    • Author(s)
      Ayahiko Niimi
    • Organizer
      World Congress on Internet Security (WorldCIS-2017), Church College, University of Cambridge, Cambridge, UK
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] トピックモデルによる話題推定手法に応じた多義語の意味切り分け2017

    • Author(s)
      田中 桂介, 新美 礼彦
    • Organizer
      第9回データ工学と情報マネジメントに関するフォーラム(第15回日本データベース学会年次大会)DEIM2017
    • Related Report
      2017 Research-status Report
  • [Presentation] ソースコード特有の近傍単語の影響を考慮したWord2Vecを用いた類似コード片推薦手法2017

    • Author(s)
      内山 武尊, 新美 礼彦
    • Organizer
      ソフトウェアエンジニアリングシンポジウム2017論文集, Vol.2017
    • Related Report
      2017 Research-status Report
  • [Presentation] 侵入検知システムへのカーネル法を用いたオンライン学習手法の適用2017

    • Author(s)
      高畑 孝輝, 新美 礼彦
    • Organizer
      Computer Security Symposium 2017 (CSS2017)
    • Related Report
      2017 Research-status Report

URL: 

Published: 2017-04-28   Modified: 2021-02-19  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi