• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of Malware Detection/Classification System Introducing Incremental Learning and Active Learning

Research Project

Project/Area Number 24500173
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionKobe University

Principal Investigator

OZAWA Seiichi  神戸大学, 工学(系)研究科(研究院), 教授 (70214129)

Co-Investigator(Kenkyū-buntansha) ANDO Ruo  情報通信研究機構, ネットワークセキュリティ研究所, 主任研究員 (30446596)
Co-Investigator(Renkei-kenkyūsha) KITAZONO Jun  神戸大学, 大学院工学研究科, 助教 (00733677)
BAN Tao  情報通信研究機構, ネットワークセキュリティ研究所, 主任研究員 (80462878)
NAKAZATO Junji  情報通信研究機構, ネットワークセキュリティ研究所, 研究員 (60435782)
Research Collaborator SHIMAMURA Jumpei  
Project Period (FY) 2012-04-01 – 2015-03-31
Project Status Completed (Fiscal Year 2014)
Budget Amount *help
¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2014: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2013: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2012: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000)
Keywordsサイバーセキュリティ / 機械学習 / オンライン学習 / 悪性スパムメール検知 / ダークネット解析 / DDoSバックスキャッタ判定 / マルウェア感染モニタリング / テキスト解析 / 悪性スパムメール攻撃 / ビッグデータ / 識別器 / マルウェア検知 / ダークネットトラフィック解析 / スパムメール悪性度判定 / インターネットセキュリティ / パターン認識 / 特徴選択 / パケット解析 / 行動推定
Outline of Final Research Achievements

In order to protect network uses from malicious spam mail attacks that can lead to malware infections and to conduct a large-scale monitoring of malicious activities by malwares, we developed three types of learning systems introducing machine learning techniques. First, we developed a malicious spam mail detection system with the following three sophisticated functions: an automatic mechanism to collect suspected malicious spam mails, an automatic labelling (malicious or benign) function for collected spam mails by a crawler-type of web security analyzer, and online learning function for automatically collected training data. Second, we developed a large-scale monitoring system which can observe transitions of subnet infection states by allocating the most similar typical patters obtained by performing the hierarchical clustering for darknet traffic features. Finally, we developed a large-scale monitoring system which can detect DDoS backscatter from observed darknet traffic features.

Report

(4 results)
  • 2014 Annual Research Report   Final Research Report ( PDF )
  • 2013 Research-status Report
  • 2012 Research-status Report
  • Research Products

    (33 results)

All 2015 2014 2013 2012

All Journal Article (17 results) (of which Peer Reviewed: 17 results,  Open Access: 1 results,  Acknowledgement Compliant: 4 results) Presentation (16 results)

  • [Journal Article] Online Feature Extraction based on Accelerated Kernel Principal Component Analysis for Data Stream2015

    • Author(s)
      Annie Anak Joseph, Takaomi Tokumoto, and Seiichi Ozawa
    • Journal Title

      Evolving Systems

      Volume: 6 Issue: 1 Pages: 15-27

    • DOI

      10.1007/s12530-015-9131-7

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] An Online Malicious Spam Email Detection System Using Resource Allocating Network with Locality Sensitive Hashing2015

    • Author(s)
      Ali Siti Hajar Aminah, Seiichi Ozawa, Tao Ban, Junji Nakazato, and Jumpei Shimamura
    • Journal Title

      Journal of Intelligent Learning Systems and Application

      Volume: 7 (2) Issue: 02 Pages: 42-57

    • DOI

      10.4236/jilsa.2015.72005

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Open Access / Acknowledgement Compliant
  • [Journal Article] An Autonomous Online Malicious Spam Mail Detection System Using Extended RBF Network2015

    • Author(s)
      Ali Siti Hajar Aminah, Seiichi Ozawa, Tao Ban, Junji Nakazato, and Jumpei Shimamura
    • Journal Title

      Proc.of Int. Joint Conf. on Neural Networks 2015

      Volume: 1

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] <b>An Incremental Linear Discriminant Analysis for Data Streams Under Non-stationary Environments</b>2014

    • Author(s)
      Annie Anak Joseph, Young-Min Jang, Seiichi Ozawa, and Minho Lee
    • Journal Title

      Transactions of the Institute of Systems, Control and Information Engineers

      Volume: 27 Issue: 4 Pages: 133-140

    • DOI

      10.5687/iscie.27.133

    • NAID

      130004565051

    • ISSN
      1342-5668, 2185-811X
    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Incremental Two-dimensional Kernel Principal Component Analysis2014

    • Author(s)
      Yonghwa Choi, Seiichi Ozawa, and Minho Lee
    • Journal Title

      Neurocomputing

      Volume: 134 Pages: 280-288

    • DOI

      10.1016/j.neucom.2013.08.045

    • Related Report
      2014 Annual Research Report 2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Neural Network Model for Semi-supervised Sequential Multi-task Learning in Multi-label Pattern Recognition Problems2014

    • Author(s)
      Daisuke Higuchi and Seiichi Ozawa
    • Journal Title

      Smart Digital Futures

      Volume: 262 Pages: 402-411

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] A Fast Incremental Kernel Principal Component Analysis for Data Streams2014

    • Author(s)
      Annie anak Joseph and Seiichi Ozawa
    • Journal Title

      Proc. of Int. Joint Conf. on Neural Networks 2014

      Volume: 1 Pages: 3135-3142

    • DOI

      10.1109/ijcnn.2014.6889940

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Detection of DDoS Backscatter Based on Traffic Features of Darknet TCP Packets2014

    • Author(s)
      Nobuaki Furutani, Tao Ban, Junji Nakazato, Jumpei Shimamura, Jun Kitazono, Seiichi Ozawa
    • Journal Title

      Proc. Ninth Asia Joint Conference on Information Security

      Volume: 1 Pages: 39-43

    • DOI

      10.1109/asiajcis.2014.23

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Detecting Malicious Spam Mails: An Online Machine Learning Approach2014

    • Author(s)
      Yuli Dai, Shunsuke Tada, Tao Ban, Junji Nakazato, Jumpei Shimamura, Seiichi Ozawa
    • Journal Title

      Neural Information Processing

      Volume: 8836 Pages: 365-372

    • DOI

      10.1007/978-3-319-12643-2_45

    • ISBN
      9783319126425, 9783319126432
    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Sentiment Analysis for Various SNS Media Using Naive Bayes Classifier and Its Application to Flaming Detection2014

    • Author(s)
      Shun Yoshida, Jun Kitazono, Seiichi Ozawa, Takahiro Sugawara, Tatsuya Haga, and Shogo Nakamura
    • Journal Title

      Proc. of 2014 IEEE Symposium on Computational Intelligence in Big Data

      Volume: 1 Pages: 1-6

    • DOI

      10.1109/cibd.2014.7011523

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] An Incremental Linear Discriminant Analysis for Data Streams Under Non-stationary Environment2014

    • Author(s)
      A. A. Joseph, Y.-M. Jang, S. Ozawa, and M. Lee
    • Journal Title

      Trans. of Institute of Systems, Control and Information Engineers

      Volume: 27 (4) Pages: 133-140

    • NAID

      130004565051

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Robust Incremental Principal Component Analysis for Feature Extraction from Stream Data with Missing Values2013

    • Author(s)
      D. Aoki, T. Omori, and S. Ozawa
    • Journal Title

      Proc. Int. Joint Conf. on Neural Networks 2013

      Volume: 1 Pages: 1-8

    • DOI

      10.1109/ijcnn.2013.6706771

    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Neural Network Model for Online Multi-Task Multi-Label Pattern Recognition2013

    • Author(s)
      D. Higuchi and S. Ozawa
    • Journal Title

      Artificial Neural Networks and Machine Learning – ICANN 2013

      Volume: 1 Pages: 162-169

    • DOI

      10.1007/978-3-642-40728-4_21

    • ISBN
      9783642407277, 9783642407284
    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Neural Network Model for Large-Scale Stream Data Learning Using Locally Sensitive Hashing2013

    • Author(s)
      A. Ali Siti Hajar, K. Fukase, and S. Ozawa
    • Journal Title

      Neural Information Processing

      Volume: 1 Pages: 369-376

    • DOI

      10.1007/978-3-642-42054-2_46

    • ISBN
      9783642420535, 9783642420542
    • Related Report
      2013 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Sequential Multitask Learning Algorithm for Pattern Recognition2012

    • Author(s)
      T. Takata, D. Higuchi, and S. Ozawa
    • Journal Title

      Proc. IEEE Int. Conf. on Development and Learning and Epigenetic Robotics

      Volume: 1 Pages: 1-2

    • DOI

      10.1109/devlrn.2012.6400827

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] Extension of Incremental Linear Discriminant Analysis to Online Feature Extraction under Nonstationary Environments2012

    • Author(s)
      A. A. Joseph, Y.-M. Jang, S. Ozawa, and M. Lee
    • Journal Title

      ICONIP 2012, LNCS 7664

      Volume: 2 Pages: 640-647

    • DOI

      10.1007/978-3-642-34481-7_78

    • ISBN
      9783642344800, 9783642344817
    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Sequential Multi-task Learning Neural Network with Metric-Based Knowledge Transfer2012

    • Author(s)
      S. Yue and S. Ozawa
    • Journal Title

      Proc. 11th Int. Conf. on Machine Learning and Applications

      Volume: 1 Pages: 671-674

    • DOI

      10.1109/icmla.2012.125

    • Related Report
      2012 Research-status Report
    • Peer Reviewed
  • [Presentation] ダークネットトラフィックに基づいたDDoSバックスキャッタ判定2015

    • Author(s)
      古谷暢章, 班 涛, 中里純二, 島村隼平, 北園淳, 小澤誠一
    • Organizer
      59回システム制御情報学会研究発表講演会
    • Place of Presentation
      中央電気倶楽部
    • Year and Date
      2015-05-20 – 2015-05-22
    • Related Report
      2014 Annual Research Report
  • [Presentation] 炎上検知のための Twitter ユーザーの分類2015

    • Author(s)
      横田凌一, 粟屋成崇, 北園淳, 小澤誠一
    • Organizer
      59回システム制御情報学会研究発表講演会
    • Place of Presentation
      中央電気倶楽部
    • Year and Date
      2015-05-20 – 2015-05-22
    • Related Report
      2014 Annual Research Report
  • [Presentation] ダークネットトラフィック観測によるDDoSバックスキャッタ判定2014

    • Author(s)
      古谷暢章, 班 涛, 中里純二, 島村隼平, 北園 淳, 小澤誠一
    • Organizer
      電子情報通信学会情報通信システムセキュリティ研究会
    • Place of Presentation
      東北学院大学 多賀城キャンパス
    • Year and Date
      2014-11-27 – 2014-11-28
    • Related Report
      2014 Annual Research Report
  • [Presentation] マルチラベル・パターン認識機能を有する逐次マルチタスク学習モデル2014

    • Author(s)
      樋口大輔,小澤誠一
    • Organizer
      平成26年 電気学会 電子・情報・システム部門大会
    • Place of Presentation
      島根大学 松江キャンパス
    • Year and Date
      2014-09-03 – 2014-09-06
    • Related Report
      2014 Annual Research Report
  • [Presentation] A Neural Network Model for Incremental Learning of Large-Scale Stream Data2014

    • Author(s)
      Ali Siti Hajar Aminah, Kiminori Fukase, and Seiichi Ozawa
    • Organizer
      58回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2014-05-21 – 2014-05-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] Fast Online Feature Extraction Using Chunk Incremental Kernel Principal Component Analysis2014

    • Author(s)
      Annie anak Joseph and Seiichi Ozawa
    • Organizer
      58回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2014-05-21 – 2014-05-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] ダークネットパケットに対するDDoS攻撃によるバックスキャッター判定に関する研究2014

    • Author(s)
      古谷暢章, 班 涛, 中里純二, 島村隼平, 小澤誠一
    • Organizer
      58回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2014-05-21 – 2014-05-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] ダークネットトラフィックデータ解析によるサブネットの分類に関する研究2014

    • Author(s)
      西風宗典, 班 涛, 島村隼平, 中里純二, 小澤誠一
    • Organizer
      58回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2014-05-21 – 2014-05-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] 文構造と経験則に基づいたネガティブツイート識別器の提案2014

    • Author(s)
      吉田 舜,小澤誠一,矢澤隆志,芳賀達也,菅原貴弘
    • Organizer
      58回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Year and Date
      2014-05-21 – 2014-05-23
    • Related Report
      2014 Annual Research Report
  • [Presentation] スパムメールに対するオンライン悪性度判定システムの開発2014

    • Author(s)
      多田隼輔,中里純二,班 涛,小澤誠一
    • Organizer
      2014年暗号と情報セキュリティーシンポジウム
    • Place of Presentation
      城山観光ホテル
    • Related Report
      2013 Research-status Report
  • [Presentation] ダークネットトラフィックデータ解析によるサブネットの分類に関する研究2014

    • Author(s)
      西風宗典,小澤誠一,班 涛,中里純二,島村隼平
    • Organizer
      第58回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Related Report
      2013 Research-status Report
  • [Presentation] ダークネットパケットに対するDDoS攻撃によるバックスキャッター判定に関する研究2014

    • Author(s)
      古谷暢章,班 涛,中里純二,島村隼平,小澤誠一
    • Organizer
      第58回システム制御情報学会研究発表講演会
    • Place of Presentation
      京都テルサ
    • Related Report
      2013 Research-status Report
  • [Presentation] ダークネットトラフィックデータの解析による サブネットの脆弱性判定に関する研究2013

    • Author(s)
      西風宗典,班涛,小澤誠一
    • Organizer
      コンピュータセキュリティシンポジウム 2013
    • Place of Presentation
      かがわ国際会議場
    • Related Report
      2013 Research-status Report
  • [Presentation] トラフィック観測による行動認識に関する研究2013

    • Author(s)
      西風宗典,多田隼輔,小澤誠一
    • Organizer
      第57回システム制御情報学会研究発表講演会
    • Place of Presentation
      兵庫県民会館
    • Related Report
      2013 Research-status Report 2012 Research-status Report
  • [Presentation] ダブルバウンス・スパムメールの悪性度判定とオンライン学習への拡張2013

    • Author(s)
      多田隼輔,班 涛,中里純二,小澤誠一
    • Organizer
      第6回NICTERプロジェクトワークショップ
    • Place of Presentation
      ABC貸会議室
    • Related Report
      2013 Research-status Report
  • [Presentation] 追加学習型主成分分析の高速化と顔画像認識への応用2012

    • Author(s)
      青木大二郎,小澤誠一
    • Organizer
      電子情報通信学会 ニューロコンピューティング研究会
    • Place of Presentation
      沖縄科学技術大学院大学
    • Related Report
      2012 Research-status Report

URL: 

Published: 2013-05-31   Modified: 2019-07-29  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi