• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on Causality-Inspired Deep Learning Model for Anomaly Detection with Imbalanced Data

Research Project

Project/Area Number 23K11064
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 60060:Information network-related
Research InstitutionShiga University

Principal Investigator

周 暁康  滋賀大学, データサイエンス学系, 准教授 (70635234)

Project Period (FY) 2023-04-01 – 2026-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2025: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2024: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2023: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
KeywordsCRL / ITL / GAN / Federated Learning / Reinforcement Learning / Digital Twin / ユビキタスコンピューティング / ビッグデータ / 深層学習 / 因果推論 / 異常検知
Outline of Research at the Start

本研究は、インテリジェントCPSフレームワークに基づき、実際の産業シナリオとデータに着目し、深層学習理論と因果推論を融合し生産環境における障害診断と異常検知モデリング手法を提案し、より信頼性の高く効果的な異常検知システムの実現及び新しい異常への既存の検出モデルの識別効率の向上を目指し、三つの側面から研究を進める。サンプル数の少ない不均衡データ、因果ヒューリスティックの特徴表現や信頼できる対象の識別など技術的課題を解決し、最終的にインテリジェントファクトリーの設備異常検知と早期警報の可視化プラットフォームの開発及びアプリケーション デモンストレーションを完成させる。

Outline of Annual Research Achievements

2023年度は、IoTやCPSS (Cyber-Physical-Social System)環境におけるデータの不均衡やサンプル数が少ない問題に対して、様々な機械学習及び深層学習モデル(強化学習、連合学習、GAN等)の開発と実装を行いました。研究成果の一部をまとめ、いくつかの学術論文誌に投稿し、国際会議で発表しました。
例えば、機械学習パラダイムにおける頑健なOOD汎化を強化することを目的として、情報理論学習(ITL)と因果表現学習(CRL)を二重生成敵対ネットワーク(Dual-GAN)アーキテクチャにシームレスに組み込んだ深層生成モデルフレームワークを新たに設計・提案しました。新たに設計された特徴分離戦略に従って、情報理論に基づく因果グラフが構築・改良され、分離されたコア特徴間の因果関連因子を強化し、洗練された因果関係に基づく介入を介して、反事実特徴で特徴表現をさらに充実させることができました。
また、軽量モデル学習とリアルタイム処理を容易にするために、デジタルツインシステムを組み込んだ、エンドエッジクラウド構造の3層連合強化学習フレームワークを設計・開発しました。デュアル強化学習スキームは、協調的な意思決定戦略により、連合学習中のクライアントノード選択とグローバルアグリゲーション頻度の最適化をサポートするために考案され、モバイルデバイスと環境変化をリアルタイムで監視するためにエッジクラウドに配置された2層のデジタルツインシステムによって支援されました。一方、軽量データ増強メカニズムを備えたモデル分割スキームが、より的を絞った方法で、分割されたニューラルネットワーク構造に基づく集約重みを個別に最適化するためにグローバルに開発され、全体的な通信コストを効果的に削減し、非IID問題を改善することができました。

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

スケジュールに記載してある「サンプル数の少なさや不均衡問題に対する多様性を持つデータの拡張手法の開発」、「因果ヒューリスティック深層学習に基づく異常検知・予測モデルの構築」、「連合学習等の手法を用いて異常検知による信頼できる対象の識別方法の開発」により、発表した学術結果は基本的に期待に応えています。

Strategy for Future Research Activity

最終的にスマートファクトリーの設備異常検知と早期警報の可視化プラットフォームの開発のために、深層学習理論と因果推論の融合モデル、及び異常検知・予測の精度を向上させるアルゴリズムに工夫しなければなりません。
2024年度は、2023年度の研究を継続し、特に「異常検知のための構造化モデルの解釈可能性の探索」、「マルチモーダル異常の因果推論モデルの構築」、及び「複雑な環境における異常検知モデルの分散トレーニング」に対して、効率的なモデルとアルゴリズムの開発を中心に進めていく予定です。

Report

(1 results)
  • 2023 Research-status Report
  • Research Products

    (26 results)

All 2024 2023

All Journal Article (21 results) (of which Int'l Joint Research: 21 results,  Peer Reviewed: 21 results,  Open Access: 1 results) Presentation (5 results) (of which Int'l Joint Research: 5 results)

  • [Journal Article] Incentive Mechanism Design of Federated Learning for Recommendation Systems in MEC2024

    • Author(s)
      Huang Jiwei、Ma Bowen、Wang Ming、Zhou Xiaokang、Yao Lina、Wang Shoujin、Qi Lianyong、Chen Ying
    • Journal Title

      IEEE Transactions on Consumer Electronics

      Volume: 70 Issue: 1 Pages: 2596-2607

    • DOI

      10.1109/tce.2023.3342187

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Digital Twin-Assisted Edge Service Caching for Consumer Electronics Manufacturing2024

    • Author(s)
      Liu Wei、Xu Xiaolong、Qi Lianyong、Zhou Xiaokang、Yan Hanzhi、Xia Xiaoyu、Dou Wanchun
    • Journal Title

      IEEE Transactions on Consumer Electronics

      Volume: 70 Issue: 1 Pages: 3141-3151

    • DOI

      10.1109/tce.2024.3357136

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Tensor-Train-Based Incremental High Order Dominant Z-Eigen Decomposition for Multi-Modal Intelligent Transportation Prediction2024

    • Author(s)
      Liu Huazhong、Zhang Yunfan、Ding Jihong、Zhang Hanning、Yang Laurence T.、Zhou Xiaokang
    • Journal Title

      IEEE Transactions on Intelligent Transportation Systems

      Volume: 25 Issue: 3 Pages: 2534-2544

    • DOI

      10.1109/tits.2023.3321730

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Federated distillation and blockchain empowered secure knowledge sharing for Internet of medical Things2024

    • Author(s)
      Zhou Xiaokang、Huang Wang、Liang Wei、Yan Zheng、Ma Jianhua、Pan Yi、I-Kai Wang Kevin
    • Journal Title

      Information Sciences

      Volume: 662 Pages: 120217-120217

    • DOI

      10.1016/j.ins.2024.120217

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Spatio-Temporal Graph Convolutional Networks via View Fusion for Trajectory Data Analytics2023

    • Author(s)
      Hu Wenya、Li Weimin、Zhou Xiaokang、Kawai Akira、Fueda Kaoru、Qian Quan、Wang Jianjia
    • Journal Title

      IEEE Transactions on Intelligent Transportation Systems

      Volume: 24 Issue: 4 Pages: 4608-4620

    • DOI

      10.1109/tits.2022.3210559

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Data-Driven System-Level Design Framework for Responsible Cyber-Physical-Social Systems2023

    • Author(s)
      Zhang Shunli、Yang Laurence T.、Zhang Yue、Zhou Xiaokang、Cui Zongmin
    • Journal Title

      Computer

      Volume: 56 Issue: 4 Pages: 80-91

    • DOI

      10.1109/mc.2023.3243645

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Dual-Driven Resource Management for Sustainable Computing in the Blockchain-Supported Digital Twin IoT2023

    • Author(s)
      Wang Dan、Li Bo、Song Bin、Liu Yingjie、Muhammad Khan、Zhou Xiaokang
    • Journal Title

      IEEE Internet of Things Journal

      Volume: 10 Issue: 8 Pages: 6549-6560

    • DOI

      10.1109/jiot.2022.3162714

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Popularity-Aware and Diverse Web APIs Recommendation Based on Correlation Graph2023

    • Author(s)
      Wu Shengqi、Shen Shigen、Xu Xiaolong、Chen Ying、Zhou Xiaokang、Liu Dongning、Xue Xiao、Qi Lianyong
    • Journal Title

      IEEE Transactions on Computational Social Systems

      Volume: 10 Issue: 2 Pages: 771-782

    • DOI

      10.1109/tcss.2022.3168595

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Reputation-Aware Supplier Assessment for Blockchain-Enabled Supply Chain in Industry 4.02023

    • Author(s)
      Xu Xiaolong、Gu Ji、Yan Hanzhi、Liu Wentao、Qi Lianyong、Zhou Xiaokang
    • Journal Title

      IEEE Transactions on Industrial Informatics

      Volume: 19 Issue: 4 Pages: 5485-5494

    • DOI

      10.1109/tii.2022.3190380

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Decentralized P2P Federated Learning for Privacy-Preserving and Resilient Mobile Robotic Systems2023

    • Author(s)
      Zhou Xiaokang、Liang Wei、Wang Kevin I-Kai、Yan Zheng、Yang Laurence T.、Wei Wei、Ma Jianhua、Jin Qun
    • Journal Title

      IEEE Wireless Communications

      Volume: 30 Issue: 2 Pages: 82-89

    • DOI

      10.1109/mwc.004.2200381

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Intelligent Containment Control With Double Constraints for Cloud-Based Collaborative Manufacturing2023

    • Author(s)
      Zhou Xiaokang、Hou Hailiang、Liang Wei、Wang Kevin I-Kai、Jin Qun
    • Journal Title

      IEEE Transactions on Industrial Informatics

      Volume: 19 Issue: 6 Pages: 7541-7551

    • DOI

      10.1109/tii.2022.3211878

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Graph Attention Network With Spatial-Temporal Clustering for Traffic Flow Forecasting in Intelligent Transportation System2023

    • Author(s)
      Chen Yan、Shu Tian、Zhou Xiaokang、Zheng Xuzhe、Kawai Akira、Fueda Kaoru、Yan Zheng、Liang Wei、Wang Kevin I-Kai
    • Journal Title

      IEEE Transactions on Intelligent Transportation Systems

      Volume: 24 Issue: 8 Pages: 8727-8737

    • DOI

      10.1109/tits.2022.3208952

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Hierarchical Federated Learning With Social Context Clustering-Based Participant Selection for Internet of Medical Things Applications2023

    • Author(s)
      Zhou Xiaokang、Ye Xiaozhou、Wang Kevin I-Kai、Liang Wei、Nair Nirmal Kumar C.、Shimizu Shohei、Yan Zheng、Jin Qun
    • Journal Title

      IEEE Transactions on Computational Social Systems

      Volume: 10 Issue: 4 Pages: 1742-1751

    • DOI

      10.1109/tcss.2023.3259431

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] CNN Partitioning and Offloading for Vehicular Edge Networks in Web32023

    • Author(s)
      Xu Xiaolong、Tang Sizhe、Qi Lianyong、Zhou Xiaokang、Dai Fei、Dou Wanchun
    • Journal Title

      IEEE Communications Magazine

      Volume: 61 Issue: 8 Pages: 36-42

    • DOI

      10.1109/mcom.002.2200424

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A distributed game theoretical approach for credibility-guaranteed multimedia data offloading in MEC2023

    • Author(s)
      Chen Ying、Zhao Jie、Zhou Xiaokang、Qi Lianyong、Xu Xiaolong、Huang Jiwei
    • Journal Title

      Information Sciences

      Volume: 644 Pages: 119306-119306

    • DOI

      10.1016/j.ins.2023.119306

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Digital Twin Enhanced Federated Reinforcement Learning With Lightweight Knowledge Distillation in Mobile Networks2023

    • Author(s)
      Zhou Xiaokang、Zheng Xuzhe、Cui Xuesong、Shi Jiashuai、Liang Wei、Yan Zheng、Yang Laurence T.、Shimizu Shohei、Wang Kevin I-Kai
    • Journal Title

      IEEE Journal on Selected Areas in Communications

      Volume: 41 Issue: 10 Pages: 3191-3211

    • DOI

      10.1109/jsac.2023.3310046

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Edge-enabled federated sequential recommendation with knowledge-aware Transformer2023

    • Author(s)
      Wei Shanming、Meng Shunmei、Li Qianmu、Zhou Xiaokang、Qi Lianyong、Xu Xiaolong
    • Journal Title

      Future Generation Computer Systems

      Volume: 148 Pages: 610-622

    • DOI

      10.1016/j.future.2023.06.028

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Video Super-Resolution Based on Inter-Frame Information Utilization for Intelligent Transportation2023

    • Author(s)
      Guo Kehua、Zhang Zhuo、Guo Haifu、Ren Sheng、Wang Lei、Zhou Xiaokang、Liu Chao
    • Journal Title

      IEEE Transactions on Intelligent Transportation Systems

      Volume: 24 Issue: 11 Pages: 13409-13421

    • DOI

      10.1109/tits.2023.3237708

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Novel supply chain vulnerability detection based on heterogeneous-graph-driven hash similarity in IoT2023

    • Author(s)
      Ye Guodong、Liu Xin、Fan Siqi、Tan Yuan、Zhou Qingguo、Zhou Rui、Zhou Xiaokang
    • Journal Title

      Future Generation Computer Systems

      Volume: 148 Pages: 201-210

    • DOI

      10.1016/j.future.2023.06.006

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Bi-Dueling DQN Enhanced Two-Stage Scheduling for Augmented Surveillance in Smart EMS2023

    • Author(s)
      Liang Wei、Xie Weiquan、Zhou Xiaokang、I-Kai Wang Kevin、Ma Jianhua、Jin Qun
    • Journal Title

      IEEE Transactions on Industrial Informatics

      Volume: 19 Issue: 7 Pages: 8218-8228

    • DOI

      10.1109/tii.2022.3216295

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Federal learning edge network based sentiment analysis combating global COVID-192023

    • Author(s)
      Liang Wei、Chen Xiaohong、Huang Suzhen、Xiong Guanghao、Yan Ke、Zhou Xiaokang
    • Journal Title

      Computer Communications

      Volume: 204 Pages: 33-42

    • DOI

      10.1016/j.comcom.2023.03.009

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Data Freshness Performance Analysis in NOMA-enabled Green Mobile Crowdsensing2023

    • Author(s)
      Y. Yang, B. Zhang, D. Guo, R. Xu, L. Ge, W. Wang, and X. Zhou
    • Organizer
      ICC 2023 (2023 IEEE International Conference on Communications)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Function Fitting System Based on Genetic Algorithm2023

    • Author(s)
      Q. Sun, X. Zhou, and J. Wang
    • Organizer
      GPC 2023 (The 18th International Conference on Green, Pervasive, and Cloud Computing)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] BiLSTM and VAE Enhanced Multi-Task Neural Network for Trust-Aware E-Commerce Product Analysis2023

    • Author(s)
      S. Wani, X. Zhou, and S. Shimizu
    • Organizer
      TrustCom 2023 (The 22nd IEEE International Conference on Trust, Security and Privacy in Computing and Communications)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Deep Graph Convolutional Network based Web API Classification Approach for Mashup Creation2023

    • Author(s)
      L. Qi, B. Yan, J. Zheng, X. Xu, W. Dou, and X. Zhou
    • Organizer
      HPCC 2023 (The 25th IEEE International Conferences on High Performance Computing and Communications)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Novel Gold Futures Price Prediction Model Based on PCA-AGRU2023

    • Author(s)
      J. Wang, T. Lu, J. Liu, Q. Sun, L. Qi, and X. Zhou
    • Organizer
      ICPADS 2023 (The 29th IEEE International Conference on Parallel and Distributed Systems)
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2023-04-13   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi