• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2020 Fiscal Year Research-status Report

樹状突起ニューロンによる非線形的フィルターをもつ畳み込みニューラルネットワーク

Research Project

Project/Area Number 19K12136
Research InstitutionKanazawa University

Principal Investigator

唐堂 由其  金沢大学, 電子情報通信学系, 准教授 (70636927)

Co-Investigator(Kenkyū-buntansha) 唐 政  富山大学, 学術研究部工学系, 教授 (90227299)
Project Period (FY) 2019-04-01 – 2022-03-31
Keywords樹状突起ニューロン / 畳み込みニューラルネットワーク / 超非線形的フィルター
Outline of Annual Research Achievements

現在、畳み込みニューラルネットワーク(CNN: Convolutional Neural Network)をはじめとする深層学習(ディープラーニング)はさまざまな機械学習タスクで驚異的な性能を実現していて、画像認識分野における躍進は研究業界のみならず広く一般的に大きなインパクトを与え,現在の人工知能ブームの顔になっている。
しかし、現在の畳み込みニューラルネットワーク(CNN)における画像の局所的な特徴抽出を担う各畳み込み層(フィルター)では、単純な線形荷重和が用いられているため、特徴の微小平行移動に対する不変性は実現できるが、回転やアフィン変換のように、より複雑な変化に対する不変性は実現できない。
R2年度において、本研究は現在の畳み込みニューラルネットワークにおける画像の局所的な特徴抽出を担う畳み込み層に非線形な特性を利用し、画像の画素とフィルターの画素の相関(画素値の積)を空間的線形荷重とし、その後に非線形シグモイド関数(S(・))を適用する;更に、隣接する画素の相関性から、非線形処理後の画像の画素とフィルターの画素の相関(画素値の積)を樹状突起におけるシナプス間の非線形相互作用を利用し、更に掛け算(min)とすることにより、回転やアフィン変換のような、より複雑な変化に対する不変性が実現できる非線形的フィルターを実現した。
更に、樹状突起ニューロンを用いた超非線形畳み込みニューラルネットワークの実装を行った。具体的に、樹状突起ニューロンを用いたの非線形フィルターを用いて、現在の畳み込みニューラルネットワークと同様に、非線形フィルターを用いた畳み込み層と現在のプーリング層の順に、複数回繰り返すことによって構成される非線形的畳み込みニューラルネットワークを実装し、その動作を確認した。また、それを現在の畳み込みニューラルネットワークと性能やコストなどの面から比較研究を行った。

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

R2年度において、主に樹状突起ニューロンを用いた超非線形的フィルターの畳み込みニューラルネットワークの実装を行った。その研究成果として、査読付き学術論文を8篇、国際学会論文を14篇を発表した。

Strategy for Future Research Activity

画像認識と医療画像診断システム開発への適用(R3年度)
金沢医科大学からの正常40例早期糖尿病 40例ほどの組織をスキャンした画像の生データを使い、本研究で提案した非線形的畳み込みニューラルネットワークで画像認識への有効性を確認した上で、医療画像診断システムに適用し、実用化を図る。

Causes of Carryover

新型コロナウイルスによる影響

  • Research Products

    (22 results)

All 2020

All Journal Article (8 results) (of which Int'l Joint Research: 8 results,  Peer Reviewed: 8 results) Presentation (14 results) (of which Int'l Joint Research: 14 results)

  • [Journal Article] Accuracy Versus Simplification in an Approximate Logic Neural Model2020

    • Author(s)
      Ji Junkai、Tang Yajiao、Ma Lijia、Li Jianqiang、Lin Qiuzhen、Tang Zheng、Todo Yuki
    • Journal Title

      IEEE Transactions on Neural Networks and Learning Systems

      Volume: 6 Pages: 1~14

    • DOI

      10.1109/TNNLS.2020.3027298

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Novel Median Dendritic Neuron Model for Prediction2020

    • Author(s)
      Wang Shi、Yu Yang、Zou Lin、Li Sheng、Yu Hang、Todo Yuki、Gao Shangce
    • Journal Title

      IEEE Access

      Volume: 8 Pages: 192339~192351

    • DOI

      10.1109/ACCESS.2020.3032948

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Evaluating a dendritic neuron model for wind speed forecasting2020

    • Author(s)
      Song Zhenyu、Tang Yajiao、Ji Junkai、Todo Yuki
    • Journal Title

      Knowledge-Based Systems

      Volume: 201-202 Pages: 106052~106052

    • DOI

      10.1016/j.knosys.2020.106052

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Evolutionary Dendritic Neural Model for Classification Problems2020

    • Author(s)
      Qian Xiaoxiao、Tang Cheng、Todo Yuki、Lin Qiuzhen、Ji Junkai
    • Journal Title

      Complexity

      Volume: 2020 Pages: 1~13

    • DOI

      10.1155/2020/6296209

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A novel machine learning technique for computer-aided diagnosis2020

    • Author(s)
      Tang Cheng、Ji Junkai、Tang Yajiao、Gao Shangce、Tang Zheng、Todo Yuki
    • Journal Title

      Engineering Applications of Artificial Intelligence

      Volume: 92 Pages: 103627~103627

    • DOI

      10.1016/j.engappai.2020.103627

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] TDSD: A New Evolutionary Algorithm Based on Triple Distinct Search Dynamics2020

    • Author(s)
      Li Xiaosi、Cai Zonghui、Wang Yirui、Todo Yuki、Cheng Jiujun、Gao Shangce
    • Journal Title

      IEEE Access

      Volume: 8 Pages: 76752~76764

    • DOI

      10.1109/ACCESS.2020.2989029

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Gravitational Search Algorithm With Chaotic Neural Oscillators2020

    • Author(s)
      Wang Yirui、Gao Shangce、Yu Yang、Wang Ziqian、Cheng Jiujun、Yuki Todo
    • Journal Title

      IEEE Access

      Volume: 8 Pages: 25938~25948

    • DOI

      10.1109/ACCESS.2020.2971505

    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Dendritic Neuron Model with Adaptive Synapses Trained by Differential Evolution Algorithm2020

    • Author(s)
      Wang Zhe、Gao Shangce、Wang Jiaxin、Yang Haichuan、Todo Yuki
    • Journal Title

      Computational Intelligence and Neuroscience

      Volume: 2020 Pages: 1~19

    • DOI

      10.1155/2020/2710561

    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Training Dendritic Neuron Model with Whale Optimization Algorithm for Classification2020

    • Author(s)
      Zhenyu Han, Jiarui Shi, Yuki Todo, and Shangce Gao
    • Organizer
      2020 IEEE International Conference on Progress in Informatics and Computing (PIC-2020)
    • Int'l Joint Research
  • [Presentation] A Sine Cosine Algorithm Enhanced Spherical Evolution for Continuous Optimization Problems2020

    • Author(s)
      Pengxing Cai, Haichuan Yang, Yu Zhang, Yuki Todo, Zheng Tang, and Shangce Gao
    • Organizer
      2020 13th International Symposium on Computational Intelligence and Design (ISCID 2020)
    • Int'l Joint Research
  • [Presentation] A Hybrid Spherical Search and Whale Optimization Algorithm2020

    • Author(s)
      Jiarui Shi, Jia Yu, Chiyan Lee, Yuki Todo, and Shangce Gao
    • Organizer
      2020 13th International Symposium on Computational Intelligence and Design (ISCID 2020)
    • Int'l Joint Research
  • [Presentation] Differential Evolution-Based Wingsuit Flying Search for Optimization2020

    • Author(s)
      Linfeng Du, Yu Zhang, Syuhei Sato, Yuki Todo, Zheng Tang, and Shangce Gao
    • Organizer
      2020 13th International Symposium on Computational Intelligence and Design (ISCID 2020)
    • Int'l Joint Research
  • [Presentation] Spherical Evolution Enhanced with Salp Swarm Algorithm2020

    • Author(s)
      Zhen Li, Haichuan Yang, Zhiming Zhang, Yuki Todo, and Shangce Gao
    • Organizer
      2020 13th International Symposium on Computational Intelligence and Design (ISCID 2020)
    • Int'l Joint Research
  • [Presentation] Using Grey Wolf Hunting Mechanism to Improve Spherical Search2020

    • Author(s)
      Sicheng Liu, Sichen Tao, Haichuan Yang, Lin Jiang, Yuki Todo, and Shangce Gao
    • Organizer
      2020 13th International Symposium on Computational Intelligence and Design (ISCID 2020)
    • Int'l Joint Research
  • [Presentation] Wingsuit Flying Search Enhanced by Spherical Evolution2020

    • Author(s)
      Jiaru Yang, Yu Zhang, Ziqian Wang, Yuki Todo, and Shangce Gao
    • Organizer
      The 15th International Conference on Bio-inspired Computing: Theories and Applications (BIC-TA 2020)
    • Int'l Joint Research
  • [Presentation] A Spherical Search-based Archive Update Mechanism for Self-adaptive Differential Evolution2020

    • Author(s)
      Yu Zhang, Zhenyu Lei, Zhiming Zhang, Yuki Todo, Zheng Tang, and Shangce Gao
    • Organizer
      2020 IEEE International Conference on Artificial Intelligence and Information Systems (ICAIIS 2020)
    • Int'l Joint Research
  • [Presentation] A Hybrid Spherical Evolution and Particle Swarm Optimization Algorithm2020

    • Author(s)
      Zhiming Zhang, Zhenyu Lei, Yu Zhang, Yuki Todo, Zheng Tang, and Shangce Gao
    • Organizer
      2020 IEEE International Conference on Artificial Intelligence and Information Systems (ICAIIS 2020)
    • Int'l Joint Research
  • [Presentation] A Novel Spherical Search Based Grey Wolf Optimizer for Optimization Problems2020

    • Author(s)
      Zhe Wang, Haichuan Yang, Ziqian Wang, Yuki Todo, Zheng Tang, and Shangce Gao
    • Organizer
      2020 IEEE International Conference on Artificial Intelligence and Information Systems (ICAIIS 2020)
    • Int'l Joint Research
  • [Presentation] Improved Teaching-Learning-based Optimization Algorithm with Advanced Learning Strategy2020

    • Author(s)
      Qianqian Li, Yang Yu, Ziqian Wang, Yuki Todo, and Shangce Gao
    • Organizer
      2020 12th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2020)
    • Int'l Joint Research
  • [Presentation] A Novel Brain Storm Optimization Algorithm Driven by Sine-Cosine Search Mechanism2020

    • Author(s)
      Qianqian Li, Yang Yu, Ziqian Wang, Yuki Todo, and Shangce Gao
    • Organizer
      2020 12th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2020)
    • Int'l Joint Research
  • [Presentation] A Hybrid Spherical Search and Moth-flame Optimization Algorithm2020

    • Author(s)
      Sichen Tao, Kaiyu Wang, Zhiming Zhang, Chiyan Lee, Yuki Todo, and Shangce Gao
    • Organizer
      2020 12th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2020)
    • Int'l Joint Research
  • [Presentation] A Hybrid Spherical Search and Sine Cosine Algorithm2020

    • Author(s)
      Kaiyu Wang, Sichen Tao, Zhiming Zhang, Yuki Todo, and Shangce Gao
    • Organizer
      2020 12th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC 2020)
    • Int'l Joint Research

URL: 

Published: 2021-12-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi