Design of Neural Network with Autonomy and its Circuit Implementation

2016 Fiscal Year Annual Research Report

• Project/Area Number: 26540127
• Research Institution: The University of Tokushima
• Principal Investigator: 上手 洋子 徳島大学, 大学院理工学研究部, 准教授 (80582642)
• Co-Investigator(Kenkyū-buntansha): 西尾 芳文 徳島大学, 大学院理工学研究部, 教授 (80253227)
• Project Period (FY): 2014-04-01 – 2017-03-31
• Keywords: ニューラルネットワーク / 脳情報処理 / 複雑系ネットワーク / 自律性 / 同期現象

Outline of Annual Research Achievements

本年度の研究計画は、これまでに設計した自律性を有するニューラルネットワークの回路実装であった。提案するニューラルネットワークは、ニューロン間の結合荷重がランダムに切り替わるダイナミックな複雑系システムである。昨年度、実際のシステムモデルを見据えて時間遅れ結合を有する1次元写像の結合系で観測される同期現象の調査を行ってきた。時間遅れの長さを変化させることで、周期解の同期現象に影響が生じることを確認している。
本年度は、1次元写像モデルを非線形回路で実現することに成功した。非線形回路として、時間遅れを有するカオス回路を用いた。また、その時間遅れを隣接するカオス回路に用い結合させることで、より実際のダイナミカルシステムに近いモデルを提案することができた。
また、脳神経科学分野では、脳内のニューロン間の結合ネットワークはヘビーテイル分布に従うことが明らかにされてきている。よって、複雑ネットワークの特徴量を模した結合カオス回路ネットワークの提案を行った。ここでは、複雑ネットワークの特徴量として次数分布に着もし、いくつかの次数分布を持つネットワークで、同期率がどのように変化するのかの調査を行った。シミュレーションの結果、スケールフリー則に従ったネットワークの同期率がランダムネットワークよりも低くなることが明らかになった。
さらに、自律性を有するアルゴリズム開発として、新しい群知能アルゴリズムの提案およびディープラーニングの学習効率向上に、カオスノイズ注入を用いた場合の性能調査を行った。
また、研究分担者の西尾は、特徴の異なる二つの非線形回路ネットワークを結合した場合の同期現象の回路実装を行っている。

Research Products

• [Journal Article] K-Means Algorithm Using Improved Firefly Algorithm (2017)
  • Author(s): Masaki TAKEUCHI, Thomas OTT, Haruna MATSUSHITA, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP'17) Volume: 1 Pages: 225-228
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Analysis of Firefly Algorithm Combined with Chaotic Map (2017)
  • Author(s): Masaki MORIYAMA, Masaki TAKEUCHI, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP'17) Volume: 1 Pages: 229-232
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Synchronization in Two Rings of Coupled Three van der Pol Oscillators (2017)
  • Author(s): Daiki NARIAI, Minh Hai TRAN, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP'17) Volume: 1 Pages: 289-292
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Synchronization of Coupled Two Rings of Chaotic Circuits (2017)
  • Author(s): Katsuki NAKASHIMA, Kazuki UETA, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP'17) Volume: 1 Pages: 325-328
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Synchronization Phenomena in Complex Networks of Coupled Chaotic Circuits with Different Degree Distribution (2017)
  • Author(s): Shuhei HASHIMOTO, Takahiro CHIKAZAWA, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP'17) Volume: 1 Pages: 333-336
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Deep Learning Improving Learning Efficiency by Using Noise for Back Propagation (2016)
  • Author(s): Kazuki NAGAO, Shinsaburo KITTAKA, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of IEEE Workshop on Nonlinear Circuit Networks (NCN'16) Volume: 1 Pages: 1-4
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Improved Firefly Algorithms Including Slow Fireflies (2016)
  • Author(s): Masaki TAKEUCHI, Haruna MATSUSHITA, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of IEEE Workshop on Nonlinear Circuit Networks (NCN'16) Volume: 1 Pages: 53-56
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Journal Article] Switching Synchronization States of Ring System of Chaotic Circuit Including Time Delay in One-Direction (2016)
  • Author(s): Seiya KITA, Yoko UWATE and Yoshifumi NISHIO
  • Journal Title: Proceedings of IEEE Workshop on Nonlinear Circuit Networks (NCN'16) Volume: 1 Pages: 67-70
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Presentation] Synchronization State of a Ring of Coupled One-Direction Time-Delayed Chaotic Circuits (2016)
  • Author(s): Seiya KITA, Yoko UWATE and Yoshifumi NISHIO
  • Organizer: IEEE CASS Shanghai and Shikoku Chapters Joint Workshop on Circuits and Systems (SSJW'16)
  • Place of Presentation: 上海交通大学 (上海, 中国)
  • Year and Date: 2016-11-24
  • Int'l Joint Research
• [Presentation] Deep Learning for Noisy Back Propagation (2016)
  • Author(s): Kazuki NAGAO, Shinsaburo KITTAKA, Yoko UWATE and Yoshifumi NISHIO
  • Organizer: IEEE CASS Shanghai and Shikoku Chapters Joint Workshop on Circuits and Systems (SSJW'16)
  • Place of Presentation: 上海交通大学 (上海, 中国)
  • Year and Date: 2016-11-24
  • Int'l Joint Research
• [Presentation] Features of Firefly Algorithm Inceasing Females (2016)
  • Author(s): Masaki TAKEUCHI, Haruna MATSUSHITA, Yoko UWATE and Yoshifumi NISHIO
  • Organizer: Taiwan and Japan Conference on Circuits and Systems (TJCAS'16)
  • Place of Presentation: National Cheng Kung University, Tainan, Taiwan
  • Year and Date: 2016-08-01
  • Int'l Joint Research
• [Presentation] Synchronization Phenomena in a Ring of Coupled Three van der Pol Oscillators (2016)
  • Author(s): Daiki NARIAI, Minh Hai TRAN, Yoko UWATE and Yoshifumi NISHIO
  • Organizer: Taiwan and Japan Conference on Circuits and Systems (TJCAS'16)
  • Place of Presentation: National Cheng Kung University, Tainan, Taiwan
  • Year and Date: 2016-08-01
  • Int'l Joint Research
• [Presentation] Synchronization in Frustrated Coupled Oscillatory Systems (2016)
  • Author(s): Yoko UWATE, Yoshifumi NISHIO and Ruedi STOOP
  • Organizer: IEEE CASS Guangzhou and Shikoku Chapters Joint Workshop on Circuits and Systems (GSCAS'16)
  • Place of Presentation: South China University of Technology, Guangzhou, China
  • Year and Date: 2016-07-15
  • Int'l Joint Research
• [Presentation] Firefly Algorithm Focused on Female Moving Distance (2016)
  • Author(s): Masaki TAKEUCHI, Haruna MATSUSHITA, Yoko UWATE and Yoshifumi NISHIO
  • Organizer: IEEE CASS Guangzhou and Shikoku Chapters Joint Workshop on Circuits and Systems (GSCAS'16)
  • Place of Presentation: South China University of Technology, Guangzhou, China
  • Year and Date: 2016-07-15
  • Int'l Joint Research