Hierarchical Spatio-Temporal Structure of Biological Information in the Dynamic Coordination on Brain-Body-Environment: An Explorative Embodiment Approach with Brain-Inspired Tools and Robotics

• Project Area: Non-linear Neuro-oscillology: Towards Integrative Understanding of Human Nature
• Project/Area Number: 16H01616
• Research Category: Grant-in-Aid for Scientific Research on Innovative Areas (Research in a proposed research area)
• Allocation Type: Single-year Grants
• Review Section: Complex systems
• Research Institution: Kyushu Institute of Technology
• Principal Investigator: 我妻 広明 九州工業大学, 大学院生命体工学研究科, 准教授 (60392180)
• Project Period (FY): 2016-04-01 – 2018-03-31
• Project Status: Completed (Fiscal Year 2017)
• Budget Amount: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000); Fiscal Year 2017: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000); Fiscal Year 2016: ¥2,860,000 (Direct Cost: ¥2,200,000、Indirect Cost: ¥660,000)
• Keywords: 非線形振動子系 / 脳型ロボット / 身体性 / 動的関係性 / 時空間階層性

Outline of Annual Research Achievements

脳身体の発達過程における手遊びの寄与に注目し，脳-身体-環境における動的関係性を扱う情報の時空間階層性を，非線形振動子系の観点から分析し，視覚・聴覚・触覚・運動感覚等の欠損時に互いに補完し課 題達成する相補性を探求する方向性として認知運動発達支援やリハビリテーションへの応用に向かう数理基盤を構築することを目的とした．
本年度は，脳活動，視線，動作の同時測定系を構築，対面した手遊びとして，じゃんけん課題における同期形成のダイナミクス分析を行った．用いたじゃんけん課題は比較的最近に日本で普及している「最初はぐー」の掛け声で開始するもので，3回から４回を腕振りが得られる．ゲーム中の勝敗によって掛け声をかけるホストとその相手をスレーブとして解析した結果，動作の同期性に関しては，ホスト側が振幅と周期が比較的安定しているのに対して，スレーブ側が振幅を増大させながらタイミングを一致させることが観測された．これは，ゲーム中の勝敗によってホストとスレーブが交代した場合でも同様であった．同期構造の開始時の腕振りが下から始まるか(FU)上から始まるか(FD)で分類すると，同期形成はファーストアップ(FU)がほとんどであったが，試行回数が進んむ時系列解析では，ホストがFUだった場合スレーブもFUとなり，ホストがUSだった場合にはスレーブもUSになる傾向が確認された．ジャンケンの熟練度を比較すると上級者では振幅を増大させる最適化されたジャンケンにより同期性が確保されるのに対し，中級者では最後の振りは一致するものの全体的として同期性が低い．さらに初級者は互いに振りを合わせようと動作するものの，周期は一致しても位相が一致しないという傾向が現れた．同時計測された脳波解析では，ジャンケンの最初の振りから２，３回目の振りの最中に4Hz～10Hz付近の整合性がウェーブレットコヒーレンス解析によって示唆された．

Research Progress Status

29年度が最終年度であるため、記入しない。

Strategy for Future Research Activity

29年度が最終年度であるため、記入しない。

Research Products

• [Int'l Joint Research] Ludwig-Maximilians-Universitat Munchen(ドイツ)
• [Int'l Joint Research] University of West Bohemia(チェコ)
• [Int'l Joint Research] Bulgarian Academy of Sciences(ブルガリア)
• [Int'l Joint Research] Universidad del Pais Vasco UPV/EHU(スペイン)
• [Int'l Joint Research] IIT Kanpur(インド)
• [Int'l Joint Research]
• [Int'l Joint Research] インド工科大学カーンプル校（IIT, Kanpur）(インド)
• [Int'l Joint Research] マレーシアプトラ大学（UPM）(マレーシア)
• [Int'l Joint Research] ブルガリア科学アカデミーシステム工学・ロボット研究所（ISER-BAS）(ブルガリア)
• [Journal Article] Epilepsy EEG Classification Using Morphological Component Analysis (2018)
  • Author(s): Mahapatra, A. G., Singh, B., Horio, K., Wagatsuma, H.
  • Journal Title: EURASIP Journal on Advances in Signal Processing Volume: 2018
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] 運転中の脳負荷指標化の脳波計測による検討 (2017)
  • Author(s): 一木麻由，バルビール・シン，アイコウイツ，我妻広明
  • Journal Title: 電子情報通信学会技術研究報告(NC研究会) Volume: 116 Pages: 31-36
• [Journal Article] 脳波-モーションキャプチャ同時測定を用いた運動の巧緻性分析のためのマーカー消失問題への取り組み (2017)
  • Author(s): 萩尾元晴，十河正弥，下竹昭寛，松本理器，池田昭夫，我妻広明
  • Journal Title: 電子情報通信学会技術研究報告(NC研究会) Volume: 116 Pages: 25-30
• [Journal Article] An effective lifting scheme method for EEG decomposition in targeted frequency range (2017)
  • Author(s): Singh, B., Ichiki, M., Ai, G., Wagatsuma, H.
  • Journal Title: ICIC Express Letters Volume: 11(1) Pages: 65-70
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] A Removal of Eye Movement and Blink Artifacts from EEG Data Using Morphological Component Analysis (2017)
  • Author(s): Singh, B., Wagatsuma, H.
  • Journal Title: Computational and Mathematical Methods in Medicine Volume: 2017 Pages: 1861645-17
  • DOI: 10.1155/2017/1861645
  • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
• [Journal Article] Energy-efficacy comparisons and multibody dynamics analyses of legged robots with different closed-loop mechanisms (2016)
  • Author(s): Komoda, K., Wagatsuma, H.
  • Journal Title: Multibody System Dynamics Volume: 2016 Issue: 2 Pages: 1-31
  • DOI: 10.1007/s11044-016-9532-9
  • Peer Reviewed / Open Access / Acknowledgement Compliant
• [Presentation] MCA Based Epilepsy EEG Classification Using Time Frequency Domain Features (2018)
  • Author(s): Mahapatra, A. G., Singh, B., Horio, K., Wagatsuma, H.
  • Organizer: The 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2018)
  • Int'l Joint Research
• [Presentation] An Integrated Framework to Clarify Characteristics of EEG Activities in the Aim of Clinical Data Treatment on Epilepsy: A Workflow by Using NIX and odML Metadata Format (2017)
  • Author(s): Kamal, Md. S., Hagio, M., Wagatsuma, H.
  • Organizer: 17th China-Japan-Korea Joint Workshop on Neurobiology and Neuroinformatics (NBNI 2017)
  • Int'l Joint Research
• [Presentation] A Narrative Speech, Gaze and Gesturing Robot Accessing to Human Emotion and Memory Which is Investigated by Using a Simultaneous Recording of Electroencephalogram and Eye-Tracker System (2017)
  • Author(s): Muthusamy, A., Kaur, G., Gupta, R., Agarwal, V., Nakayama, S., Ichiki, M., Maniamma, J.M Bhattacharya, B., Wagatsuma, H.
  • Organizer: The 12th International Conference on Innovative Computing, Information and Control (ICICIC2017)
  • Int'l Joint Research
• [Presentation] Removal of Drift and Blink Artifacts in EEG based on Sparse Morphological Decomposition (2017)
  • Author(s): Singh, B., Ichiki, M., Wagatsuma, H.
  • Organizer: The 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2017)
  • Int'l Joint Research
• [Presentation] A High-Precision Skilled Movement Evaluation by using Curvature Analysis in the Simultaneous Recording of 3D Motion Capture System and Intracranial Video-EEG Monitoring and Stimulation (2017)
  • Author(s): Maniamma, J., Hagio, M., Togo, M., Shimotake, A., Matsumoto, R., Ikeda, A., Wagatsuma, H.
  • Organizer: The 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2017)
  • Int'l Joint Research
• [Presentation] MCA-Based Denosing for In-Vehicle EEG Measurements to Estimate the Driver's Mental Workload Influenced by Distractions (2017)
  • Author(s): Ichiki, M., Singh, B., Ai, G., Wagatsuma, H.
  • Organizer: The 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2017)
  • Int'l Joint Research
• [Presentation] odML- NIX Standardization Workflow for EEG and Motion recordings (2017)
  • Author(s): Wagatsuma, H., Togo, M., Ichiki, M., Hagio, M., Yoshida, H., Maniamma, J., Asai, Y.
  • Organizer: Brainhack Global (2017) Japan
  • Int'l Joint Research
• [Presentation] A BMI Approach to Use an Affinity Humanoid to Connect with Online EEG Analyses via ROS Functional Modules (2017)
  • Author(s): Nakayama, S., Ichiki, M., Muthusamy, A., Sampath, S., Yoshida, Y., Sinha, A., Shah, D., Soni, H., Panday, H., Srivantava, R., Sharma, A., Bhattacharya, B., Wagatsuma, H.
  • Organizer: 第27回日本神経回路学会全国大会
• [Presentation] A Simultaneous Recording of Electroencephalogram and 3D Motions of Body Parts During Games Interacting Hand Gestures and Team Sports Playing in the Court (2017)
  • Author(s): Hagio, M., Ichiki, M., Nakayama, S., Yoshida, Yuki, Tachibana, K., Wagatsuma, H.
  • Organizer: 第27回日本神経回路学会全国大会 / The 27st Annual Conference of the Japanese Neural Networks Society (JNNS 2017)
• [Presentation] 脳波-モーションキャプチャ同時測定を用いた運動の巧緻性分析のためのマーカー消失問題への取り組み (2017)
  • Author(s): 萩尾元晴（九工大）・十河正弥・下竹昭寛・松本理器・池田昭夫（京大）・我妻広明（九工大/理研/産総研）
  • Organizer: 電子情報通信学会 ニューロコンピューティング研究会 (NC)
  • Place of Presentation: 機械振興会館（東京都港区）
• [Presentation] 運転中の脳負荷指標化の脳波計測による検討 (2017)
  • Author(s): 一木麻由・シン バルビール・アイ コウイツ（九工大）・我妻広明（九工大/理研/産総研）
  • Organizer: 電子情報通信学会 ニューロコンピューティング研究会 (NC)
  • Place of Presentation: 機械振興会館（東京都港区）
• [Presentation] The Bereitschaftspotential Paradigm for Rise to Stand-Up (2016)
  • Author(s): Balbir Singh, Hiroaki Wagatsuma, Kiyohisa Natsume
  • Organizer: The 39th Annual Meeting of the Japan Neuroscience Society (Neuroscience 2016)
  • Place of Presentation: Pacifico Yokohama
  • Year and Date: 2016-07-20
  • Int'l Joint Research
• [Presentation] BCI Developmental Tools Available for Online EEG Data Acquisition and Time-Frequency Analyses by Using the Wavelet Lifting Scheme (2016)
  • Author(s): Balbir Singh, Mayu Ichiki, Guangyi Ai, Hiroaki Wagatsuma
  • Organizer: The 4th INCF Japan Node International Workshop Advances in Neuroinformatics (AINI) 2016
  • Place of Presentation: RIKEN Brain Science Institute
  • Year and Date: 2016-05-28
  • Int'l Joint Research
• [Presentation] A Simultaneous Recording of EEGs and the Eye-Tracking System based on Multitask Operation Design Compatible with Driving Distractions (2016)
  • Author(s): Mayu Ichiki, Guangy Ai, Jonathan Shi Khai Ooi, Siti Anom Ahmad, Hiroaki Wagatsuma
  • Organizer: The 4th INCF Japan Node International Workshop Advances in Neuroinformatics (AINI) 2016
  • Place of Presentation: RIKEN Brain Science Institute
  • Year and Date: 2016-05-28
  • Int'l Joint Research
• [Presentation] A Proposal of the Movable Fulcrum for Evaluating CFRP Bending Shaped to Fit the Human Body Kinetics and Maximize its Assistive Force in the Aim of the Orthosis Design for Backbone Problems (2016)
  • Author(s): Akira Matsuda, Yuki Yoshida, Hiroaki Wagatsuma
  • Organizer: The 4th INCF Japan Node International Workshop Advances in Neuroinformatics (AINI) 2016
  • Place of Presentation: RIKEN Brain Science Institute
  • Year and Date: 2016-05-28
  • Int'l Joint Research
• [Presentation] The Bereitschaftspotential for Rise of Stand-Up towards Robot-Assist Device Preparation (2016)
  • Author(s): Balbir Singh, Hiroaki Wagatsuma, Kiyohisa Natsume
  • Organizer: SICE Annual Conference 2016
  • Place of Presentation: Tsukuba International Congress Center, Tsukuba, JAPAN.
  • Int'l Joint Research
• [Presentation] A Hybrid Human Support Bionic Devices Consisted of Rigid Body Mechanics and Elastic Body Kinematics Analyzed by Multibody Dynamics (2016)
  • Author(s): Yuki Yoshida, Akira Matsuda, Hiroaki Wagatsuma
  • Organizer: SICE Annual Conference 2016
  • Place of Presentation: Tsukuba International Congress Center, Tsukuba, JAPAN.
  • Int'l Joint Research
• [Presentation] Establishment of the Standard Criterion of the Driver's Status by Using EEG Measurements that Evaluates an Comfort in Driving Even Under Conditions with Automated Driving Operations (2016)
  • Author(s): Mayu Ichiki, Balbir Singh，Guangyi Ai, Hiroaki Wagatsuma
  • Organizer: The 15th POSTECH-KYUTECH Joint Workshop on Neuroinformatics
  • Place of Presentation: Pohang University of Science and Technology, Korea
  • Int'l Joint Research
• [Presentation] AI-Based Possible Data Analyses Applying to the Simultaneous Recording of EEGs and Scenic Camera to Segregate Distinguishable Events Happens in the Target Environment (2016)
  • Author(s): Motoharu Hagio, Mayu Ichiki, Julieron Marine, Hiroaki Wagatsuma
  • Organizer: The 15th POSTECH-KYUTECH Joint Workshop on Neuroinformatics
  • Place of Presentation: Pohang University of Science and Technology, Korea
  • Int'l Joint Research
• [Presentation] Multibody Dynamic Applying to the Complex Combination of Various Factors with Rigid and Flexible Components: A Case Study (2016)
  • Author(s): Yuki Yoshida, Akira Matsuda, Hiroaki Wagatsuma
  • Organizer: The 15th POSTECH-KYUTECH Joint Workshop on Neuroinformatics
  • Place of Presentation: Pohang University of Science and Technology, Korea
  • Int'l Joint Research
• [Presentation] A Comparative Analysis of Indexing of Mental Workload by using Neuro-Driving Tools based on EEG Measurements Coupling with the Eye-Tracking System. (2016)
  • Author(s): Ichiki M, Ai G, Ooi JS and Wagatsuma H.
  • Organizer: Neuroinformatics 2016
  • Place of Presentation: University of Reading, UK
  • Int'l Joint Research
• [Book] 強いAI・弱いAI 研究者に聞く人工知能の実像（6章；pp.124-156） (2017)
  • Author(s): 鳥海 不二夫
  • Total Pages: 274
  • Publisher: 丸善出版
  • ISBN: 4621301799
• [Remarks] ダイナミックブレインプラットフォーム
  • URL: https://dynamicbrain.neuroinf.jp/
• [Remarks] ダイナミックブレイン プラットフォーム(DBPF)委員会
  • URL: https://dynamicbrain.neuroinf.jp/
• [Funded Workshop] NIX-odML Global Workshop & Hackathon 2017 in Japan (2017)