• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Brain Decoding for Super-resolution fMRI with unsupervised learning

Research Project

Project/Area Number 17K00312
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Intelligent informatics
Research InstitutionKochi University of Technology

Principal Investigator

Yoshida Shinichi  高知工科大学, 情報学群, 教授 (30334519)

Co-Investigator(Kenkyū-buntansha) 岡本 一志  電気通信大学, 大学院情報理工学研究科, 准教授 (10615032)
佐伯 幸郎  神戸大学, システム情報学研究科, 特命助教 (40549408)
Project Period (FY) 2017-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2019: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2018: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2017: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords深層ニューラルネットワーク / MRI / 脳情報デコーディング / 超解像アルゴリズム / 機械学習 / extreme Learning Machine / CNN / support vector machine / 超解像 / 深層学習 / 敵対的生成ネットワーク / GAN / SRGAN / SRCNN
Outline of Final Research Achievements

We developed a super-resolution method for 3-dimensional brain MRI data using convolutional neural network and generative adversarial model. We utilized 2-dimensional RFB-ESRGAN and nESRGAN for 3-dimensional brain data. The originality of our model is using 2-step 2-dimensional model for 3-dimensional data and the result shows that the proposed method achieved the better result compared with those of 3D SRCNN and 3D SRGAN in terms of PSNR, SSIM, and LPIPS. For brain decoding we conducted the two experiment. One is the prediction of visual stimuli of face expression using fMRI brain data with SVM and ELM. The other is the prediction of Big Five score using structural MRI brain data with 3D CNN. The result shows that the accuracy of prediction of face expression 80% and the accuracy of prediction of Big Five score is 70%.

Academic Significance and Societal Importance of the Research Achievements

3次元MRIデータに対して2次元深層ニューラルネットワークモデルを用いることで、計算コストの削減のみならず、超解像化の精度を向上できたことは学術的な意義があるものであり、3次元データがしばしば使われる医療分野への深層学習の適用をスムースに進めることが可能になる。同時に、深層でないニューラルネットワークELMの脳画像への適用や、脳構造画像へのCNNの適用でBig Fiveスコアを推定したことは学術的な意義があると考えている。

Report

(6 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (33 results)

All 2021 2020 2019 2018 2017 Other

All Int'l Joint Research (2 results) Journal Article (3 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 3 results,  Open Access: 3 results) Presentation (28 results) (of which Int'l Joint Research: 18 results,  Invited: 1 results)

  • [Int'l Joint Research] 吉林大学(中国)

    • Related Report
      2019 Research-status Report
  • [Int'l Joint Research] 吉林大学(中国)

    • Related Report
      2018 Research-status Report
  • [Journal Article] 3D MRI Reconstruction Based on 2D Generative Adversarial Network Super-Resolution2021

    • Author(s)
      Zhang Hongtao、Shinomiya Yuki、Yoshida Shinichi
    • Journal Title

      Sensors

      Volume: 21 Issue: 9 Pages: 2978-2978

    • DOI

      10.3390/s21092978

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Relating brain structure images to personality characteristics using 3D convolution neural network2021

    • Author(s)
      Cao Lixian、Liang Yanchun、Lv Wei、Park Kaechang、Miura Yasuhiro、Shinomiya Yuki、Yoshida Shinichi
    • Journal Title

      CAAI Transactions on Intelligence Technology

      Volume: 6 Issue: 3 Pages: 338-346

    • DOI

      10.1049/cit2.12021

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Facial Expression Decoding based on fMRI Brain Signal2019

    • Author(s)
      Cao Benchun、Liang Yanchun、Yoshida Shinichi、Guan Renchu
    • Journal Title

      International Journal of Computers Communications & Control

      Volume: 14 Issue: 4 Pages: 475-488

    • DOI

      10.15837/ijccc.2019.4.3433

    • Related Report
      2019 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Analysis of Trained Convolutional Neural Network Using Generative Adversarial Network2021

    • Author(s)
      Yasuyuki TSUTSUI, Yuki SHINOMIYA, Shinichi YOSHIDA
    • Organizer
      The 7th International Workshop on Advanced Computational Intelligence and Intelligent Informatics (IWACIII 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Few-Annotation Training by Data Augmentation in Agriculture2021

    • Author(s)
      Shumpei NODA, Yuki SHINOMIYA, Shinichi YOSHIDA
    • Organizer
      The 7th International Workshop on Advanced Computational Intelligence and Intelligent Informatics (IWACIII 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3D Brain MRI Reconstruction based on 2D Super-Resolution Technology2020

    • Author(s)
      Zhang Hongtao; Yuki Shinomiya; Shinichi Yoshida
    • Organizer
      2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] A 3D-CNN Classifier for Gender Discrimination from Diffusion Tensor Imaging of Human Brain2020

    • Author(s)
      Yuichiro Nitta; Yuki Shinomiya; Kaechang Park; Shinichi Yoshida
    • Organizer
      2020 Joint 11th International Conference on Soft Computing and Intelligent Systems and 21st International Symposium on Advanced Intelligent Systems (SCIS-ISIS)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Time-Series Feature Representation on Brain Decoding from Visual Stimuli2019

    • Author(s)
      Yuki SHINOMIYA, Rina NAKAYAMA, Shinichi YOSHIDA
    • Organizer
      The 6th International Workshop on Advanced Computational Intelligence and Intelligent Informatics
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Improved Single-Image Super-Resolution for Brain MRI image based on FSRCNN2019

    • Author(s)
      Hongtao ZHANG, Yuki SHINOMIYA, Shinichi YOSHIDA, Yanchun LIANG
    • Organizer
      International Workshop on Human-Engaged Computing
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 視覚刺激における畳み込みニューラルネットワークを用いた脳活動信号からの感情予測2019

    • Author(s)
      三浦康寛, 佐々木泰一, 四宮友貴, 吉田真一
    • Organizer
      2019 IEEE SMC Hiroshima Chapter 若手研究会
    • Related Report
      2019 Research-status Report
  • [Presentation] マルチアングル2D超解像技術に基づく3DMRI画像再構成の評価2019

    • Author(s)
      新田雄一郎, ZHANG Hongtao, 四宮友貴, 吉田真一
    • Organizer
      2019 IEEE SMC Hiroshima Chapter 若手研究会
    • Related Report
      2019 Research-status Report
  • [Presentation] Prediction of Human Chracteristics from Brain Structural MRI using CNN2019

    • Author(s)
      Shinichi YOSHIDA
    • Organizer
      The 7th International Symposium on Frontier Technology
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Super-Resolution using Convolutional Neural Network for Magnetic Resonance Imaging2018

    • Author(s)
      Churong Zhuo, Shinichi Yoshida
    • Organizer
      ISCIIA 2018 (The 8th International Symposium on Computational Intelligence and Industrial Applications)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Topological Data Analysis for Time Series of functional Magnetic Resonance Imaging2018

    • Author(s)
      Rina Nakayama, Shinichi Yoshida
    • Organizer
      ISCIIA 2018 (The 8th International Symposium on Computational Intelligence and Industrial Applications)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Brain Decoding: Application of Intelligent Informatics to Neuroscience2018

    • Author(s)
      Shinichi Yoshida
    • Organizer
      ISCIIA 2018 (The 8th International Symposium on Computational Intelligence and Industrial Applications)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Prediction of Brain Disposition by applying Convolutional Neural Network to Magnetic Resonance Imaging2018

    • Author(s)
      Takenobu SASATANI, Kaechang PARK, Shinichi YOSHIDA
    • Organizer
      ISCIIA 2018 (The 8th International Symposium on Computational Intelligence and Industrial Applications)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] Transfer Learning for Lung Cancer Computed Tomography Diagnosis2018

    • Author(s)
      Yunpeng Jiang, Yoshida Shinichi, Xiangjiu Che.
    • Organizer
      ISCIIA 2018 (The 8th International Symposium on Computational Intelligence and Industrial Applications)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] CNN を用いたMRI 構造画像からの個人属性の推定2018

    • Author(s)
      笹谷健文, 朴啓彰, 吉田真一
    • Organizer
      電気関係学会四国支部連合大会(電気学会,電子情報通信学会,情報処理学会,IEEE他)
    • Related Report
      2018 Research-status Report
  • [Presentation] Feature Map Approximation of Triangular Norms with Siamese Neural Network2018

    • Author(s)
      Kazushi Okamoto
    • Organizer
      ISCIIA 2018 (The 8th International Symposium on Computational Intelligence and Industrial Applications)
    • Related Report
      2018 Research-status Report
  • [Presentation] Autoencoder型協調フィルタリングにおけるモデルパラメータの評価2018

    • Author(s)
      藤井流華, 岡本一志
    • Organizer
      日本知能情報ファジィ学会 ソフトロボティクス研究部会 第16回ポトラック&ワークショップ
    • Related Report
      2018 Research-status Report
  • [Presentation] モデルベース協調フィルタリングにおける推薦の透明性に関する検討2018

    • Author(s)
      藤井流華, 岡本一志
    • Organizer
      第13回Webインテリジェンスとインタラクション研究会
    • Related Report
      2018 Research-status Report
  • [Presentation] fMRIを用いた脳情報デコーディングにおける時系列特徴の検討2018

    • Author(s)
      中山梨奈,吉田真一
    • Organizer
      日本知能情報ファジィ学会 ソフトロボティクス研究部会 第16回ポトラック&ワークショップ
    • Related Report
      2018 Research-status Report
  • [Presentation] 機械学習による脳構造からの個人属性の推定2018

    • Author(s)
      笹谷健文, 吉田真一
    • Organizer
      日本知能情報ファジィ学会 ソフトロボティクス研究部会 第16回ポトラック&ワークショップ
    • Related Report
      2018 Research-status Report
  • [Presentation] A study of estimation of human emotion induced by OASIS using fMRI2017

    • Author(s)
      Yasuhiro Yamanaka, Shinichi Yoshida
    • Organizer
      International Workshop on Human-Engaged Computing 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Measurement of emotion induced from character image using fMRI2017

    • Author(s)
      Rena Matsuzaki, Shinichi Yoshida
    • Organizer
      International Workshop on Human-Engaged Computing 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] fMRIによる感情のブレインデコーディングにおけるOASIS画像セットの評価2017

    • Author(s)
      山中 康寛
    • Organizer
      日本知能情報ファジィ学会 第15回ソフトロボティックス研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] 漢字から誘発される感情のfMRI によるブレインデコーディング2017

    • Author(s)
      松﨑 麗奈
    • Organizer
      日本知能情報ファジィ学会 第15回ソフトロボティックス研究会
    • Related Report
      2017 Research-status Report
  • [Presentation] Decoding of human emotion induced by brain decoding using MVPA2017

    • Author(s)
      Taichi Sasaki, Shinichi Yoshida
    • Organizer
      International Workshop on Human-Engaged Computing 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Topological Data Analysis using functional Magnetic Resonance Imaging2017

    • Author(s)
      Rina Nakayama, Shinichi Yoshida
    • Organizer
      International Workshop on Human-Engaged Computing 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Decoding of human facial expression induced by extreme learning machine using fMRI2017

    • Author(s)
      Li Xiang, Shinichi Yoshida
    • Organizer
      International Workshop on Human-Engaged Computing 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Toward the Single Image Super-Resolution for MRI using Convolutional Neural Network2017

    • Author(s)
      Zhuo Churong, Shinichi Yoshida
    • Organizer
      International Workshop on Human-Engaged Computing 2017
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi