• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Integrative study on gaze shift and visual object recognition dynamics in natural scenes

Research Project

Project/Area Number 17H01755
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Research Field Cognitive science
Research InstitutionThe University of Electro-Communications

Principal Investigator

Miyawaki Yoichi  電気通信大学, 大学院情報理工学研究科, 教授 (80373372)

Co-Investigator(Kenkyū-buntansha) 柳澤 琢史  大阪大学, 高等共創研究院, 教授 (90533802)
Project Period (FY) 2017-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥17,030,000 (Direct Cost: ¥13,100,000、Indirect Cost: ¥3,930,000)
Fiscal Year 2019: ¥5,980,000 (Direct Cost: ¥4,600,000、Indirect Cost: ¥1,380,000)
Fiscal Year 2018: ¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2017: ¥390,000 (Direct Cost: ¥300,000、Indirect Cost: ¥90,000)
Keywords眼球運動 / 自然画像 / 脳 / 物体認識 / 時間
Outline of Final Research Achievements

In this study, we aimed to understand what humans preferentially look at and recognize in natural scenes consisting of various objects from a temporal perspective, and obtained the following results. (1) We found spatio-temporal prioritization of gaze toward higher-order image features by combining analysis of eye movements during observation of natural scene images and quantification of image features using a deep convolutional neural network. (2) We found that this prioritization is caused solely by image features, regardless of the meaning or context of presented images. (3) We developed a new source estimation method for measuring and analyzing magnetoencephalography signals with high spatiotemporal resolution. (4) We estimated the representation time for object image information in brain activity patterns and compared it with the latency for eye movement.

Academic Significance and Societal Importance of the Research Achievements

ヒトの視線の解析は、ヒトがどのような対象を優先的に処理し、認識するかという基礎的知見を与えるものであり、またその知見は、ヒトへの効率的な情報提示のあり方を考える上で有用であるとともに、注意喚起のための標識や広告、デザインなどへの応用において価値をもつ。特に本研究では、シーンの意味や文脈から独立した純粋な高次特徴量への誘目性があることを見出しているため、画像操作による視線誘引への応用可能性を提示することにも成功しており、その意義は高いと考えられる。また新しい脳活動信号源解析手法は、本研究の枠組みを超えて、ヒト脳磁場信号解析全般への波及効果が大である。

Report

(4 results)
  • 2020 Final Research Report ( PDF )
  • 2019 Annual Research Report
  • 2018 Annual Research Report
  • 2017 Annual Research Report
  • Research Products

    (30 results)

All 2021 2020 2019 2018 2017 Other

All Int'l Joint Research (5 results) Journal Article (1 results) (of which Peer Reviewed: 1 results,  Open Access: 1 results) Presentation (23 results) (of which Int'l Joint Research: 6 results,  Invited: 8 results) Remarks (1 results)

  • [Int'l Joint Research] NIMH/NIH(米国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Maastricht University(オランダ)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Max Planck Institute(ドイツ)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] NIMH. NIH(米国)

    • Related Report
      2018 Annual Research Report
  • [Int'l Joint Research] NIMH, NIH(米国)

    • Related Report
      2017 Annual Research Report
  • [Journal Article] Information spreading by a combination of MEG source estimation and multivariate pattern classification2018

    • Author(s)
      Masashi Sato, Okito Yamashita, Masa-aki Sato, Yoichi Miyawaki
    • Journal Title

      PLoS ONE

      Volume: 13 Issue: 6 Pages: e0198806-e0198806

    • DOI

      10.1371/journal.pone.0198806

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] 構造化スパースモデルを用いた脳磁場信号源推定における信号源ノイズの影響の評価2021

    • Author(s)
      宮﨑海, 韮澤駿, 赤松和昌, 宮脇陽一
    • Organizer
      ニューロコンピューティング研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 深層ニューラルネットワークモデル・脳磁場計測・超高磁場MRI計測の融合による認識行動ダイナミクスの高時空間分解能解析の試み2021

    • Author(s)
      宮脇陽一
    • Organizer
      生理研研究会「人工知能技術と科学の協調と展開」
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] Time-resolved fast neural decoding independent of variation in hemodynamic response latency2020

    • Author(s)
      Yoichi Miyawaki, Daniel Handwerker, Javier Gonzalez-Castillo, Laurentius Huber, Arman Khojandi, Yuhui Chai, Peter Bandettini
    • Organizer
      Organization for Human Brain Mapping (OHBM) 2020
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Reduction of Information Spreading in MEG Source Estimation Using a Structured Model2020

    • Author(s)
      Naoki Ishibashi, Kazuaki Akamatsu, Shun Nirasawa, Yoichi Miyawaki
    • Organizer
      Organization for Human Brain Mapping (OHBM) 2020
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 超高磁場fMRI信号の超高速計測による血流動態反応の遅延から独立した神経情報表現のデコーディング2020

    • Author(s)
      Yoichi Miyawaki, Daniel A Handwerker, Javier Gonzalez-Castillo, Laurentius Huber, Arman Khojandi, Yuhui Chai, and Peter A Bandettini
    • Organizer
      第43回日本神経科学大会
    • Related Report
      2019 Annual Research Report
  • [Presentation] Event-related decoding of visual stimulus information using short-TR BOLD fMRI at 7T2020

    • Author(s)
      Yoichi Miyawaki, Daniel Handwerker, Javier Gonzalez-Castillo, Laurentius Huber, Arman Khojandi, Yuhui Chai, and Peter A Bandettini
    • Organizer
      2020 ISMRM & SMRT VIRTUAL CONFERENCE & EXHIBITION
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 超高磁場fMRI信号の超高速計測による血行動態と神経情報表現の時間的分離2020

    • Author(s)
      宮脇陽一
    • Organizer
      第4回ヒト脳イメージング研究会
    • Related Report
      2019 Annual Research Report
    • Invited
  • [Presentation] 脳磁場信号源推定における情報拡散現象2019

    • Author(s)
      宮脇陽一,佐藤匡
    • Organizer
      最新のEEG/MEG研究と電流源推定法の現在地
    • Related Report
      2019 Annual Research Report
  • [Presentation] 脳磁場信号源推定への構造化スパースモデリングの適用および評価2019

    • Author(s)
      石橋直樹,赤松和昌,韮澤駿,宮脇陽一
    • Organizer
      最新のEEG/MEG研究と電流源推定法の現在地
    • Related Report
      2019 Annual Research Report
  • [Presentation] 脳磁場解析における構造化スパースモデリングの適用および評価2019

    • Author(s)
      石橋直樹,赤松和昌,宮脇陽一
    • Organizer
      第22回情報論的学習理論ワークショップ(IBIS 2019)
    • Related Report
      2019 Annual Research Report
  • [Presentation] 構造化スパースモデリングを用いた脳磁場信号源推定の評価2019

    • Author(s)
      石橋直樹,赤松和昌,宮脇陽一
    • Organizer
      第3回ヒト脳イメージング研究会
    • Related Report
      2019 Annual Research Report
  • [Presentation] 深層畳み込みニューラルネットワークを用いて生成した高次画像特徴への視線の誘引2019

    • Author(s)
      渡邉莉菜、西野智博、赤松和昌、宮脇陽一
    • Organizer
      日本視覚学会2019年冬季大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 実物体の触力覚形状認識時における脳内情報表現部位の遷移2019

    • Author(s)
      衞藤祥太、中谷裕教、宮脇陽一
    • Organizer
      電子情報通信学会ニューロコンピューティング研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Gaze attraction toward higher-order image features generated by deep convolutional neural network2019

    • Author(s)
      Rina Watanabe, Tomohiro Nishino, Kazuaki Akamatsu, Yoichi Miyawaki
    • Organizer
      Vision Sciences Society 2019
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ヒト脳活動の非侵襲的計測と神経情報表現の解析2018

    • Author(s)
      宮脇陽一
    • Organizer
      静岡大学川人研究室セミナー
    • Related Report
      2018 Annual Research Report
    • Invited
  • [Presentation] Temporal priority of gaze during natural scene viewing2018

    • Author(s)
      Kazuaki Akamatsu, Yoichi Miyawaki
    • Organizer
      Vision Sciences Society 2018
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 非侵襲的脳活動計測を用いた神経情報表現の研究2018

    • Author(s)
      宮脇陽一
    • Organizer
      日本学術振興会先端ナノデバイス・材料テクノロジー第151委員会平成30年度第1回研究会「生体情報計測:ウェアラブル・脳計測技術の 最近の展開」
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 機械学習を用いた脳機能画像解析と細胞形態解析への応用2018

    • Author(s)
      宮脇陽一
    • Organizer
      Neurovascular Unit研究会2018
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] L0ノルム最適化に基づくスパース判別アルゴリズムを用いた特徴量選択精度の評価2018

    • Author(s)
      石橋直樹,伊藤紀基,佐藤匡,樺島祥介,宮脇陽一
    • Organizer
      ニューロコンピューティング研究会
    • Related Report
      2017 Annual Research Report
  • [Presentation] 自然画像観察時における注視の時間的優先性2018

    • Author(s)
      赤松和昌,宮脇陽一
    • Organizer
      日本視覚学会2018年冬季大会
    • Related Report
      2017 Annual Research Report
  • [Presentation] Toward high spatio-temporal resolution analysis of neural information representation using multivariate patterns of human brain activity2017

    • Author(s)
      Yoichi MIyawaki
    • Organizer
      National Institute of Mental Health, National Institutes of Health
    • Related Report
      2017 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 機械学習を用いた脳活動解析とヒトの感覚知覚メカニズムの解明2017

    • Author(s)
      宮脇陽一
    • Organizer
      電気通信大学技術士会総会
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Presentation] 神経情報の復号化を用いたヒト脳内における視知覚表象の解明2017

    • Author(s)
      宮脇陽一
    • Organizer
      第5回MEET Young Cardiologists
    • Related Report
      2017 Annual Research Report
    • Invited
  • [Remarks] MIYAWAKI LAB.

    • URL

      http://www.cns.mi.uec.ac.jp/

    • Related Report
      2019 Annual Research Report 2018 Annual Research Report 2017 Annual Research Report

URL: 

Published: 2017-04-28   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi