• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Effects of the spatiotemporal structure of a scene on perception

Research Project

Project/Area Number 19K20640
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 90030:Cognitive science-related
Research InstitutionNational Institute of Occupational Safety and Health,Japan (2023)
Tohoku University (2019-2022)

Principal Investigator

Hatori Yasuhiro  独立行政法人労働者健康安全機構労働安全衛生総合研究所, 新技術安全研究グループ, 任期付研究員 (30750955)

Project Period (FY) 2019-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2021: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Fiscal Year 2020: ¥1,690,000 (Direct Cost: ¥1,300,000、Indirect Cost: ¥390,000)
Fiscal Year 2019: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords学習 / 知覚 / 行動 / 予測 / 多感覚情報処理 / 注意 / fMRI / 機械学習 / 脳・神経 / 認知科学
Outline of Research at the Start

光景に含まれる視聴覚情報は高次の時空間的な統計的性質を有している。脳は視聴覚情報に含まれる統計的性質を学習し、情報処理に活用していると考えられる。時空間的な統計的性質を動画像から抽出する過程をモデル化する。脳活動計測を活用することで、モデルにより得られた統計的性質が脳内で表現されているかどうかを検討する。時空間的な統計的性質を学習できれば、将来起こりやすい視聴覚情報を予測することが可能となる。本研究では、予測と実際の感覚情報の差が知覚に与える影響も検討する。

Outline of Final Research Achievements

The external world has statistical properties in terms of time and space. By using these statistical properties, efficient information processing becomes possible. This study focused on (1) the modeling of the learning process of spatial arrangements (contextual cueing effect) and (2) the examination of the coordinate system used in the spatio-temporal integration (serial dependence). We proposed a model that extracts global features from images and learns the relationship with the position of the target to be searched for. The model was successful to reproducing the learning speed difference between letter arrangement and natural image. The psychophysical experiment demonstrated that serial dependence is carried out based on retinal position.

Academic Significance and Societal Importance of the Research Achievements

空間配置の学習モデルは文字配置を扱うものは提案されていたが、自然光景に対する学習を扱うことのできるモデルはこれまで提案されていなかった。自然光景に対する学習過程をモデル化することは、光景の情報処理と効率的な行動の関係を理解することにつながる。また、どのような情報を学習し、行動に利用しているのかを明らかにすることは、製品デザイン等の設計指針に関する基礎的な知見を提供する。

Report

(6 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • 2019 Research-status Report
  • Research Products

    (21 results)

All 2023 2022 2021 2020 2019

All Journal Article (2 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 2 results,  Open Access: 1 results) Presentation (18 results) (of which Int'l Joint Research: 9 results) Book (1 results)

  • [Journal Article] Control of bottom-up attention in scene cognition contributes to visual working memory performance.2023

    • Author(s)
      Azumi Tanabe-Ishibashi, Ryo Ishibashi and Yasuhiro Hatori
    • Journal Title

      Attention, Perception, & Psychophysics

      Volume: 85 Issue: 5 Pages: 1425-1436

    • DOI

      10.3758/s13414-023-02740-2

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A motion-in-depth model based on inter-ocular velocity to estimate direction in depth2020

    • Author(s)
      Wu Wei、Hatori Yasuhiro、Tseng Chia-huei、Matsumiya Kazumichi、Kuriki Ichiro、Shioiri Satoshi
    • Journal Title

      Vision Research

      Volume: 172 Pages: 11-26

    • DOI

      10.1016/j.visres.2020.04.002

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] Independent effects of top-down and bottom-up attention in a dual-task test of working memory with scenes2023

    • Author(s)
      A. Tanabe-Ishibashi, R. Ishibashi, Y. Hatori
    • Organizer
      23rd Conference of the European Society for Cognitive Psychology
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 自然動画観察時の頭部と眼球の運動方向の分析2023

    • Author(s)
      羽鳥康裕, 方 昱, 江本正喜, 塩入 諭
    • Organizer
      日本視覚学会2023年冬季大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] 自然動画観察時の頭部と眼球の運動方向の分析2023

    • Author(s)
      羽鳥康裕, 方 昱, 江本正喜, 塩入 諭
    • Organizer
      日本視覚学会 2023年冬季大会
    • Related Report
      2022 Research-status Report
  • [Presentation] 文脈手がかり効果は画像の大域的な特徴に基づく学習により生じる2022

    • Author(s)
      羽鳥康裕,Zheng-xiong Yuan, 塩入 諭
    • Organizer
      日本視覚学会 2022年夏季大会
    • Related Report
      2022 Research-status Report
  • [Presentation] Estimate students' concentration level by using facial expression2022

    • Author(s)
      Guan-yun Wang, Hikaru Nagata, Yasuhiro Hatori, Yoshiyuki Sato, Chia-huei Tseng, Satoshi Shioiri
    • Organizer
      ヒューマン情報処理研究会
    • Related Report
      2022 Research-status Report
  • [Presentation] Prediction of Engagement from Temporal Changes in Facial Expression2022

    • Author(s)
      Haruka Kato, Koki Takahashi, Yasuhiro Hatori, Yoshiyuki Sato, Satoshi Shioiri
    • Organizer
      World Conference on Computers in Education 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Analysis of Facial Expressions for the Estimation of Concentration on Online Lectures2022

    • Author(s)
      Renjun Miao, Haruka Kato, Yasuhiro Hatori, Yoshiyuki Sato, Satoshi Shioiri
    • Organizer
      World Conference on Computers in Education 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Detection of Synchronized Head Movements from a Single Classroom-Scene Video2022

    • Author(s)
      Yasuhiro Hatori, Taira Nakajima, Shinichi Watabe
    • Organizer
      World Conference on Computers in Education 2022
    • Related Report
      2022 Research-status Report
    • Int'l Joint Research
  • [Presentation] Gaze directed towards salient objects in scenes induces intrusion errors in visual working memory2021

    • Author(s)
      Azumi Tanabe-Ishibashi, Ryo Ishibashi, Yasuhiro Hatori
    • Organizer
      43rd European Conference on Visual Perception
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Audiovisual interaction for spatial attention2021

    • Author(s)
      Satoshi Shioiri, Shin Ono, Wei Wu, Shuichi Sakamoto, Ryo Teraoka, Yoshiyuki Sato, Yasuhiro Hatori, Chia Huei Tseng, Ichiro Kuriki
    • Organizer
      43rd European Conference on Visual Perception
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Investigation of self-initiated attention shift2021

    • Author(s)
      Wei Wu, Kazuya Kobayashi, Shin Ono, Yoshiyuki Sato, Yasuhiro Hatori, Chia-huei Tseng, Ichiro Kuriki, Satoshi Shioiri
    • Organizer
      43rd European Conference on Visual Perception
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] 仮想空間内のアバターの周囲に向けられる注意の計測2021

    • Author(s)
      羽鳥康裕、ハ テウク、塩入 諭
    • Organizer
      日本視覚学会2021年夏季大会
    • Related Report
      2021 Research-status Report
  • [Presentation] 脳波を用いた自発的注意変化測定の検討2021

    • Author(s)
      小林司弥,小野真,羽鳥康裕,曽加蕙,栗木一郎,塩入諭
    • Organizer
      日本視覚学会2021年冬季大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 脳波を用いた自発的注意計測2020

    • Author(s)
      小林司弥,小野真,羽鳥康裕,曽加蕙,栗木一郎,塩入諭
    • Organizer
      ヒューマン情報処理研究会
    • Related Report
      2020 Research-status Report
  • [Presentation] 脳波を用いた視聴覚注意の空間分布測定2019

    • Author(s)
      小野 真, 坂本修一, 寺岡 諒, 佐藤好幸, 羽鳥康裕, 曽 加蕙, 栗木一郎, 塩入諭
    • Organizer
      ヒューマン情報処理研究会
    • Related Report
      2019 Research-status Report
  • [Presentation] Salient items intrude in visual working memory2019

    • Author(s)
      A. Tanabe-Ishibashi, R. Ishibashi, Y. Hatori
    • Organizer
      21th Conference of the European Society for Cognitive Psychology
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Attempt on the measurement of spatial extent of audiovisual attention by EEG2019

    • Author(s)
      S. Ono, S. Sakamoto, R. Teraoka, Y. Sato, Y. Hatori, C. H. Tseng, I. Kuriki, S. Shioiri
    • Organizer
      15th Asia-Pacific Conference on Vision
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 先行刺激に依存する知覚バイアスに対する空間要因の影響2019

    • Author(s)
      羽鳥康裕, 坂井拓美, David Whitney, 塩入 諭
    • Organizer
      行動の多様性を支える神経基盤とその動作様式の解明
    • Related Report
      2019 Research-status Report
  • [Book] 図説 視覚の事典2022

    • Author(s)
      日本視覚学会
    • Total Pages
      360
    • Publisher
      朝倉書店
    • ISBN
      9784254102949
    • Related Report
      2022 Research-status Report

URL: 

Published: 2019-04-18   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi