• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Audiovisual spatial attention controlled by self-initiated attention

Research Project

Project/Area Number 19H01111
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionTohoku University

Principal Investigator

Shioiri Satoshi  東北大学, 電気通信研究所, 教授 (70226091)

Co-Investigator(Kenkyū-buntansha) 小川 誠二  東北福祉大学, 感性福祉研究所, 教授 (00358813)
Tseng Chiahuei  東北大学, 電気通信研究所, 准教授 (00793811)
成 烈完  東北福祉大学, 感性福祉研究所, 准教授 (30358816)
羽鳥 康裕  東北大学, 電気通信研究所, 助教 (30750955)
坂本 修一  東北大学, 電気通信研究所, 教授 (60332524)
酒井 宏  筑波大学, システム情報系, 教授 (80281666)
栗木 一郎  埼玉大学, 理工学研究科, 教授 (80282838)
Project Period (FY) 2019-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥46,670,000 (Direct Cost: ¥35,900,000、Indirect Cost: ¥10,770,000)
Fiscal Year 2021: ¥9,100,000 (Direct Cost: ¥7,000,000、Indirect Cost: ¥2,100,000)
Fiscal Year 2020: ¥8,580,000 (Direct Cost: ¥6,600,000、Indirect Cost: ¥1,980,000)
Fiscal Year 2019: ¥28,990,000 (Direct Cost: ¥22,300,000、Indirect Cost: ¥6,690,000)
Keywords注意 / 自発 / 視覚 / 聴覚 / マルチモーダル / 脳波 / SSVEP / ASSR / 自発的注意 / 視聴覚注 / クロスモーダ / 定常的誘発脳波 / アルファ波 / ガンマ波 / スピンドル解析 / 視聴覚注意 / 視聴覚相互作用 / 臨界相モデル / クロスモーラル / 定常的誘発電位 / クロスモーダル / 視覚注意 / 聴覚注意 / 自発脳波 / 誘発脳波
Outline of Research at the Start

注意は膨大な感覚入力から必要な情報を選択する脳の優れた機能であり、脳の主体性の理解のために、注意研究は不可欠である。注意の対象や課題を自発的に選択する処理過程(自発的注意)は、ヒトの主体性にかかわる極めて重要な脳機能である。本研究では代表者らが開発した注意計測手法などを利用し困難を克服し、研究手法の開発、モデル化および実証を通して自発的注意過程の解明を目指す。様々な対象、課題の間で注意対象を自由に変更する実験を設定し、注意変更に先行する脳活動を分析することで自発的注意関連脳活動を調査する。臨界相理論を用いた自発的注意モデルを構築する。

Outline of Final Research Achievements

The visual attention is usually shifted by self-initiation in daily life, and we investigated the brain activities corresponding to self-initiated attention to understand the attention process working in daily life. Criticality states of neural activities is a possible index of preparing process of the self-initiated attention. Therefore, we searched critical states related to attentional shift self-initiated, analyzing electroencephalogram data. We conducted an experiment, in which subjects selected the location and time of attention shift freely, allowing also to choose not to shift. The critical state was analyzed separately for EEG results for different brain areas to compare brain activities under shift and no-shift cases. The results suggest that critical states of the global dynamics of brain activity is related to self-initiated attention. Related to this issue, we also worked on multimodal attention processes for attention shift between different modality in future.

Academic Significance and Societal Importance of the Research Achievements

注意の研究は非常に活発に行われているが、基本的には実験室で何らかの指示や刺激による誘導に伴う条件での検討である。本研究では、被験者が自由に注意対象の変更を許容された条件における注意過程の解明を扱った。そのために自発的注意を調査するための実験パラダイムを開発し、臨界状況の解析や自発脳波に関するスピンドル解析を行った。注意シフトに先行する時間帯で臨界状況の変化が見られ、その成果は今後の注意の自発性研究に大きな貢献が期待できる。自発的注意を理解しモデル化することができれば、学習時の注意状態の変化を予測することで効果的な学習方法を開発するなど多様な応用展開が期待できる。

Report

(5 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Annual Research Report
  • 2019 Comments on the Screening Results   Annual Research Report
  • Research Products

    (52 results)

All 2022 2021 2020 2019 Other

All Int'l Joint Research (15 results) Journal Article (11 results) (of which Int'l Joint Research: 4 results,  Peer Reviewed: 9 results,  Open Access: 8 results) Presentation (26 results) (of which Int'l Joint Research: 14 results,  Invited: 9 results)

  • [Int'l Joint Research] FNS for Scientific Research(フランス)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] National Taiwan University/China Medical University(その他の国・地域(台湾))

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] 昆明理工大学(中国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] University of Aberdeen(英国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Aberdeen University(英国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Kunming 理工大学(中国)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] National Taiwan University(その他の国・地域(台湾))

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] University of Haifa(イスラエル)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Rajamangala University 工科大学(タイ)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Aberdeen University(英国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Kunming 理工大学(中国)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] National Taiwan University(その他の国・地域(台湾))

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] University of Haifa(イスラエル)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research] Rajamangala University 工科大 学(タイ)

    • Related Report
      2019 Annual Research Report
  • [Int'l Joint Research]

    • Related Report
      2019 Annual Research Report
  • [Journal Article] Visual attention around a hand location localized by proprioceptive information2022

    • Author(s)
      Shioiri, S., Sasada, T., and Nishikawa, R.,
    • Journal Title

      Cereb Cortex Commun

      Volume: 3 (1) Issue: 1 Pages: 1-18

    • DOI

      10.1093/texcom/tgac005

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] ‘Collinear search impairment is luminance contrast invariant2021

    • Author(s)
      Tseng, C.H., Chow, H.M., Liang, J., Shioiri, S., and Chen, C.C.
    • Journal Title

      Scientific reports

      Volume: 11, (1) Issue: 1 Pages: 11507-11507

    • DOI

      10.1038/s41598-021-90909-w

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Contribution of the slow motion mechanism to global motion revealed by an MAE technique2021

    • Author(s)
      Shioiri, S., Matsumiya, K., and Tseng, C.H.
    • Journal Title

      Scientific reports

      Volume: 11, (1) Issue: 1 Pages: 3995-3995

    • DOI

      10.1038/s41598-021-82900-2

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] MA and togetherness (ittaikan) in the narratives of dancers and spectators: sharing an uncertain space2021

    • Author(s)
      Tseng, C.H., Cheng, M., Matout, H., Fujita, K., Kitamura, Y., Shioiri, S., Bachrach, A
    • Journal Title

      Japanese Psychological Research

      Volume: in press Issue: 4 Pages: 421-433

    • DOI

      10.1111/jpr.12330

    • NAID

      210000170390

    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Crispness, the key for the palatability of “kakinotane”: A sensory study with onomatopoeic words2021

    • Author(s)
      A Saita, K Yamamoto, A Raevskiy, R Takei, H Washio, S Shioiri, N Sakai
    • Journal Title

      Foods

      Volume: 10 (8) Issue: 8 Pages: 1724-1724

    • DOI

      10.3390/foods10081724

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Temporal characteristics of auditory spatial attention on word intelligibility2020

    • Author(s)
      Teraoka Ryo、Sakamoto Shuichi、Cui Zhenglie、Suzuki Yoiti、Shioiri Satoshi
    • Journal Title

      Acoustical Science and Technology

      Volume: 41 Issue: 1 Pages: 394-395

    • DOI

      10.1250/ast.41.394

    • NAID

      130007782687

    • ISSN
      0369-4232, 1346-3969, 1347-5177
    • Year and Date
      2020-01-01
    • Related Report
      2019 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Interpersonal communication on the Japanese concept ``Ma''2020

    • Author(s)
      C Tseng, YT Wang, S Shioiri
    • Journal Title

      Acoustical Science and Technology

      Volume: 41 Issue: 1 Pages: 2-5

    • DOI

      10.1250/ast.41.2

    • NAID

      130007782630

    • ISSN
      0369-4232, 1346-3969, 1347-5177
    • Year and Date
      2020-01-01
    • Related Report
      2019 Annual Research Report
  • [Journal Article] Effect of auditory spatial attention in rear side2020

    • Author(s)
      R Teraoka, S Sakamoto, Z Cui, Y Suzuki, S Shioiri
    • Journal Title

      The Journal of the Acoustical Society of America

      Volume: 148 Pages: 2619-2619

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Basic Color Categories in Mandarin Chinese Revealed by Cluster Analysis2020

    • Author(s)
      Tracy Hsieh, Ichiro Kuriki (corresponding author), I-Ping Chen, Yumiko Muto, Rumi Tokunaga, Satoshi Shioiri
    • Journal Title

      Journal of Vision

      Volume: 20 Issue: 12 Pages: 1-17

    • DOI

      10.1167/jov.20.12.6

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A motion-in-depth model based on inter-ocular velocity to estimate direction in depth2020

    • Author(s)
      Wu Wei、Hatori Yasuhiro、Tseng Chia-huei、Matsumiya Kazumichi、Kuriki Ichiro、Shioiri Satoshi
    • Journal Title

      Vision Research

      Volume: 172 Pages: 11-26

    • DOI

      10.1016/j.visres.2020.04.002

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] [papers] Viewers' Susceptibility to Image Blurs in Watching Ultra-high-definition TV Correlates with Their Dynamic Visual Acuity2019

    • Author(s)
      M Emoto, Y Fang, S Shioiri
    • Journal Title

      ITE Transactions on Media Technology and Applications

      Volume: 7 Issue: 2 Pages: 103-110

    • DOI

      10.3169/mta.7.103

    • NAID

      130007622448

    • ISSN
      2186-7364
    • Related Report
      2019 Annual Research Report
  • [Presentation] A study on preference of physical size of motion pictures by methods of experimental psychology , 539-5422021

    • Author(s)
      M Harasawa, Y Sawahata, Y Miyashita, K Komine, S Shioiri
    • Organizer
      Proceedings of the International Display Workshops 27
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Spatial spread of visual attention on a uniform random-dot field with and without border2021

    • Author(s)
      L Shi, SK Andersen, S Shioiri
    • Organizer
      PERCEPTION 50 (1_ SUPPL)
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] Investigation of self-initiated attention shift2021

    • Author(s)
      W Wu, K Kobayashi, S Ono, Y Sato, Y Hatori, CH Tseng, I Kuriki, S Shioiri
    • Organizer
      PERCEPTION 50 (1_ SUPPL), 90-90
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] Audiovisual interaction for spatial attention2021

    • Author(s)
      S Shioiri, S Ono, W Wu, S Sakamoto, R Teraoka, Y Sato, Y Hatori,
    • Organizer
      PERCEPTION 50 (1_ SUPPL), 41-41
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] The visual attention at the hand-movement goal independent of the top-down attention2021

    • Author(s)
      W Wu, Z Li, Y Sato, Y Hatori, C Tseng, I Kuriki, S Shioiri
    • Organizer
      Journal of Vision 21 (9), 2113-2113
    • Related Report
      2021 Annual Research Report
    • Invited
  • [Presentation] Spatial extent of audiovisual cross-modal attention2021

    • Author(s)
      S Shioiri, S Ono, W Wei, S Sakamoto, R Teraoka, Y Sato, Y Hatori,
    • Organizer
      Journal of Vision 21 (9), 2189-2189
    • Related Report
      2021 Annual Research Report
  • [Presentation] Quali-informatics in the society with yotta scale data2021

    • Author(s)
      S Shioiri, Y Sato, Y Horaguchi, H Muraoka, M Nihei
    • Organizer
      IEEE International Symposium on Circuits and Systems (ISCAS), 1-4
    • Related Report
      2021 Annual Research Report
  • [Presentation] Quali-Informatics and estimating human judgments2021

    • Author(s)
      S Shioiri, Y Sato
    • Organizer
      IEICE Technical Report; IEICE Tech. Rep. 120 (351), 31-35
    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
  • [Presentation] Analysis of visual subjective evaluation for qualities of food taste using machine learning techniques2021

    • Author(s)
      Y Sato, K Matsubara, Y Wada, N Sakai, S Shioiri
    • Organizer
      IEICE Technical Report; IEICE Tech. Rep. 120 (418), 58-62
    • Related Report
      2020 Annual Research Report
  • [Presentation] 脳波を用いた自発的注意計測2020

    • Author(s)
      小林司弥, 小野真, 羽鳥康裕, 曽加蕙, 栗木一郎, 塩入諭
    • Organizer
      電子情報通信学会技術研究報告; 信学技報 120 (306), 29-34
    • Related Report
      2020 Annual Research Report
  • [Presentation] Analysis of human subjective evaluation using deep neural networks2020

    • Author(s)
      Y Sato, K Matsubara, Y Wada, S Shioiri
    • Organizer
      IEICE Technical Report; IEICE Tech. Rep. 120 (306), 77-80
    • Related Report
      2020 Annual Research Report
  • [Presentation] 視覚認知における身体性2020

    • Author(s)
      塩入諭
    • Organizer
      感覚代行シンポジウム 46, 13-16
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Differences in Attention Modulations Measured by Steady-State Visual-Evoked Potentials and by Behaviors2019

    • Author(s)
      S Shioiri
    • Organizer
      I-PERCEPTION 10, 24-24
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Studying Attention without Relying on BehaviorY Yeshurun, S Shioiri2019

    • Author(s)
      Y Yeshurun, S Shioiri
    • Organizer
      I-PERCEPTION 10, 23-23
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] The Preferred Physical Size of Moving Images Varied With Viewing Distance But Not With Screen Size2019

    • Author(s)
      M Harasawa, Y Sawahata, Y Miyashita, K Komine, S Shioiri
    • Organizer
      PERCEPTION 48, 139-139
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effect of Attention on the Perceptual Grouping2019

    • Author(s)
      C Tseng, CC Chen, S Shioiri
    • Organizer
      PERCEPTION 48, 27-27
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Spatial Spread of Visual Attention Measured Using Steady-State Visually Evoked Fields2019

    • Author(s)
      S Shioiri, T Miura, K Matsumiya, I Kuriki, K Amano
    • Organizer
      PERCEPTION 48, 11-11
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Different Effects of Pre-and Postsaccadic Stimulus Contrast on Displacement Detection Across Saccades2019

    • Author(s)
      S Takano, K Matsumiya, C Tseng, I Kuriki, H Deubel, S Shioiri
    • Organizer
      PERCEPTION 48, 106-106
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cross-cultural Differences in Sensitivity Detection of Yawning Faces2019

    • Author(s)
      K Sato, H Matout, M Chan, Y Hatori, I Kuriki, S Shioiri, C Tseng
    • Organizer
      I-PERCEPTION 10, 125-1262019
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Trial Order Effect in Size Preference 2AFC Judgment Task About Natural Scene Moving Images2019

    • Author(s)
      M Harasawa, Y Sawahata, Y Miyashita, K Komine, S Shioiri
    • Organizer
      I-PERCEPTION 10, 174-175
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Attempt on the Measurement of Spatial Extent of Audiovisual Attention by EEG2019

    • Author(s)
      Shin Ono, Shuichi Sakamoto, Ryo Teraoka, Yoshiyuki Sato, Yasuhiro Hatori, Chiahuei Tseng, Ichiro Kuriki, Satoshi Shioiri
    • Organizer
      I-PERCEPTION 10, 139-140
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Influence of the HDR Environment on Shitsukan Perception2019

    • Author(s)
      G Watanabe, I Kuriki, Y Hatori, C Tseng, S Shioiri
    • Organizer
      I-PERCEPTION 10, 162-162
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Convolutional Neural Networks for humanlike Image Assessment2019

    • Author(s)
      Hassan Matout, Hao Wang, Yasuhiro Hatori, Yoshiyuki Sato, Kazuya Matsubara, Yuji Wada, Chia-huei Tseng, Ichiro Kuriki, Satoshi Shioiri
    • Organizer
      I-PERCEPTION
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Influence of Pre-and Post-Saccadic Contrast on Displacement Detection Across Saccades2019

    • Author(s)
      S Takano, K Matsumiya, C Tseng, I Kuriki, H Deubel, S Shioiri
    • Organizer
      I-PERCEPTION 10, 75-75
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] The Interaction of Grouping and Salience in Visual Search: The Electrophysiological Evidence for the Collinear Masking Effect2019

    • Author(s)
      L Jingling, C Tseng, S Ono, S Shioiri
    • Organizer
      I-PERCEPTION 10, 92-92
    • Related Report
      2019 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 空間表現を広げる視覚のしくみ2019

    • Author(s)
      塩入 諭
    • Organizer
      NHK 技研 R&D, 14-28
    • Related Report
      2019 Annual Research Report
    • Invited

URL: 

Published: 2019-04-18   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi