• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of innovative QoE analysis / evaluation system for HD video using brain function and physiological measurement.

Research Project

Project/Area Number 17K00154
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Multimedia database
Research InstitutionUniversity of Toyama

Principal Investigator

Horita Yuukou  富山大学, 学術研究部都市デザイン学系, 教授 (80209303)

Project Period (FY) 2017-04-01 – 2021-03-31
Project Status Completed (Fiscal Year 2020)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2019: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2018: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2017: ¥3,120,000 (Direct Cost: ¥2,400,000、Indirect Cost: ¥720,000)
Keywords画質評価 / 生体情報 / NIRS / QoE / 脈波 / 人の嗜好 / HRV / CNN / 心拍変動
Outline of Final Research Achievements

To develop the QoE analysis / evaluation system for HD video using brain function and physiological measurement, it is very important to find out the biometric features related to human preference. So, we extracted the information on pulse wave from the Hb changes signal of NIRS. By using the FFT to the Hb signals, we found out the 2-nd peak of power spectrum that is implying the frequency information of the pulse wave. The frequency deviation of 2-nd peak may have some information about the change of brain activity, it is associated with the human preference for viewing the significant image content.
Then, in order to estimate human preference, we created a subject's heart rate variability spectrogram (HRVS) for still images using a trained convolutional neural network (CNN) and Support vector machine (SVM). Using these models, we showed the images to the subjects and extracted the measured HRVS features, and confirmed whether the subjects' preferences could be discriminated using SVM.

Academic Significance and Societal Importance of the Research Achievements

人の五感に関連する技術分野は感性工学を筆頭として、開発システムの限界を感じることが多かった。しかし、脳機能・生体計測情報を利用することで、ユーザ1人ひとりに最適化された製品やサービスを提供することが可能となる。ユーザの価値観や嗜好が無意識に推定できる脳血流量、心拍変動や脈波などの脳機能・生体計測情報は有効な手段となり、人とコンピュータとを密接に関連づけるBCI 技術への革新的な発展が期待される。

Report

(5 results)
  • 2020 Annual Research Report   Final Research Report ( PDF )
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (18 results)

All 2020 2019 2018

All Journal Article (3 results) (of which Peer Reviewed: 3 results) Presentation (15 results) (of which Int'l Joint Research: 8 results)

  • [Journal Article] Consideration of Relationship between Human Preference and Pulse Wave Derived from Brain Activity2019

    • Author(s)
      Mami KITABATA, Yota NIIGAKI, Yuukou HORITA
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: E102.A Issue: 9 Pages: 1250-1253

    • DOI

      10.1587/transfun.E102.A.1250

    • NAID

      130007699505

    • ISSN
      0916-8508, 1745-1337
    • Year and Date
      2019-09-01
    • Related Report
      2019 Research-status Report
    • Peer Reviewed
  • [Journal Article] Preference Identification for Images using the Change of The Amount of Blood in Frontal Lobe with NIRS2018

    • Author(s)
      Yang Du, Daiki Sawada, Yuukou Horita
    • Journal Title

      IEEJ Transactions on Electronics, Information and Systems

      Volume: 138 Issue: 5 Pages: 572-577

    • DOI

      10.1541/ieejeiss.138.572

    • NAID

      130006730620

    • ISSN
      0385-4221, 1348-8155
    • Year and Date
      2018-05-01
    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Journal Article] A Study of Image Quality Assessment Using the Biological Information with NIRS2018

    • Author(s)
      Yang Du, Daiki Sawada, Yuukou Horita
    • Journal Title

      IEEJ Transactions on Electronics, Information and Systems

      Volume: 138 Issue: 4 Pages: 341-346

    • DOI

      10.1541/ieejeiss.138.341

    • NAID

      130006602471

    • ISSN
      0385-4221, 1348-8155
    • Related Report
      2018 Research-status Report
    • Peer Reviewed
  • [Presentation] CNNよる変動スペクトログラムと嗜好との関係性の調査2020

    • Author(s)
      岸田嵩平・落合楊平・武用洸起・岡崎佑哉・堀田裕弘
    • Organizer
      電子情報通信学会イメージメディアクオリティ研究会, vol. 120, no. 303, IMQ2020-8, pp. 5-8
    • Related Report
      2020 Annual Research Report
  • [Presentation] ディープラーニングを用いた画像観察時の脳血流動態と嗜好との関連性についての調査2020

    • Author(s)
      落合楊平・岸田嵩平・武用洸起・岡崎佑哉・堀田裕弘
    • Organizer
      電子情報通信学会イメージメディアクオリティ研究会, vol. 120, no. 303, IMQ2020-9, pp. 9-12
    • Related Report
      2020 Annual Research Report
  • [Presentation] HDTV 画像における脳機能・生理的計測と嗜好との関係の検討2020

    • Author(s)
      武用洸起, 馬渡裕弥, 岸田嵩平, 落合楊平, 堀田裕弘
    • Organizer
      電子情報通信学会イメージメディアクオリティ研究会
    • Related Report
      2019 Research-status Report
  • [Presentation] RELATIONSHIP BETWEEN CEREBRAL BLOOD FLOW AND HUMAN PREFERENCE DURING IMAGE VIEWING USING WAVELET TRANSFORM2020

    • Author(s)
      Yohei Ochiai, Yuya Umawatari, Shuhei Kishida, Yuukou Horita
    • Organizer
      The 10th International Workshop on Image Media Quality and Its Applications (IMQA2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] CONSIDERATION OF RELATIONSHIP BETWEEN HUMAN PREFERENCE AND HEART RATE VARIABILITY OBTAINED FROM WEARABLE BIOSENSOR2020

    • Author(s)
      Shuhei Kishida,Yuya Umawatari, Yohei Ochiai, Yuukou Horita
    • Organizer
      The 10th International Workshop on Image Media Quality and Its Applications (IMQA2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] A STUDY OF RELATIONSHIP BETWEEN SKIN TEMPERATURE AND HUMAN PREFERENCE USING THERMAL IMAGING CAMERA2020

    • Author(s)
      Yuya Umawatari, Yohei Ochiai, Shuhei Kishida, Yuukou Horita
    • Organizer
      The 10th International Workshop on Image Media Quality and Its Applications (IMQA2020)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 状態遷移図を用いたApparent SpO2と嗜好との関係の解析2019

    • Author(s)
      安藤優汰, 新垣陽太, 堀田裕弘
    • Organizer
      信学技報 IMQ2018-63, IE2018-147, MVE2018-94, pp.221-225
    • Related Report
      2018 Research-status Report
  • [Presentation] ウェーブレット変換とニューラルネットワークを用いた画像観察時の脳血流動態と嗜好との関連性2019

    • Author(s)
      落合楊平, 新垣陽太, 堀田裕弘
    • Organizer
      信学技報 IMQ2018-64, IE2018-148, MVE2018-95, pp.227-232
    • Related Report
      2018 Research-status Report
  • [Presentation] RELATIONSHIP BETWEEN PREFERENCE AND CEREBRAL HEMODYNAMICS BY OBSERVATION OF COMFORTABLE IMAGE AND UNCOMFORTABLE IMAGE2018

    • Author(s)
      Yota Niigaki, Yuukou Horita
    • Organizer
      Proc. of The Ninth International Workshop on Image Media Quality and its Applications (IMQA 2018) OS1-3
    • Related Report
      2018 Research-status Report
  • [Presentation] NIRSを用いた画像内容と脳血流との関連性に関する現状と課題2018

    • Author(s)
      新垣陽太, 堀田裕弘
    • Organizer
      信学技報 IMQ2018-6, HIP2018-33, pp.5-10
    • Related Report
      2018 Research-status Report
  • [Presentation] Analysis of the Relationship between Cerebral Blood Flow and Preference while Viewing Different Image Contents Associated with Emotions2018

    • Author(s)
      Fumiya Kamizeki, Yang Du, Daiki Sawada, Yuukou Horita
    • Organizer
      International Workshop on Advanced Image Technology 2018 (IWAIT2018), Chiang Mai, Thailand
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Examination of the Individual Differences under the Same Image Viewing Environment by using NIRS2018

    • Author(s)
      Koji Yoshiie, Yang Du, Daiki Sawada, Yuukou Horita
    • Organizer
      International Workshop on Advanced Image Technology 2018 (IWAIT2018), Chiang Mai, Thailand
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Consideration of the Effect of Preference for Image Contents using Apparent SpO22018

    • Author(s)
      Yudai Sato, Yang Du, Daiki Sawada, Yuukou Horita
    • Organizer
      International Workshop on Advanced Image Technology 2018 (IWAIT2018), Chiang Mai, Thailand
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] Measurement of the difference of the cerebral blood flow while viewing image contents by using different displays2018

    • Author(s)
      Kazuki Nakayama, Yang Du, Daiki Sawada, Yuukou Horita
    • Organizer
      International Workshop on Advanced Image Technology 2018 (IWAIT2018), Chiang Mai, Thailand
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] A study of the influence of video quality on Apparent SpO22018

    • Author(s)
      Yota Niigaki, Yang Du, Daiki Sawada, Yuukou Horita
    • Organizer
      International Workshop on Advanced Image Technology 2018 (IWAIT2018), Chiang Mai, Thailand
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2017-04-28   Modified: 2022-01-27  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi