• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Clarifying the emotion generation mechanism for the cross-media data retrieval system bringing emotion and its application

Research Project

Project/Area Number 18500163
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Sensitivity informatics/Soft computing
Research InstitutionKyoto Institute of Technology

Principal Investigator

HOUCHIN Teruhisa  Kyoto Institute of Technology, Graduate Schoolof Seicnce and Technology, professor (00251984)

Co-Investigator(Kenkyū-buntansha) TANIZUKA Noboru  Osaka Prefecture University, Graduate School of Science, Associate Professor (50079159)
Project Period (FY) 2006 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥4,010,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥510,000)
Fiscal Year 2007: ¥2,210,000 (Direct Cost: ¥1,700,000、Indirect Cost: ¥510,000)
Fiscal Year 2006: ¥1,800,000 (Direct Cost: ¥1,800,000)
KeywordsKansei Informatics / Experimental psychology / Brain / Information fundamentals / Information retrieval / 実験系心理学
Research Abstract

It is experimentally clarified that how the harmony of the audiovisual material influences its impression, and how "semantic harmony" and "formal harmony" of the audiovisual material are related with "general harmony". In the experiment, four patterns of audiovisual materials are used. These are created by combining the semantically matched and mismatched sound clips and the temporally matched and mismatched video clips. This experiment clarifies that the impression of the sound is more dominant than that of the video overall in that of the audiovisual material, and the rating of general harmony must be high in order to get an audiovisual material of high scores of the impression words of "Natural", "Beautiful", and "Impressive" included in "Naturalness factor". In addition, the rating of general harmony of the audiovisual material could be estimated by using the rating of semantic harmony and that of formal harmony.
A method of synchronizing a music clip and a video clip of the query result in the cross-media retrieval system is proposed for the purpose of improving the degree of their fitness. The proposed method changes the speed in playing a video clip. This method decides the synchronization points of a video clip based on the beats in a music clip. The speed in playing a video clip is decided according to the times of the synchronization points. The proposed synchronization method is experimentally evaluated. The evaluation result shows that the proposed method could improve the degree of fitness of a music clip and a video one.
The predictability of the brain magnetism is discussed based on the analysis of the data at different consciousness states with nonlinear methods. External reading of the mental activity is concerned.

Report

(3 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • Research Products

    (21 results)

All 2008 2007 2006

All Journal Article (12 results) (of which Peer Reviewed: 2 results) Presentation (9 results)

  • [Journal Article] 感性に基づくマルチメディアデータ検索システムにおける一気分適応法2008

    • Author(s)
      村井 昭仁, 宝珍 輝尚
    • Journal Title

      日本感性工学会研究論文集 7

      Pages: 553-560

    • NAID

      130001756463

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] Mood Adaptation in Kansei Multimedia Data retrieval System2008

    • Author(s)
      A., Murai, T., Hochin
    • Journal Title

      Journal of Japan Society of Kansei Engineering Vol.5, No.4

      Pages: 553-560

    • NAID

      130001756463

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Synchronizing Music and Video of Query Results in Cross-Media Retrieval System2007

    • Author(s)
      T. Hochin, W. Xue
    • Journal Title

      Lecture Note in Artificial Intelligence 4693

      Pages: 793-800

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
    • Peer Reviewed
  • [Journal Article] 感性異種メディアデータ検索での問合せ結果提示における動画の再生速度の影響について2007

    • Author(s)
      桑田 和也, 宝珍 輝尚
    • Journal Title

      情報処理学会研究報告 2007

      Pages: 89-96

    • NAID

      110006291459

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Journal Article] Synchronizing Music and Video of Query Results in Cross-Media Retrieval System2007

    • Author(s)
      T., Hochin, W., Xue
    • Journal Title

      Lecture Note in Artificial Intelligence Vol.4693

      Pages: 793-800

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] On the Effect of Speed of Playing Video in the Query Result of Kansei Cross-Media Retrieval2007

    • Author(s)
      K., Kuwata, T., Hochin
    • Journal Title

      IPSJ SIG Technical Reports Vol.2008, No.34

      Pages: 89-96

    • NAID

      110006291459

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] 動画の再生速度が視聴覚素材の印象に及ぼす影響2007

    • Author(s)
      桑田 和也, 宝珍 輝尚
    • Journal Title

      第12回電子情報通信学会関西支部学生会学生研究発表講演会講演論文集

      Pages: 73-73

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 意識状態と脳磁波ダイナミクスの時空間特性 II2007

    • Author(s)
      谷塚 昇, 森島昌志, Khan Rahman, 寳珍輝尚
    • Journal Title

      電子情報通信学会総合大会講演論文集 基礎・境界

      Pages: 81-81

    • Related Report
      2006 Annual Research Report
  • [Journal Article] Method of Adapting Kansei Picture Retrieval System to the User's Emotion2006

    • Author(s)
      Teruhisa Hochin, Akihito Murai
    • Journal Title

      Proc. of the First International Conference on Kansei Engineering & Intelligent Systems

      Pages: 51-58

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 感性検索における検索行動タイプと画像の印象について2006

    • Author(s)
      宝珍 輝尚, 村井 昭仁
    • Journal Title

      第8回日本感性工学会大会予稿集

      Pages: 156-156

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 脳磁アルファ波の非線形動力学解析2006

    • Author(s)
      谷塚 昇, 森島昌志, M.ラマン・カーン, 宝珍輝尚
    • Journal Title

      第21回日本ゆらぎ現象研究会研究会抄録集

      Pages: 12-12

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 脳磁気波の時空特性と意識状態2006

    • Author(s)
      森島昌志, ラマンカーン, 谷塚 昇, 寳珍輝尚
    • Journal Title

      電子情報通信学会ソサイエティ大会講演論文集 基礎・境界

      Pages: 37-37

    • Related Report
      2006 Annual Research Report
  • [Presentation] 脳磁気の観測時系列におけるダイナミクスの解析2008

    • Author(s)
      谷塚 昇
    • Organizer
      電子情報通信学会総合大会 基礎・境界シンポジウム
    • Place of Presentation
      福岡県北九州市
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Dynamical Analysis for Measurement Time Series of the Brain Magnetism2008

    • Author(s)
      N., Tanizuka
    • Organizer
      IEICE General Conference
    • Place of Presentation
      Fukuoka, Japan
    • Year and Date
      2008-03-20
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 脳磁気の観測時系列におけるダイナミクスの解析2008

    • Author(s)
      谷塚 昇
    • Organizer
      電子情報通信学会総合大会基礎・境界シンポジウム
    • Place of Presentation
      福岡県北九州市
    • Year and Date
      2008-03-20
    • Related Report
      2007 Annual Research Report
  • [Presentation] 視聴覚素材における音と動画の調和について2008

    • Author(s)
      桑田 和也
    • Organizer
      第4回日本感性工学会春季大会
    • Place of Presentation
      宮城県仙台市
    • Year and Date
      2008-03-07
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] On the harmony of sound and video clips in the audiovisual Materials2008

    • Author(s)
      K., Kuwata
    • Organizer
      4th Spring Conference of Japan Society of Kansei Engineering
    • Place of Presentation
      Miyagi, Japan
    • Year and Date
      2008-03-07
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 視聴覚素材の同期と印象について2007

    • Author(s)
      宝珍 輝尚
    • Organizer
      第9回日本感性工学会大会
    • Place of Presentation
      東京都新宿区
    • Year and Date
      2007-08-03
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] On the Synchronization and the Impression of Audiovisual Clips2007

    • Author(s)
      T., Hochin
    • Organizer
      9th Conference. of Japan Society of Kansei Engineering
    • Place of Presentation
      Tokyo, Japan
    • Year and Date
      2007-08-03
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] State of consciousness and spatiotemporal dynamics of brain magnetic wave2007

    • Author(s)
      N. Tanizuka
    • Organizer
      International Symposium on Synchronization in Complex Networks
    • Place of Presentation
      Leuven, Belgium
    • Year and Date
      2007-07-04
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] State of consciousness and spatiotemporal dynamics of brain magnetic wave2007

    • Author(s)
      N., Tanizuka
    • Organizer
      International Symposium on Synchro-nization in Complex Networks
    • Place of Presentation
      Leuven, Belgium
    • Year and Date
      2007-07-04
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary

URL: 

Published: 2006-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi