• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

1999 Fiscal Year Final Research Report Summary

The effective way to use sound and motion picture in multimedia

Research Project

Project/Area Number 10835015
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field 感性工学
Research InstitutionKyushu Institute of Design

Principal Investigator

IWAMIYA Shin-ichiro  Kyushu Institute of Design, Faculty of Design, professor, 芸術工学部, 教授 (60112356)

Project Period (FY) 1998 – 1999
KeywordsMusic / Motion picture / Computer / Accent / Congruency / Synchronization / Impression / Color
Research Abstract

To clarify the effective way to combine sound and music in multimedia, a series of experiments were examined. Firstly, the matching experiment of the musical tempo and the speed of motion picture in the audio-visual context was examined. This experiment showed two factors which affect the subjective congruency of audio-visual contents. One is the synchronization of visual and auditory accents and the other is the matching of musical tempo and speed of visual movement. Secondly, the effects of the synchronization of visual and auditory accents and the matching of musical tempo and visual speed on the audio-visual contents was examined by the subjective rating experiment. The independency of these two factors on the subjective congruency of audio-visual contents was shown. The synchronization factors was more dominant than the audio-visual contents were discussed. Finally, the degree of matching between color and music was explored as a function of colors and types of music. Blue, violet, purple, and red images are matched with powerful and dark music played with miner key and fast tempo. Bright music with tempo match with blue, purple, and violet. In general, music match with the colors which encourage the impression of music. In multimedia communication, if we know the effective way to use sound and motion picture, we can make excellent audio-visual contents without professionals' help. The present study proposes the basic knowledge to do so.

  • Research Products

    (12 results)

All Other

All Publications (12 results)

  • [Publications] Yoshimori Sugano: "On the matching of music and motion picture using computer graphics and computer music"Proceedings of 5th ICMPC. 465-468 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Yoshimori Sugano: "The effect of accent structure synchronization between music and motion picture on the feeling of congruency"Proceedings of QCAV '98. 445-449 (1998)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 菅野禎盛: "音楽のリズムと映像の動きの同期が音と映像の調和に及ぼす効果"音楽知覚認知研究. 5. 1-10 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 岩宮眞一郎: "色彩が音楽の印象に与える影響"芸術工学研究. 1. 63-68 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 岩宮眞一郎: "WWWを利用したコミュニケーションにおける音と映像の相互作用"日本音楽知覚認知学会平成11年度春季研究発表会資料. 44-51 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] 菅野禎盛: "映像の動きと音楽のリズムの構造的関係が両者の調和感と情緒的印象に及ぼす影響"日本音響学会平成11年度秋季研究発表会講演論文集. 559-560 (1999)

    • Description
      「研究成果報告書概要(和文)」より
  • [Publications] Yoshimori Sugano: "On the matching of music and motion picture using computer graphics and computer music"Proc.of 5th ICMPC. 465-468 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yoshimori Sugano: "The effect of accent structure synchronization between music and motion pictures on the feeling of congruency"Proc.of QCAV'98. 445-449 (1998)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yoshimori Sugano: "Effects of synchronization between musical rhythm and visual motion on the congruency of music and motion picture (in Japanese)"Journal of Music Perception and Cognition. 5. 1-10 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Shin-ichiro Iwamiya: "The effects of color on the impression of music (in Japanese)"Design Issue of KID. No.1. 63-68 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Shin-ichiro Iwamiya: "The interaction between sound and motion picture in the WWW communication (in Japanese)"Proc.of meeting of SMPC (Spring). 44-51 (1999)

    • Description
      「研究成果報告書概要(欧文)」より
  • [Publications] Yoshimori Sugano: "The effects of structure relationship between motion of animation and rhythm of music on the audio-visual congruency and emotional impression (in Japanese)"Proc.of meeting of ASJ (Fall). 559-560 (1999)

    • Description
      「研究成果報告書概要(欧文)」より

URL: 

Published: 2001-10-23  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi