• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Lifelog video retrieval using emotion estimation based on recognition of spontaneous facial expressions

Research Project

Project/Area Number 15K15993
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Multimedia database
Research InstitutionKyoto Institute of Technology

Principal Investigator

Nomiya Hiroki  京都工芸繊維大学, 情報工学・人間科学系, 准教授 (80533116)

Research Collaborator SAKAUE Shota  
MAEDA Mitsuaki  
Project Period (FY) 2015-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2016: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2015: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Keywordsライフログ / 映像検索 / 感情推定 / 表情認識 / 表情強度 / 機械学習
Outline of Final Research Achievements

A video retrieval system to efficiently retrieve and display impressive scenes from lifelog videos is developed on the basis of emotion estimation. In most of impressive scenes, a person in a video often shows a variety of facial expressions. Therefore, this system retrieves impressive scenes by means of facial expression recognition and the estimation of the intensity of facial expression using facial feature points. In addition, a method to detect emotional scenes in which a certain facial expression is observed is introduced. By using them, a lifelog video retrieval system is developed. This system works on a web browser and has a user-friendly interface so that a user easily finds impressive scenes.

Report

(3 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Research-status Report
  • Research Products

    (7 results)

All 2017 2016 2015

All Journal Article (4 results) (of which Peer Reviewed: 4 results,  Acknowledgement Compliant: 4 results) Presentation (2 results) Book (1 results)

  • [Journal Article] Estimation of Emotional Scene from Lifelog Videos in Consideration of Intensity of Various Facial Expressions2017

    • Author(s)
      Shota Sakaue, Hiroki Nomiya, Teruhisa Hochin
    • Journal Title

      Proc. of 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing

      Volume: 印刷中

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Emotional Video Scene Retrieval System for Lifelog Videos Based on Facial Expression Intensity2017

    • Author(s)
      Mitsuaki Maeda, Hiroki Nomiya, Shota Sakaue, Teruhisa Hochin, Yukiko Nishizaki
    • Journal Title

      Proc. of 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing

      Volume: 印刷中

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Recognition and Intensity Estimation of Facial Expression Using Ensemble Classifiers2016

    • Author(s)
      Hiroki Nomiya, Shota Sakaue, Teruhisa Hochin
    • Journal Title

      Proc. of 15th IEEE/ACIS International Conference on Computer and Information Science

      Volume: 1 Pages: 825-830

    • DOI

      10.1109/icis.2016.7550861

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Journal Article] Emotional Scene Retrieval from Lifelog Videos Using Evolutionary Feature Creation2015

    • Author(s)
      Hiroki Nomiya, Teruhisa Hochin
    • Journal Title

      Studies in Computational Intelligence

      Volume: 612 Pages: 61-75

    • DOI

      10.1007/978-3-319-23509-7_5

    • ISBN
      9783319235080, 9783319235097
    • Related Report
      2015 Research-status Report
    • Peer Reviewed / Acknowledgement Compliant
  • [Presentation] 決定木アンサンブルを用いた表情認識と表情強度の推定2016

    • Author(s)
      野宮 浩揮
    • Organizer
      第8回データ工学と情報マネジメントに関するフォーラム(DEIM2016)
    • Place of Presentation
      ヒルトン福岡シーホーク(福岡県・福岡市)
    • Year and Date
      2016-03-01
    • Related Report
      2015 Research-status Report
  • [Presentation] 顔特徴点の位置変化による特徴量を用いた表情強度の推定2016

    • Author(s)
      阪上 翔太、野宮 浩揮、宝珍 輝尚
    • Organizer
      情報処理学会
    • Place of Presentation
      大阪大学中之島センター(大阪府大阪市)
    • Related Report
      2016 Annual Research Report
  • [Book] Emotional and Facial Expressions: Recognition, Developmental Differences and Social Importance2015

    • Author(s)
      Hiroki Nomiya, Teruhisa Hochin, Andrew Cummings, Jennifer Rennels, Denise Davidson, Sandra B. Vanegas, Elizabeth Hilvert, Elizabeth Tuminello, Theano Kokkinaki 他
    • Total Pages
      189
    • Publisher
      Nova Science Publishers
    • Related Report
      2015 Research-status Report

URL: 

Published: 2015-04-16   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi