• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Investigation on generation and perception of higher-order facial impressions based on the morphable 3D face model and its application to perceptual human interface systems

Research Project

Project/Area Number 16K00378
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Research Field Kansei informatics
Research InstitutionHosei University

Principal Investigator

AKAMATSU Shigeru  法政大学, 理工学部, 教授 (50339503)

Co-Investigator(Kenkyū-buntansha) 行場 次朗  東北大学, 文学研究科, 教授 (50142899)
伊師 華江  仙台高等専門学校, 総合工学科, 准教授 (10435406)
Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥4,550,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥1,050,000)
Fiscal Year 2018: ¥910,000 (Direct Cost: ¥700,000、Indirect Cost: ¥210,000)
Fiscal Year 2017: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2016: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Keywords画像認識・生成 / ヒューマンインタフェース / 感性情報処理 / 顔の認知 / 視覚印象 / 眼球運動 / 感性インタフェース / 顔情報処理 / 3次元モデル / 顔認知 / 高次視覚印象 / 3次元モデル
Outline of Final Research Achievements

Among factors that bring diversity to facial appearance, not only static variations in individual facial shape in 3D but also dynamic traits of the face caused by its change of posture and variation in direction of the gaze for its observation, creating facial expressions, effects of aging, wearing make-up and so on, were investigated in terms of their effects given to the higher-order impression perceived in the face. Insights on image engineering technologies for perceptual interface system, such as transformation of social impressions conveyed by the face of the anthropomorphic agent and estimation of the age from faces, were also investigate in this report.

Academic Significance and Societal Importance of the Research Achievements

本研究の結果から、任意の顔に対してその好感度を高めるなど、顔印象を自在に操作することによって感性情報を効果的に発信できるような擬人化エージェントの設計指針が得られるとともに、任意の顔画像に対して多くの人による印象判断をなぞるような分類・検索機能を実現することが可能となり、人間・コンピュータ間の感性インタフェース技術の高度化への寄与が期待される。
併せて、3次元顔表象から視覚を通じて様々な高次印象が想起される過程など、顔認知の脳内メカニズムの解明にマクロな視点から貢献することも期待される。

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (31 results)

All 2019 2018 2017 2016

All Journal Article (1 results) Presentation (30 results) (of which Int'l Joint Research: 10 results)

  • [Journal Article] 両眼視野闘争下におけるアレキシサイミア傾向者の表情知覚の特性2018

    • Author(s)
      高橋玲央、行場次朗
    • Journal Title

      IEICE Technica1 Report (電子情報通信学会 技術報告)

      Volume: HCS2017-97 Pages: 23-28

    • Related Report
      2017 Research-status Report
  • [Presentation] Automatic generation of 3D faces expressing different utterances by modeling individual variation of shape deformation from expressionless faces2019

    • Author(s)
      Isseki Miwa, Shigeru Akamatsu
    • Organizer
      International Workshop on Advanced Image Technology 2019 (IWAIT 2019)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] モーションキャプチャから得られる3次元特徴量を用いた表情のセグメンテーション2019

    • Author(s)
      安田謙太郎、赤松茂
    • Organizer
      動的画像処理実利用化ワークショップ2019
    • Related Report
      2018 Annual Research Report
  • [Presentation] 顔観察時の視線停留の動的なパターンと顔認知特性との関係を探る2019

    • Author(s)
      大上俊、山田涼子、赤松茂
    • Organizer
      電子情報通信学会画像工学研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] 隠れマルコフモデルを用いた顔の再認時における視線運動分析2019

    • Author(s)
      瀧澤裕太、赤松茂
    • Organizer
      電子情報通信学会2019年総合大会・学生ポスターセッション
    • Related Report
      2018 Annual Research Report
  • [Presentation] 表情間の3次元顔形状差分の分析にもとづく任意人物の発話表情生成の試み2018

    • Author(s)
      三輪一石、赤松茂
    • Organizer
      画像電子学会年次大会2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] Does appearance transformation of an avatar face changing its favorability impressions affect human recognition of its face?2018

    • Author(s)
      Ryoko Yamada, Momoko Hada, Shigeru Akamatsu
    • Organizer
      41st European Conference on Visual Perception 2018 (ECVP2018)
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 印象が変化する顔を同一人物と認識するか2018

    • Author(s)
      作田由衣子、山田涼子、羽田桃子、赤松茂
    • Organizer
      日本心理学会第82回大会
    • Related Report
      2018 Annual Research Report
  • [Presentation] HMMに基づく視線動作モデルの個人性と顔再認特性との関係を探る2018

    • Author(s)
      大上俊、山田涼子、赤松茂
    • Organizer
      電子情報通信学会HCGシンポジウム2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 個人間における3次元顔形状の分類を用いた発話表情生成の試み2018

    • Author(s)
      三輪一石、赤松茂
    • Organizer
      電子情報通信学会HCGシンポジウム2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 距離画像に対するCNNを用いた指文字からの数字認識2018

    • Author(s)
      岡田治樹、赤松茂
    • Organizer
      電子情報通信学会HCGシンポジウム2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] 隠れマルコフモデルによる視線動作のモデル化から顔再認特性を探る2018

    • Author(s)
      大上俊、山田涼子、赤松茂
    • Organizer
      映像情報メディア学会冬季大会2018
    • Related Report
      2018 Annual Research Report
  • [Presentation] How does the transformation of an avatar face giving a favorable impression affect human recognition of the face?2018

    • Author(s)
      Momoko Hada, Ryoko Yamada, Shigeru Akamatsu
    • Organizer
      International Workshop on Advanced Image Technology 2018 (IWAIT 2018)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 主成分分析に基づく三次元発話表情顔の生成2018

    • Author(s)
      三輪一石、赤松茂
    • Organizer
      2018年電子情報通信学会総合大会
    • Related Report
      2017 Research-status Report
  • [Presentation] Kinect v2・Leap Motionを用いた腕指方向推定システムの動作認識2018

    • Author(s)
      稲葉三千貴、赤松茂
    • Organizer
      2018年電子情報通信学会総合大会
    • Related Report
      2017 Research-status Report
  • [Presentation] KinectとLeap Motionを用いた部分空間法による指文字認識2018

    • Author(s)
      岡田治樹、赤松茂
    • Organizer
      2018年電子情報通信学会総合大会
    • Related Report
      2017 Research-status Report
  • [Presentation] Does impression manipulation of avatar faces affect observer’s face recognition performance and displacement of their gaze?2017

    • Author(s)
      Ryoko Yamada, Momoko Hada, Yuiko Sakuta, Shigeru Akamatsu
    • Organizer
      5th IIEEJ International Workshop on Image Electronics and Visual Computing 2017 (IEVC 2017)
    • Place of Presentation
      FPT Complex / FPT City Da Nang, Da Nang, Vietnam
    • Year and Date
      2017-02-28
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Creating animation of facial speech by stepwise manipulations on morphable 3D face models for impression transformation2017

    • Author(s)
      Kazuya Horii, Hikaru Tanaka, Shigeru Akamatsu
    • Organizer
      International Workshop on Advanced Image Technology 2017(IWAIT 2017)
    • Place of Presentation
      Equatorial Hotel, Penang, Malaysia
    • Year and Date
      2017-01-08
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Age-group classification by face images using both Gabor and facial shape features2017

    • Author(s)
      Masaki Takaku, Shigeru Akamatsu
    • Organizer
      International Workshop on Advanced Image Technology 2017(IWAIT 2017)
    • Place of Presentation
      Equatorial Hotel, Penang, Malaysia
    • Year and Date
      2017-01-08
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Does an appearance transformation of 3D faces for transmitting social impressions affect people’s identification of faces?2017

    • Author(s)
      Ryoko Yamada, Momoko Hada, Yuiko Sakuta, Shigeru Akamatsu
    • Organizer
      International Workshop on Advanced Image Technology 2017(IWAIT 2017)
    • Place of Presentation
      Equatorial Hotel, Penang, Malaysia
    • Year and Date
      2017-01-08
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] How does social impression transformation created on avatar faces affect face recognition performance and eye movement?2017

    • Author(s)
      Ryoko Yamada, Momoko Hada, Yuiko Sakuta, Shigeru Akamatsu
    • Organizer
      40th European Conference on Visual Perception 2017 (ECVP 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research
  • [Presentation] 顔に対する好ましさの印象は人による顔認識能力にどのような影響を与えるか2017

    • Author(s)
      羽田桃子、山田涼子、赤松 茂
    • Organizer
      電子情報通信学会HCGシンポジウム
    • Related Report
      2017 Research-status Report
  • [Presentation] 3次元顔アバターに対する印象操作は人による顔の同定にどのように影響するか2016

    • Author(s)
      山田涼子、羽田桃子、作田由衣子、赤松茂
    • Organizer
      電子情報通信学会HCGシンポジウム2016
    • Place of Presentation
      高知市文化プラザかるぽーと(高知県高知市)
    • Year and Date
      2016-12-07
    • Related Report
      2016 Research-status Report
  • [Presentation] 3次元顔モーフィングモデル上の印象変換操作にもとづく発話動画像の生成及び評価2016

    • Author(s)
      堀井和也、田中ひかる、赤松茂
    • Organizer
      電子情報通信学会HCGシンポジウム2016
    • Place of Presentation
      高知市文化プラザかるぽーと(高知県高知市)
    • Year and Date
      2016-12-07
    • Related Report
      2016 Research-status Report
  • [Presentation] 顔画像からのGabor特徴と形状特徴を用いた自動年齢推定2016

    • Author(s)
      高久将来、赤松茂
    • Organizer
      電子情報通信学会HCGシンポジウム2016
    • Place of Presentation
      高知市文化プラザかるぽーと(高知県高知市)
    • Year and Date
      2016-12-07
    • Related Report
      2016 Research-status Report
  • [Presentation] 3次元顔モーフィングモデルにもとづく顔の印象変換操作 ‐異種レンジファインダ-によって得られる新規の3次元顔への対応‐2016

    • Author(s)
      田中ひかる、堀井和也、赤松茂
    • Organizer
      電子情報通信学会HCGシンポジウム2016
    • Place of Presentation
      高知市文化プラザかるぽーと(高知県高知市)
    • Year and Date
      2016-12-07
    • Related Report
      2016 Research-status Report
  • [Presentation] 顔の記憶が得意な人の方略を視線計測から探る2016

    • Author(s)
      作田由衣子、山田涼子、稲葉善典、赤松茂
    • Organizer
      日本顔学会年次大会フォーラム顔学2016
    • Place of Presentation
      東京藝術大学(東京都台東区)
    • Year and Date
      2016-11-19
    • Related Report
      2016 Research-status Report
  • [Presentation] 真顔・笑顔のポートレート写真の加工と印象評価2016

    • Author(s)
      鴫原薫、伊師華江
    • Organizer
      日本顔学会年次大会フォーラム顔学2016
    • Place of Presentation
      東京藝術大学(東京都台東区)
    • Year and Date
      2016-11-19
    • Related Report
      2016 Research-status Report
  • [Presentation] Effects of Facial Expressions on Visual Short-Term Memory and Alexithymia Traits2016

    • Author(s)
      Takahashi, J. and Gyoba, J.
    • Organizer
      The 31st International Congress of Psychology
    • Place of Presentation
      パシフィコ横浜(神奈川県横浜市)
    • Year and Date
      2016-07-24
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] People can identify a face even if the person’s facial impressions have changed2016

    • Author(s)
      Yuiko Sakuta, Ryoko Yamada, Yoshinori Inaba, Shigeru Akamatsu
    • Organizer
      International Conference on Memory (ICOM 2016)
    • Place of Presentation
      Budapest, Hungary
    • Year and Date
      2016-07-17
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] 顔をおぼえるのが上手い人・下手な人:再認実験と視線計測からのアプローチ2016

    • Author(s)
      作田由衣子、山田涼子、稲葉善典、赤松茂
    • Organizer
      日本認知心理学会第14回大会
    • Place of Presentation
      広島大学(広島県東広島市)
    • Year and Date
      2016-06-18
    • Related Report
      2016 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi