Affective Rendering ? Toward the Realization of Affect Adapted Image Synthesis

• Project/Area Number: 21300033
• Research Category: Grant-in-Aid for Scientific Research (B)
• Allocation Type: Single-year Grants
• Section: 一般
• Research Field: Media informatics/Database
• Research Institution: University of Yamanashi
• Principal Investigator: MAO Xiaoyang 山梨大学, 大学院・医学工学総合研究部, 教授 (20283195)
• Co-Investigator(Kenkyū-buntansha): TAKAHASHI Shigeo 東京大学, 新領域創成科学研究科, 准教授 (40292619) ; OMATA Masaki 山梨大学, 大学院・医学工学総合研究部, 准教授 (60402088) ; YOSHIDA Norimasa 日本大学, 生産工学部, 准教授 (70277846) ; TOYOURA Masahiro 山梨大学, 大学院・医学工学総合研究部, 助教 (80550780)
• Project Period (FY): 2009 – 2012
• Project Status: Completed (Fiscal Year 2012)
• Budget Amount: ¥17,810,000 (Direct Cost: ¥13,700,000、Indirect Cost: ¥4,110,000); Fiscal Year 2012: ¥2,470,000 (Direct Cost: ¥1,900,000、Indirect Cost: ¥570,000); Fiscal Year 2011: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000); Fiscal Year 2010: ¥5,460,000 (Direct Cost: ¥4,200,000、Indirect Cost: ¥1,260,000); Fiscal Year 2009: ¥6,890,000 (Direct Cost: ¥5,300,000、Indirect Cost: ¥1,590,000)
• Keywords: グラフィクス / Affective Computing / Affective Rendering / 生体情報 / 人間中心設計

Research Abstract

We proposed affective rendering as a new affective computing technology which deals with user emotion in the field of image synthesis. Affective rendering is realized in 3 steps - affect sensing, affect analysis and affect adapted rendering. We have carried out various experiments to study the mapping between the typical visual parameters and 2D affect space. Techniques for estimating the 2D emotion state of a user from biological signals are developed and applied to an emotional painting tool that dynamically adapts the colors of brush and the outline of canvas to the estimated emotion of the user.

Research Products

• [Journal Article] Abstracting Images into Continuous Line Artistic Styles (2013)
  • Author(s): Fernando J. Wong and Shigeo Takahashi
  • Journal Title: The Visual Computer Volume: 未定(採録決定済) Issue: 6-8 Pages: 729-738
  • DOI: 10.1007/s00371-013-0809-1
  • Peer Reviewed
• [Journal Article] Automatic generation of accentuated Pencil Drawing with Saliency Map and LIC (2012)
  • Author(s): Michitaka Hata, Masahiro Toyoura, Xiaoyang Mao
  • Journal Title: he Visual Computer Volume: Vol.28,No.6-8 Pages: 657-668
  • Peer Reviewed
• [Journal Article] 大局的特徴量 GIST を用いた作品例に基づく絵画調画像生成 (2012)
  • Author(s): 阿部 敬由, 豊浦 正広, 茅 暁陽
  • Journal Title: 画像電子学会誌 Volume: Vol.41, No.4 Pages: 340-351
  • NAID: 130004870585
  • Peer Reviewed
• [Journal Article] Automatic generation of accentuated Pencil Drawing with Saliency Map and LIC (2012)
  • Author(s): Michitaka Hata, Masahiro Toyoura, Xiaoyang Mao
  • Journal Title: The Visual Computer Volume: Vol.28, No.6-8 Issue: 6-8 Pages: 657-668
  • DOI: 10.1007/s00371-012-0689-9
  • Peer Reviewed
• [Journal Article] 大局的特徴量GISTを用いた作品例に基づく絵画調画像生成 (2012)
  • Author(s): 阿部 敬由, 豊浦 正広, 茅 暁陽
  • Journal Title: 画像電子学会誌 Volume: Vol.41, No.4
  • NAID: 130004870585
  • Peer Reviewed
• [Journal Article] Saliency MapとLIC法を利用したアクセントのある鉛筆画生成法 (2012)
  • Author(s): 畠 康高, 豊浦 正広, 茅 暁陽
  • Journal Title: 電子情報通信学会論文誌 Volume: Vol.J95-A, No.7
  • NAID: 10031083724
  • Peer Reviewed
• [Journal Article] Digital Camouflage Images Using Two-scale Decomposition (2012)
  • Author(s): 7.Hui Du, Xiaogang Jin, Xiaoyang Mao
  • Journal Title: Computer Graphics Forum Volume: Vol.31, No.7 Issue: 7 Pages: 2203-2212
  • DOI: 10.1111/j.1467-8659.2012.03213.x
  • Peer Reviewed
• [Journal Article] Mathematical Marbling (2012)
  • Author(s): 5.Shufang Lu, Aubrey Jaffer, Xiaogang Jin, Hanli Zhao, Xiaoyang Mao
  • Journal Title: IEEE Computer Graphics and Applications Volume: Vol.32, No.6 Issue: 6 Pages: 26-35
  • DOI: 10.1109/mcg.2011.51
  • Peer Reviewed
• [Journal Article] コンピュータによるビュー中心絵画調画像生成 (2012)
  • Author(s): 茅 暁陽
  • Journal Title: 画像電子学会誌 Volume: Vol.41, No.4
  • Peer Reviewed
• [Journal Article] The Evolutes of Log-Aesthetic Curves and The Drawable Boundaries of The Curve Segments (2012)
  • Author(s): Norimasa Yoshida, Takefumi Saito
  • Journal Title: Computer-Aided Design and Applications Volume: Vol. 9, No. 5 Issue: 5 Pages: 721-731
  • DOI: 10.3722/cadaps.2012.721-731
  • Peer Reviewed
• [Journal Article] Using Eye-Tracking Data for Automatic Film Comic Creation (2012)
  • Author(s): Masahiro Toyoura、Tonoya Sawada、Manoru Kunihiro、Xiaoyang Mao
  • Journal Title: Proceedings of the Seventh ACM Symposium on Eye Tracking Research & Applications Pages: 373-376
  • DOI: 10.1145/2168556.2168640
  • Peer Reviewed
• [Journal Article] 生体信号の変化に伴って観察者の覚せい度を制御する視覚的効果の設計 (2011)
  • Author(s): 森脇和也, 小俣昌樹, 嘉糠大輔, 茅暁陽, 今宮淳美
  • Journal Title: 画像電子学会誌 Volume: Vol.40 Pages: 768-777
  • NAID: 10029794809
  • Peer Reviewed
• [Journal Article] 生体信号の変化に伴って観察者の覚せい度を制御する視覚的効果の設計 (2011)
  • Author(s): 森脇和也、小俣昌樹、嘉糠大輔、茅暁陽、今宮淳美
  • Journal Title: 画像電子学会誌 Volume: 第40巻 Pages: 768-777
  • NAID: 10029794809
  • Peer Reviewed
• [Journal Article] An immersive View Control Method Using EMG Signals of Users' Eyelid Movements (2011)
  • Author(s): Masaki Omata、Satoshi Kagoshima、Atsumi Imamiya、Xiaoyang Mao
  • Journal Title: Proceedings of the ICMI 2011 MMCogEmS workshop
  • Peer Reviewed
• [Journal Article] 感情に連動して色が変化するお絵描き (2010)
  • Author(s): 嘉糠 大輔, 小俣昌樹,今宮淳美,茅 暁陽
  • Journal Title: 日本バーチャルリアリティ学会論文 誌 Volume: Vol.15,No.3 Pages: 479-482
  • Peer Reviewed
• [Journal Article] 感情に連動して色が変化するお絵描きツール (2010)
  • Author(s): 嘉糠大輔, 他3名
  • Journal Title: 日本バーチャルリアリティ学会論文誌 Volume: 15(3) Pages: 479-482
  • Peer Reviewed
• [Journal Article] 生体情報によるアウェアネス検出のための五感刺激と生体情報との関係の分析 (2010)
  • Author(s): 小俣昌樹, 他3名
  • Journal Title: 日本バーチャルリアリティ学会論文誌 Volume: 15(4) Pages: 553-562
  • Peer Reviewed
• [Journal Article] 最適視点計算を用いた非透視投影図の自動生成 (2010)
  • Author(s): 真塩海里, 他3名
  • Journal Title: 画像電子学会誌 Volume: 39(4) Pages: 359-368
  • Peer Reviewed
• [Journal Article] Automatic Blending of Multiple Perspective Views for Aesthetic Composition (2010)
  • Author(s): K.Mashio, 他3名
  • Journal Title: Proceedings of Smart Graphics 2010 (掲載決定)
  • Peer Reviewed
• [Journal Article] Real-Time Saliency-Aware Video Abstraction (2009)
  • Author(s): H.Zhao, 他5名
  • Journal Title: The Visual Computer 25(11) Pages: 973-984
  • Peer Reviewed
• [Journal Article] AtelierM++ : A Fast and Accurate Marbling System (2009)
  • Author(s): H.Zhao, 他3名
  • Journal Title: Multimedia Tools and Application 44(2) Pages: 187-203
  • Peer Reviewed
• [Presentation] 情動誘導映像の設計 (2013)
  • Author(s): 川頭 匠,豊浦 正広,小俣 昌樹,茅 暁陽
  • Organizer: 芸術科学フォーラム
  • Place of Presentation: 慶応義塾大学
  • Year and Date: 2013-03-15
• [Presentation] 情動誘導映像の設計 (2013)
  • Author(s): 3.川頭 匠，豊浦 正広，小俣 昌樹，茅 暁陽
  • Organizer: 芸術科学フォーラム
  • Place of Presentation: 慶応義塾大学（横浜）
• [Presentation] Film Comic Generation with Eye Tracking (2013)
  • Author(s): Tomoya Sawada, Masahiro Toyoura, Xiaoyang Mao
  • Organizer: International Conference on MultiMedia Modeling (MMM)
  • Place of Presentation: Huangshan（中国）
• [Presentation] Hierarchical Design of Continuous Line Illustrations (2013)
  • Author(s): Fernando J. Wong and Shigeo Takahashi
  • Organizer: Proceedings of the 8th International Conference on Computer Graphics Theory and Applications (GRAPP2013)
  • Place of Presentation: Barcelona（スペイン）
• [Presentation] Affective Rendering: Visual Effect Animations for Affecting User Arousal (2012)
  • Author(s): Masaki Omata, Kazuya Moriwaki, Xiaoyang Mao, Daisuke Kanuka, Atsumi Imamiya
  • Organizer: IEEE International Conference on Multimedia Computing and Systems (ICMCS)
  • Place of Presentation: Tangier
  • Year and Date: 2012-05-11
• [Presentation] Affective Rendering: Visual Effect Animations for Affecting User Arousal (2012)
  • Author(s): Masaki Omata, Kazuya Moriwaki, Xiaoyang Mao, Daisuke Kanuka, Atsumi Imamiya
  • Organizer: IEEE International Conference on Multimedia Computing and Systems (ICMCS)
  • Place of Presentation: Tangier(モロッコ）
• [Presentation] 写真からの対話的イラスト生成 (2012)
  • Author(s): 岩田 大輝, 関 啓夢, 茅 暁陽, 豊浦 正広
  • Organizer: Visual Computing/グラフィクスとCAD合同シンポジウム
  • Place of Presentation: 早稲田大学(東京）
• [Presentation] Affective Doodle: a painting tool reflecting user emotion (2012)
  • Author(s): Masaki Omata, Daisuke Kanuka, Xiaoyang Mao and Atsumi Imamiya
  • Organizer: Proceedings of the ACM Symposium on Applied Perception
  • Place of Presentation: Los Angeles（米国）
• [Presentation] 片眼鏡実現のための距離情報を含む映像の合成 (2012)
  • Author(s): 豊浦 正広, 柏木 賢治, 茅 暁陽
  • Organizer: 画像電子学会ビジュアルコンピューティングワークショップ
  • Place of Presentation: 秋保リゾートホテルクレセント（仙台）
• [Presentation] ユーザビリティ評価における集中と作業成績の関連性の調査 (2012)
  • Author(s): 宮崎雄宇, 小俣昌樹, 茅暁陽
  • Organizer: FIT2012（第11 回情報科学技術フォーラム）
  • Place of Presentation: 法政大学（東京）
• [Presentation] 感情推定に向けた感情喚起画像提示時の脳波と脳血流変化の測定 (2011)
  • Author(s): 嘉糠大輔, 小俣昌樹, 茅暁陽,今宮淳美
  • Organizer: 第18回VR心理学研究会
  • Place of Presentation: 高知工科大学
  • Year and Date: 2011-12-09
• [Presentation] Saliency MapとLIC法を利用したアクセントのある鉛筆画生成法 (2011)
  • Author(s): 畠康高、茅暁陽、豊浦正広
  • Organizer: Visual Computing/グラフィクスとCAD合同シンポジウム
  • Place of Presentation: 島根県立産業交流会館
  • Year and Date: 2011-06-26
• [Presentation] GUIの配色が与える生体的影響の調査 (2010)
  • Author(s): 小林久祥, 他3名
  • Organizer: 第4回色彩情報シンポジウム
  • Place of Presentation: 長野長野大学
  • Year and Date: 2010-11-06
• [Presentation] コンピュータ操作時における香り刺激による生体情報の変化の検証 (2009)
  • Author(s): 小俣昌樹, 他3名
  • Organizer: 日本バーチャルリアリティ学会「テレイマージョン技術・サイバースペースと仮想都市・香りと生体情報」合同研究会
  • Place of Presentation: ホテル紫苑(岩手県盛岡市)
  • Year and Date: 2009-06-12
• [Remarks]
  • URL: http://www.vc.media.yamanashi.ac.jp/Top_jp.html
• [Remarks]
  • URL: http://www.vc.media.yamanashi.ac.jp/Research.jp.html