User emotion sensing in search process based on chromatic sensation and color information expressing human emotion

• Project/Area Number: 25870701
• Research Category: Grant-in-Aid for Young Scientists (B)
• Allocation Type: Multi-year Fund
• Research Field: Kansei informatics; Multimedia database
• Research Institution: Aoyama Gakuin University
• Principal Investigator: Kajiyama Tomoko 青山学院大学, 理工学部, 助教 (20454085)
• Project Period (FY): 2013-04-01 – 2017-03-31
• Project Status: Completed (Fiscal Year 2016)
• Budget Amount: ¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000); Fiscal Year 2015: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000); Fiscal Year 2014: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000); Fiscal Year 2013: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
• Keywords: 書籍表紙画像 / 色抽出 / レビュー / 検索インタフェース / 書籍探索システム / 形容詞 / 色彩心理

Outline of Final Research Achievements

To propose a method for sensing human emotion based on browsed color information, a method to extract colors from texts expressing human emotion was proposed and an image retrieval system that allows users to browse color information intuitively. The target domain was books and a method for revising book cover images to reflect readers' impressions was developed. It uses a database of the correspondence between adjectives and colors as extracted from book contexts and reviews. This correspondence is used to revise the colors in the original book cover image. A book search system displaying the revised book cover images was constructed by applying a ring-structured graphical search interface that supports multi-faceted search with simple ring operations. Testing showed that it enhances the opportunity to discover new books and enables users to find relevant books by attracting their emotion to the proposed images during the search process.

Research Products

• [Journal Article] An improved botanical search application for middle- and high-school students (2016)
  • Author(s): Tomoko Kajiyama
  • Journal Title: Education and Information Technologies Volume: 21(6) Issue: 6 Pages: 1821-1836
  • DOI: 10.1007/s10639-015-9421-5
  • Peer Reviewed / Int'l Joint Research
• [Journal Article] Self-localization and Navigation in Dynamic Search Hierarchy for Retrieval Interface (2016)
  • Author(s): Tomoko Kajiyama and Shin’ichi Satoh
  • Journal Title: Advances in Intelligent Systems and Computing Volume: 364 Pages: 519-528
  • DOI: 10.1007/978-3-319-19090-7_39
  • ISBN: 9783319190891, 9783319190907
  • Peer Reviewed
• [Journal Article] A Color Extraction Method from Text for Use in Creating a Book Cover Image that Reflects Reader Impressions, (2016)
  • Author(s): Takuya Iida, Tomoko Kajiyama, Noritomo Ouchi and Isao Echizen
  • Journal Title: Advances in Intelligent Systems and Computing Volume: 364 Pages: 201-211
  • DOI: 10.1007/978-3-319-19090-7_16
  • ISBN: 9783319190891, 9783319190907
  • Peer Reviewed / Acknowledgement Compliant
• [Journal Article] A Method for Creating Package Images that Reflect Consumer Taste Impressions (2016)
  • Author(s): Taichi Ueno, Tomoko Kajiyama and Noritomo Ouchi
  • Journal Title: IEICE Transactions on Information and Systems Volume: E99.D Issue: 1 Pages: 102-110
  • DOI: 10.1587/transinf.2015MUP0010
  • NAID: 130005116191
  • ISSN: 0916-8532, 1745-1361
  • Peer Reviewed
• [Journal Article] 曖昧な情報要求からの探索を支援するリング状検索インタフェース―植物検索とアプリ検索への適用による効果― (2016)
  • Author(s): 梶山朋子
  • Journal Title: 可視化情報学会誌 Volume: 36(140) Pages: 14-18
  • NAID: 130005188844
• [Journal Article] Wonder Search: リング状検索インタフェースの改良によるアプリ検索アプリケーション (2014)
  • Author(s): 梶山朋子
  • Journal Title: 電子情報通信学会論文誌 Volume: J97-D(5) Pages: 923-932
  • Peer Reviewed
• [Journal Article] 読者の印象を反映させた書籍表紙画像生成のための色抽出手法 (2014)
  • Author(s): 飯田拓也，梶山朋子，大内紀知，越前功
  • Journal Title: 電子情報通信学会論文誌 Volume: J97-D(1) Pages: 75-84
  • Peer Reviewed
• [Journal Article] 鑑賞者の印象を反映させた映画ポスター色変換手法の提案 (2014)
  • Author(s): 八木祐太，梶山朋子，大内紀知
  • Journal Title: 芸術科学会論文誌 Volume: 13(1) Pages: 59-66
  • Peer Reviewed
• [Journal Article] An Interaction Model between Human and System for Intuitive Graphical Search Interface (2013)
  • Author(s): Tomoko Kajiyama
  • Journal Title: Knowledge and Information Systems (KAIS) Journal Volume: 未定 Issue: 1 Pages: 41-60
  • DOI: 10.1007/s10115-012-0611-9
  • Peer Reviewed / Open Access
• [Presentation] A Book Search System Displaying Revised Book Cover Images Reflecting Reader Impressions (2016)
  • Author(s): Tomoko Kajiyama
  • Organizer: The 13th Annual International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services
  • Place of Presentation: Hiroshima, Japan
  • Year and Date: 2016-11-29
  • Int'l Joint Research
• [Presentation] Color Conversion of Book Cover Images to Reflect Reader Impressions (2016)
  • Author(s): Tomoko Kajiyama
  • Organizer: 2016 IEEE 5th Global Conference on Consumer Electronics
  • Place of Presentation: Kyoto, Japan
  • Year and Date: 2016-10-14
  • Int'l Joint Research
• [Presentation] User Emotion Sensing in Search Process based on Chromatic Sensation (2014)
  • Author(s): Tomoko Kajiyama
  • Organizer: the 1st ACM International Workshop on Human Centered Even Understanding from Multimedia
  • Place of Presentation: Orlando, Florida, USA
  • Year and Date: 2014-11-07
• [Presentation] 読者の印象を反映させた書籍表紙画像生成のための色彩と象徴物の抽出 (2014)
  • Author(s): 梶山朋子
  • Organizer: 電子情報通信学会HCS研究会
  • Place of Presentation: 沖縄
  • Year and Date: 2014-05-29
• [Presentation] An Application Search Interface Including Sense-related Search Facets (2014)
  • Author(s): Tomoko Kajiyama
  • Organizer: ACM International Conference on Multimedia Retrieval 2014
  • Place of Presentation: Glasgow, UK
  • Year and Date: 2014-04-04
• [Presentation] レビューに基づいた映画ポスターの色彩変更によるユーザの期待度と満足度への影響
  • Author(s): 梶山朋子
  • Organizer: 電子情報通信学会EMM研究会
  • Place of Presentation: 高知
• [Presentation] 映画ポスターとレビュー色彩化の比較による作品の印象とユーザ評価の関係性
  • Author(s): 梶山朋子
  • Organizer: 電子情報通信学会HCS研究会
  • Place of Presentation: 沖縄
• [Presentation] 読者の印象を反映させた書籍表紙画像生成のための一考察
  • Author(s): 梶山朋子
  • Organizer: 第15回情報科学技術フォーラム
  • Place of Presentation: 鳥取
• [Presentation] A Method for Extracting Colors from Text to Visualize Readers’ Impressions
  • Author(s): Tomoko Kajiyama
  • Organizer: The 7th Workshop Emotion and Computing -Current Research and Future Impact
  • Place of Presentation: Koblenz, Germany
• [Presentation] A Color Extraction Method from Text for Use in Creating a Book Cover Image that Reflects Reader Impressions
  • Author(s): Tomoko Kajiyama
  • Organizer: The 8th International Conference on Knowledge, Information and Creativity Support Systems
  • Place of Presentation: Krakow, Poland
• [Presentation] アイコン画像の色彩を直観的に操作できるアプリ検索インタフェースの可能性
  • Author(s): 梶山朋子
  • Organizer: HCGシンポジウム2013
  • Place of Presentation: 愛媛