• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

復元誤差と生成モデリングによる新しいタイプの非写実的な画像の開発と生理心理評価

Research Project

Project/Area Number 23K11727
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 90010:Design-related
Research InstitutionUniversity of Nagasaki

Principal Investigator

平岡 透  長崎県立大学, 情報システム学部, 教授 (30626891)

Co-Investigator(Kenkyū-buntansha) 片山 徹也  長崎県立大学, 情報システム学部, 教授 (00612805)
井上 光平  九州大学, 芸術工学研究院, 准教授 (70325570)
野中 尋史  愛知工業大学, 経営学部, 准教授 (70544724)
Project Period (FY) 2023-04-01 – 2026-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,680,000 (Direct Cost: ¥3,600,000、Indirect Cost: ¥1,080,000)
Fiscal Year 2025: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
Fiscal Year 2024: ¥2,340,000 (Direct Cost: ¥1,800,000、Indirect Cost: ¥540,000)
Fiscal Year 2023: ¥520,000 (Direct Cost: ¥400,000、Indirect Cost: ¥120,000)
Keywordsノンフォトリアリスティックレンダリング / 復元誤差 / アイトラッカー / 生理心理評価 / GAN / 生成モデリング / 非写実的な画像
Outline of Research at the Start

本研究では,復元誤差と生成モデリングによる新しいタイプの非写実的な画像を開発する.写真画像や動画,3次元データをさまざまなフィルタリング処理によって変換し,変換後のデータを逆フィルタによって復元するという反復計算を行う中で,復元誤差が蓄積することで自発的なパターンを形成した新しいタイプの非写実的な画像を生成する.さらに,GAN(敵対的生成ネットワーク)を用いた生成モデリングによって,複数の種類の非写実的な画像を融合することで,新しい表現を創発させる.加えて,本研究では非写実的な画像の評価法を生理心理的なアプローチから構築する.

Outline of Annual Research Achievements

復元誤差などによって,次に示す新しいタイプのノンフォトリアリスティックレンダリング(NPR)を開発した.:(1)重みシフトバイラテラルフィルタを用いたイスラム模様風画像,(2)Circular Slopeフィルタを用いた星屑風画像,(3)相関係数を用いた一方向Parallel-Fine-Curve-Line画像,(4)スムージングフィルタを用いた反応拡散模様風画像,(5)バイラテラルフィルタとアンシャープマスクを用いたRGB-D画像からスムーズなモアレ風画像,(6)領域分割スムージングフィルタを用いた波紋画像,(7)スペースが可変なストライプアート画像,(8)テンプレートによる相関係数を用いた波紋画像とチェッカーパターン画像,(9)異なるウィンドウサイズの周辺差分フィルタを用いた点光源画像,(10)スムージングフィルタと折り返し処理を用いたまだら画像,(11)ポアソン分布とエントロピーを用いたアブストラクトペインティング画像,(12)逆アイリスフィルタを用いたセル風画像,(13)スムージングフィルタを用いたストライプパッチワーク画像,(14)縦横スムージングフィルタを用いた流線画像,(15)バイラテラルフィルタを用いたRGB-D動画からのモアレ風動画,(16)ウィンドウサイズが拡張されたPrewittフィルタを用いたRGB-D動画からのチェッカーパターン動画
アイトラッカーを用いてNPRの画像を生理心理的側面から評価する方法を検討した.このとき,NPRの画像を見るときの視線動作を用いた基礎実験を行った.
敵対的生成ネットワーク(GAN)の一つであるDCGAN(Deep Convolutional GAN)を用いて,セル風画像とParallel-Fine-Curve-Line画像を合成し,新しい表現の非写実的な画像を創発させる研究を行った.

Current Status of Research Progress
Current Status of Research Progress

2: Research has progressed on the whole more than it was originally planned.

Reason

16種類のタイプのNPRを開発した,RGB-D動画を用いたNPRを開発した.また,アイトラッカーを用いて,パラメータの値を変えた場合のセル風画像の生理心理評価を行った.さらに,DCGANを用いてセル風画像とParallel-Fine-Curve-Line画像を合成し,新しい表現の非写実的な画像を創発させる研究を行った.
以上より,現在の研究がおおむね順調に進展していると評価する.

Strategy for Future Research Activity

2024年度も引き続きさまざまなタイプのNPRを開発する.また,スタイルトランスファーを用いて,新しい表現の非写実的な画像を創発させる研究を行う.

Report

(1 results)
  • 2023 Research-status Report
  • Research Products

    (23 results)

All 2024 2023

All Journal Article (21 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 20 results,  Open Access: 21 results) Presentation (2 results) (of which Int'l Joint Research: 2 results)

  • [Journal Article] Quality Improvement of Mottled Images Generated Using Smoothing Filtering and Extension / Return Processing2024

    • Author(s)
      Toru Hiraoka and Takeshi Kameyama
    • Journal Title

      ICIC Express Letters

      Volume: Vol.18, No.1 Pages: 47-52

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Method to Reduce Changes in Photographic Images with Embedded Images2024

    • Author(s)
      Toru Hiraoka and Kanya Goto
    • Journal Title

      ICIC Express Letters

      Volume: Vol.18, No.1 Pages: 53-58

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] An Iterative Raster Scan Algorithm for Superpixel Segmentation2024

    • Author(s)
      Kohei Inoue, Kenji Hara, Naoki Ono and Toru Hiraoka
    • Journal Title

      Journal of the Institute of Industrial Applications Engineers

      Volume: Vol.12, No.1 Pages: 12-17

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Method for Embedding Binary Image in Photographic Image Using 8-Neighbor Average2024

    • Author(s)
      Kanya Goto and Toru Hiraoka
    • Journal Title

      Journal of the Institute of Industrial Applications Engineers

      Volume: Vol.12, No.1 Pages: 1-4

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Streamline Images Using Correlation Coefficients Between RGB2024

    • Author(s)
      Toru Hiraoka and Hiroki Fujimoto
    • Journal Title

      ICIC Express Letters

      Volume: Vol.18, No.2 Pages: 143-149

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Abstract-Painting Images Using Poisson Distribution and Entropy2024

    • Author(s)
      Toru Hiraoka and Takeshi Kameyama
    • Journal Title

      ICIC Express Letters

      Volume: Vol.18, No.2 Pages: 151-157

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Quality Improvement of Cell-Like Images Generated Using Inverse Iris Filter2024

    • Author(s)
      Toru Hiraoka and Seiichi Hamasaki
    • Journal Title

      ICIC Express Letters

      Volume: Vol.18, No.3 Pages: 229-234

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] High Quality Method for Stripe-Patchwork Images Generated Using Smoothing and Inverse Filters2024

    • Author(s)
      Toru Hiraoka and Jia-Lin Zhang
    • Journal Title

      ICIC Express Letters

      Volume: Vol.18, No.3 Pages: 235-239

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Quality Improvement for Generation of Islamic-Pattern-Like Images Using Weight-Shifted Bilateral Filter2023

    • Author(s)
      Toru Hiraoka and Minoru Kumano
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.4 Pages: 457-462

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Stardust-Like Images Using Circular Slope Filter2023

    • Author(s)
      Toru Hiraoka and Yoshihisa Tsurunari
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.5 Pages: 541-546

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of One-Orientated Parallel-Fine-Curve-Line Images by Iterative Calculation Using Correlation Coefficient from Average Value2023

    • Author(s)
      Toru Hiraoka and Hirotaka Hirayama
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.6 Pages: 651-658

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Reaction-Diffusion-Pattern-Like Images with Partially Variable Size2023

    • Author(s)
      Toru Hiraoka
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: Vol.E106-A, No.6 Pages: 957-961

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Smooth Moire-Like Images from RGB-D Images2023

    • Author(s)
      Toru Hiraoka
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.7 Pages: 753-740

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Width-Changing Ripple Images Using Region-Divided Smoothing Filter2023

    • Author(s)
      Toru Hiraoka and Jia-Lin Zhang
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.8 Pages: 857-863

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] バイラテラルフィルタを用いたRGB-D動画からのモアレ風動画の生成2023

    • Author(s)
      平岡透
    • Journal Title

      産業応用工学会誌

      Volume: Vol.11,No.2 Pages: 156-159

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Stripe-Art Images with Variable Stripe Spacing2023

    • Author(s)
      Toru Hiraoka and Kanya Goto
    • Journal Title

      Journal of the Institute of Industrial Applications Engineers

      Volume: Vol.11, No.4 Pages: 70-73

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Underwater Image Enhancement by Linear Contrast Transform with Gray World Assumption2023

    • Author(s)
      Yunjia Huang, Kohei Inoue, Toru Hiraoka, Naoki Ono and Kenji Hara
    • Journal Title

      Journal of the Institute of Industrial Applications Engineers

      Volume: Vol.11, No.4 Pages: 74-80

    • Related Report
      2023 Research-status Report
    • Open Access
  • [Journal Article] Generation of Ripple and Checkered-Pattern Images Using Correlation Coefficient with Template2023

    • Author(s)
      Toru Hiraoka and Kanya Goto
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.11 Pages: 1209-1216

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Method to Improve the Quality of Point-Light-Style Images Using Peripheral Difference Filters with Different Window Sizes2023

    • Author(s)
      Toru Hiraoka and Kanya Goto
    • Journal Title

      IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences

      Volume: Vol.E106-A, No.11 Pages: 1440-1443

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Fundamental Experiments for Gaze Evaluation of Non-Photorealistic Images Generated by NPR2023

    • Author(s)
      Toru Hiraoka and Mio Isagawa
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.12 Pages: 1341-1345

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Generation of Checkered-Pattern Videos from RGB-D Videos2023

    • Author(s)
      Toru Hiraoka and Kanya Goto
    • Journal Title

      ICIC Express Letters

      Volume: Vol.17, No.12 Pages: 1347-1353

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Generation of Flowing-Line Images Using Vertical and Horizontal Smoothing Filters2024

    • Author(s)
      Karin Kuroki and Toru Hiraoka
    • Organizer
      The 2024 International Conference on Artificial Life and Robotics
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Method for Embedding Multiple Photographic Images in a Photographic Image2024

    • Author(s)
      Naoki Kouno, Kanya Goto and Toru Hiraoka
    • Organizer
      The 2024 International Conference on Artificial Life and Robotics
    • Related Report
      2023 Research-status Report
    • Int'l Joint Research

URL: 

Published: 2023-04-13   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi