• 研究課題をさがす
  • 研究者をさがす
  • KAKENの使い方
  1. 課題ページに戻る

2023 年度 実施状況報告書

Language-driven visual content customization using construction sequences.

研究課題

研究課題/領域番号 23K16921
研究機関東京大学

研究代表者

沈 奕超  東京大学, 大学院情報理工学系研究科, 助教 (40969119)

研究期間 (年度) 2023-04-01 – 2028-03-31
キーワードcomputer graphics / typography / computer vision / icon colorization / virtual try-on
研究実績の概要

In the past one year, I have been working on various projects related to this funding, including designing high-usability icons, icon colorization, procedural shape generation, and foundation model for typography. These projects lead to four journal papers and one conference short paper. The result outcomes exhibits distinct contributions that we focus on providing novel computational models and foundation models for graphic design elements, such as fonts and icons.

現在までの達成度 (区分)
現在までの達成度 (区分)

1: 当初の計画以上に進展している

理由

In the past year, I developed a foundation model for typography which is fundamentally change how multilingual font applications can be achieved. This model can be used to do language-driven font retrieval and vector glyph optimization. Meanwhile, I also developed another foundation model for connecting text descriptions with icons. This foundation model can then be used to design high-usability icons that reduce the effort of icon designers.
These two foundation models are very unique compared to other existing foundation models where our models focus on graphic design domains rather than natural scene images.

今後の研究の推進方策

The development of the foundation model of typography (i.e., FontCLIP) provides a great foundation for me to proceed on related research projects, such as utilize language input to design variable fonts and sentence generation. Meanwhile, with the foundation model for icon, I plan to combine it with a large language model to generate diverse icons that users can use for various graphic design tasks.

次年度使用額が生じた理由

In the past year, since the computational resources, including the machines and GPUs are still suffice for the project need, so I did not spend that much for purchasing new devices. In this year, since I plan to work improving the foundation models that facilitate language driven content generation, so I plan to purchase new computational devices to utilize the research fundings.

  • 研究成果

    (12件)

すべて 2024 2023 その他

すべて 国際共同研究 (3件) 雑誌論文 (4件) (うち国際共著 4件、 査読あり 4件、 オープンアクセス 3件) 学会発表 (1件) (うち国際学会 1件) 備考 (4件)

  • [国際共同研究] National Taiwan University/National Chung Cheng University/National Yang Ming Chiao Tung University(その他の国・地域)

    • 国名
      その他の国・地域
    • 外国機関名
      National Taiwan University/National Chung Cheng University/National Yang Ming Chiao Tung University
  • [国際共同研究] Carleton University(カナダ)

    • 国名
      カナダ
    • 外国機関名
      Carleton University
  • [国際共同研究] Reichman University(イスラエル)

    • 国名
      イスラエル
    • 外国機関名
      Reichman University
  • [雑誌論文] FontCLIP: A Semantic Typography Visual-Language Model for Multilingual Font Applications2024

    • 著者名/発表者名
      Yuki Tatsukawa、 I-Chao Shen、 Anran Qi、Yuki Koyama、Takeo Igarashi、Ariel Shamir
    • 雑誌名

      Computer Graphics Forum

      巻: - ページ: -

    • 査読あり / オープンアクセス / 国際共著
  • [雑誌論文] EvIcon: Designing High‐Usability Icon with Human‐in‐the‐loop Exploration and IconCLIP2023

    • 著者名/発表者名
      Shen I‐Chao、Cherng Fu‐Yin、Igarashi Takeo、Lin Wen‐Chieh、Chen Bing‐Yu
    • 雑誌名

      Computer Graphics Forum

      巻: 42 ページ: -

    • DOI

      10.1111/cgf.14924

    • 査読あり / 国際共著
  • [雑誌論文] Data‐guided Authoring of Procedural Models of Shapes2023

    • 著者名/発表者名
      Hossain Ishtiaque、Shen I‐Chao、Igarashi Takeo、van Kaick Oliver
    • 雑誌名

      Computer Graphics Forum

      巻: 42 ページ: -

    • DOI

      10.1111/cgf.14935

    • 査読あり / オープンアクセス / 国際共著
  • [雑誌論文] Palette‐Based and Harmony‐Guided Colorization for Vector Icons2023

    • 著者名/発表者名
      Lin Miao、Shen I‐Chao、Chin Hsiao‐Yuan、Chen Ruo‐Xi、Chen Bing‐Yu
    • 雑誌名

      Computer Graphics Forum

      巻: 42 ページ: -

    • DOI

      10.1111/cgf.14950

    • 査読あり / オープンアクセス / 国際共著
  • [学会発表] 3D Reconstruction from Sketch with Hidden Lines by Two-Branch Diffusion Model2024

    • 著者名/発表者名
      Yuta Fukushima
    • 学会等名
      Eurographics
    • 国際学会
  • [備考] FontCLIP

    • URL

      https://yukistavailable.github.io/fontclip.github.io/

  • [備考] Icon colorization

    • URL

      https://jdily.github.io/proj_site/icon_colorization.html

  • [備考] Procedural Models Authoring

    • URL

      https://jdily.github.io/proj_site/data_proc_model.html

  • [備考] EvIcon

    • URL

      https://jdily.github.io/proj_site/evicon_proj.html

URL: 

公開日: 2024-12-25  

サービス概要 検索マニュアル よくある質問 お知らせ 利用規程 科研費による研究の帰属

Powered by NII kakenhi