• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Interactive Functional Design with Flow Precomputation

Research Project

Project/Area Number 20K19845
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 61020:Human interface and interaction-related
Research InstitutionJapan Advanced Institute of Science and Technology

Principal Investigator

Xie Haoran  北陸先端科学技術大学院大学, 先端科学技術研究科, 准教授 (40789898)

Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2022: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2021: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2020: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Keywords設計支援 / 機能デザイン / 複雑流体 / ユーザインタフェース / 深層学習 / 生成モデル / スケッチ / 流体 / データ駆動 / ソフトロボティクス / 生成系AI / 流体デザイン / モデリング / 事前計算 / デザイン支援 / ロボットアーム
Outline of Research at the Start

本研究では複雑流体に着目し,機能的設計のデータ駆動型フレームワークを構築する.そこで,非定常流体モデルおよび動力学計算を事前計算プロセスとして処理し,ユーザインタフェースを介して実時間のデザイン支援の設計最適化が可能になる.本研究は,計算機上のモデリングにとどまらず,デジタルファブリケーション技術と既存部品の組み合わせで魚型ロボットの試作と検証まで実施する.本研究は機能的設計の新たな基盤技術として,多研究分野の知識を融合して,専門知識が要らなくて個性的かつ機能的な生体模倣ロボットの設計製作が可能になる.

Outline of Final Research Achievements

This research proposal has conducted research projects in the fields of computer graphics and user interface, employing data-driven and deep learning approaches for functional design interfaces. Specifically, research activities have been conducted on complex smoke design using deep generative models, and robotics devices utilizing the functional design. The outcomes of this research proposal aimed to establish the foundational technology for data-driven approaches for functional design, achieving numerous research results across multi-discipline research fields. We have published 7 journal papers in international academic journals, presented 40 papers at international conferences, and delivered 13 invited lectures both domestically and internationally. In addition, our research outcomes have attracted attention from around the world and have been reported in numerous medias, including ITmedia NEWS, Tech Xplore, and IEEE Spectrum.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的意義としては,調整中である機能デザインを初心者でも使えるデザインのユーザインタフェースを介して設計支援技術の新たな基盤を構築していく.特に,生体模倣等の設計作業の手間を劇的に軽減できることで,インタラクティブな創造活動支援のため,一般ユーザでも簡単にデザインできるようにするインタフェース技術を研究開発してきた.近年は深層学習等の人工知能やロボット技術が気軽に使える時代となり,本研究の社会的意義としてこれらの技術の民主化に向かい,誰でも高機能・高付加価値の個人ニーズに合うようなコンテンツ制作ができる.

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (64 results)

All 2023 2022 2021 2020 Other

All Int'l Joint Research (1 results) Journal Article (7 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 7 results,  Open Access: 7 results) Presentation (46 results) (of which Int'l Joint Research: 38 results,  Invited: 8 results) Remarks (8 results) Funded Workshop (2 results)

  • [Int'l Joint Research] Jilin University(中国)

    • Related Report
      2022 Annual Research Report
  • [Journal Article] DualMotion: Global-to-Local Casual Motion Design for Character Animations2023

    • Author(s)
      Yichen PENG, Chunqi ZHAO, Haoran XIE, Tsukasa FUKUSATO, Kazunori MIYATA, Takeo IGARASHI
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E106.D Issue: 4 Pages: 459-468

    • DOI

      10.1587/transinf.2022IIP0011

    • ISSN
      0916-8532, 1745-1361
    • Year and Date
      2023-04-01
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Omnidirectional Haptic Stimulation System via Pneumatic Actuators for Presence Presentation2023

    • Author(s)
      Shogo Yoshida, Haoran Xie, Kazunori Miyata
    • Journal Title

      Sensors

      Volume: 23 Issue: 2 Pages: 1-16

    • DOI

      10.3390/s23020584

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] DualSmoke: Sketch-Based Smoke Illustration Design with Two-Stage Generative Model2023

    • Author(s)
      Haoran Xie, Keisuke Arihara, Syuhei Sato, Kazunori Miyata
    • Journal Title

      Journal of Computational Visual Media

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Using Biomimicry Science in the Design of a Kinetic Facade to Regulate the Amount of Daylight Entering a Working Space2022

    • Author(s)
      Sukhum Sankaewthong, Teerayut Horanont, Kazunori Miyata, Jessada Karnjana, Chawee Busayarat, Haoran Xie
    • Journal Title

      Buildings

      Volume: 12 Issue: 12 Pages: 1-26

    • DOI

      10.3390/buildings12122089

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Image Deformation Estimation via Multiobjective Optimization2022

    • Author(s)
      Takumi Nakane, Haoran Xie, Chao Zhang
    • Journal Title

      IEEE Access

      Volume: 10 Pages: 53307-53323

    • DOI

      10.1109/access.2022.3174360

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Chinese Traditional Color Harmony Inheritance Method for High-speed Railway2022

    • Author(s)
      Liangyu Shi, Wei Pei, Jinfeng Li, Kazunori Miyata, Siqun Ma, Haoran Xie
    • Journal Title

      Journal of Robotics, Networking and Artificial Life

      Volume: 8 Issue: 4 Pages: 304-311

    • DOI

      10.2991/jrnal.k.211108.015

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] dualFace: Two-Stage Drawing Guidance for Freehand Portrait Sketching2021

    • Author(s)
      Zhengyu Huang, Yichen Peng, Tomohiro Hibino, Chunqi Zhao, Haoran Xie*, Tsukasa Fukusato, Kazunori Miyata
    • Journal Title

      Journal of Computational Visual Media

      Volume: 未定 Pages: 1-13

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Open Access
  • [Presentation] Interactive Layout Drawing Interface with Shadow Guidance2023

    • Author(s)
      Jiahao Weng, Haoran Xie
    • Organizer
      International Workshop on Advanced Image Technology 2023 (IWAIT 2023)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Augmenting Human with Compact Supernumerary Robotic Limbs2022

    • Author(s)
      Haoran Xie, Zeyu Ding, Shogo Yoshida, Toby Chong, Takuma Torii and Tsukasa Fukusato
    • Organizer
      13th Augmented Human International Conference (AH 2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] ILoveEye: Eyeliner Makeup Guidance System with Eye Shape Features2022

    • Author(s)
      Hange Wang, Haoran Xie, Kazunori Miyata
    • Organizer
      24th International on Human-Computer Interaction (HCII2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fine-tuning Deep Neural Networks by Interactively Refine the 2D Latent Space of Ambiguous Images2022

    • Author(s)
      Jaifu Wei, Haoran Xie, Chia-Ming Chang, Xi Yang
    • Organizer
      31st International Joint Conference on Artificial Intelligence IJCAI-ECAI 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Sketch2Makizushi: Interactive Guidance System for Decorative Sushi Rolls with User Sketches2022

    • Author(s)
      Yoshiki Funahashi, Wataru Omori, Shogo Yoshida, Yichen Peng, Haoran Xie, Shogo Okada, Kazunori Miyata.
    • Organizer
      NICOGRAPH International 2022
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Find Your ASMR: Perceptual Retrieval Interface for Autonomous Sensory Meridian Response Videos2022

    • Author(s)
      Qi Zhou, Jiahao Weng, Haoran Xie
    • Organizer
      24th International on Human-Computer Interaction (HCII2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] HiVideo: Hierarchical Browsing Interface for Educational Videos2022

    • Author(s)
      Jiahao Weng, Chao Zhang, Xi Yang, Haoran Xie
    • Organizer
      SIGGRAPH 2022, Poster
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Drawing Support System for Sketching Aging Anime Faces2022

    • Author(s)
      Sicheng Li, Haoran Xie, Xi Yang, Chia-Ming Chang, Kazunori Miyata
    • Organizer
      The 21th International Conference on Cyberworlds (CW2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] MagGlove: A Haptic Glove with Movable Magnetic Force for Manipulation Learning2022

    • Author(s)
      Mikiya Kusunoki, Shogo Yoshida, Haoran Xie
    • Organizer
      The 21th International Conference on Cyberworlds (CW2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Sketch-based City Generation Using Procedural Modeling and Generative Model2022

    • Author(s)
      Junya Kanda, Yi He, Haoran Xie, Kazunori Miyata
    • Organizer
      21th International Conference on Cyberworlds (CW2022)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Human as an Interface2022

    • Author(s)
      謝浩然
    • Organizer
      JAIST Creative Society Design Symposium
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Augment Human Capabilities with User Interfaces2022

    • Author(s)
      謝浩然
    • Organizer
      UUM-JAIST Training Certification Program
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] DualFace: Two-Stage Drawing Guidance for Freehand Portrait Sketching2022

    • Author(s)
      謝浩然
    • Organizer
      VC+VCC2022
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 人間拡張のためのオーグメンテッドインタフェース2022

    • Author(s)
      謝浩然
    • Organizer
      コンピュータグラフィックスとビジュアル情報学研究会CGVI第187回研究発表会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 拡張知能のインタフェース技術2022

    • Author(s)
      謝浩然
    • Organizer
      中国天津大学建築学院デジタル化グループ
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 人間拡張のインタフェース技術2022

    • Author(s)
      謝浩然
    • Organizer
      慶應義塾大学SFC研究所
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] Sketch-based 3D Shape Modeling from Sparse Point Clouds2022

    • Author(s)
      Xusheng Du, Yi He, Xi Yang, Chia-Ming Chang, Haoran Xie
    • Organizer
      International Workshop on Advanced Image Technology 2022 (IWAIT 2022)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Hierarchical Visual Interface for Lecture Video Retrieval and Summarization2022

    • Author(s)
      Jiaohao Weng, Chao Zhang, Xi Yang, Haoran Xie
    • Organizer
      International Workshop on Advanced Image Technology 2022 (IWAIT 2022)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Interactive 3D Character Modeling from 2D Orthogonal Drawings with Annotations2022

    • Author(s)
      Zhengyu Huang, Haoran Xie, Tsukasa Fukusato
    • Organizer
      International Workshop on Advanced Image Technology 2022 (IWAIT 2022)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Interactive Drawing Interface with 3D Animal Model Retrieval2022

    • Author(s)
      Sicheng Li, Haoran Xie, Kazunori Miyata
    • Organizer
      International Workshop on Advanced Image Technology 2022 (IWAIT 2022)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Interactive Shadow Generation System for Spatial Augmented Reality2022

    • Author(s)
      Shogo Yoshida, Haoran Xie, Kazunori Miyata
    • Organizer
      International Workshop on Advanced Image Technology 2022 (IWAIT 2022)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Skeleton2Stroke: Interactive Stroke Correspondence Editing with Pose Features2021

    • Author(s)
      Ryoma Miyauchi, Yichen Peng, Tsukasa Fukusato, Haoran Xie
    • Organizer
      SIGGRAPH Asia 2021, Technical Communications
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Two-Stage Motion Editing Interface for Character Animation2021

    • Author(s)
      Yichen Peng, Chunqi Zhao, Zhengyu Huang, Tsukasa Fukusato, Haoran Xie, Kazunori Miyata
    • Organizer
      20th annual Symposium on Computer Animation (SCA)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches2021

    • Author(s)
      Haoran Xie, Yichen Peng, Hange Wang, Kazunori Miyata
    • Organizer
      23rd International on Human-Computer Interaction (HCII2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sketch-Based Human Motion Retrieval via Shadow Guidance2021

    • Author(s)
      Yichen Peng, Zhengyu Huang, Chunqi Zhao, Haoran Xie, Tsukasa Fukusato and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Interactive Dance Support System Using Spatial Augmented Reality2021

    • Author(s)
      Yi He, Xiaojie Zheng, Asuka Yagami, Yichen Peng, Shogo Yoshida, Haoran Xie, Hideaki Kanai and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sketch-based Anime Hairstyle Editing with Generative Inpainting2021

    • Author(s)
      Shuyang Luo, Haoran Xie and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Skeleton-Based Interactive Fabrication for Large-Scale Newspaper Sculpture2021

    • Author(s)
      Sicheng Li, Shogo Yoshida, Keisuke Arihara, Kento Nakashima, Yichen Peng, Haoran Xie, Toshiki Sato and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] One-shot Line Extraction from Color Illustrations2021

    • Author(s)
      Zhengyu Huang, Yichen Peng, Haoran Xie, Tsukasa Fukusato and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sketch2Bento: Sketch-based Arrangement Guidance for Lunch Boxes2021

    • Author(s)
      Hange Wang, Haruka Kanayama, Yichen Peng, Shogo Yoshida, Haoran Xie, Shogo Okada, Kazunori Miyata
    • Organizer
      NICOGRAPH International 2021
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] xLimb: Wearable Robot Arm with Storable and Extendable Mechanisms2021

    • Author(s)
      Zeyu Ding, Shogo Yoshida, Takuma Torii and Haoran Xie
    • Organizer
      12th Augmented Human International Conference (AH2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] NaviChoker: Augmenting Pressure Sensation via Pneumatic Actuator2021

    • Author(s)
      Shogo Yoshida, Haoran Xie and Kazunori Miyata
    • Organizer
      12th Augmented Human International Conference (AH2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] xBalloon: Animated Objects with Balloon Plastic Actuator2021

    • Author(s)
      Haoran Xie, Takuma Torii, Aoshi Chiba and Qiukai Qi
    • Organizer
      12th Augmented Human International Conference (AH2021)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] BPActuators: Lightweight and Low-Cost Soft Actuators by Balloons and Plastics2021

    • Author(s)
      Qiukai Qi, Shogo Yoshida, Genki Kakihana, Takuma Torii, Van Anh Ho, Haoran Xie
    • Organizer
      4th IEEE International Conference on Soft Robotics (RoboSoft)
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] Affine Subspace Clustering with Nearest Subspace Neighbor2021

    • Author(s)
      Katsuya Hotta, Haoran Xie and Chao Zhang
    • Organizer
      International Workshop on Advanced Image Technology 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sketch-based Normal Map Generation with Geometric Sampling2021

    • Author(s)
      Yi He, Haoran Xie, Chao Zhang, Xi Yang and Kazunori Miyata
    • Organizer
      International Workshop on Advanced Image Technology 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] A Wearable Augmented Reality System with Anamorphosis Projection2021

    • Author(s)
      Shogo Yoshida, Haoran Xie and Kazunori Miyata
    • Organizer
      International Workshop on Advanced Image Technology 2021
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Computational Creativity with User Sketches2021

    • Author(s)
      Haoran Xie
    • Organizer
      1st International Symposium on Intelligence Design
    • Related Report
      2020 Research-status Report
    • Invited
  • [Presentation] Body2Particles: Designing Particle Systems Using Body Gestures2020

    • Author(s)
      Haoran Xie, Dazhao Xie and Kazunori Miyata
    • Organizer
      19th International Federation for Information Processing - International Conference on Entertainment Computing (IFIP-ICEC 2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Apparel Generation via Cluster-Indexed Global and Local Feature Representations2020

    • Author(s)
      Chunzhi Gu, Zhengyu Huang, Sicheng Li, Haoran Xie, Xi Yang and Chao Zhang
    • Organizer
      IEEE 9th Global Conference on Consumer Electronics (GCCE 2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Candidate Subspace Screening for Linear Subspace Clustering with Energy Minimization2020

    • Author(s)
      Katsuya Hotta, Haoran Xie and Chao Zhang
    • Organizer
      Irish Machine Vision and Image Processing Conference (IMVIP 2020)
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] xClothes: Augmenting Human Thermoregulation Using Shape Changing Clothes2020

    • Author(s)
      Haoran Xie, Hiromu Matsuzaki and Takuma Torii
    • Organizer
      Augmented Human 2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Sketch2Domino: Interactive Chain Reaction Design and Guidance2020

    • Author(s)
      Yichen Peng, Yuki Mishima, Yamato Igarashi, Ryoma Miyauchi, Masahiro Okawa, Haoran Xie and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Interactive Projection System for Calligraphy Practice2020

    • Author(s)
      Zhizhou He, Haoran Xie and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] Learning Rubik's Cube through User Operation History2020

    • Author(s)
      Shuhei Ajisaka, Shinichiro Hara, Moe Matsuchi, Shuyang Luo, Shogo Yoshida, Haoran Xie and Kazunori Miyata
    • Organizer
      NICOGRAPH International 2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research
  • [Presentation] User Augmented Interface2020

    • Author(s)
      Haoran Xie
    • Organizer
      Northwest A&F University
    • Related Report
      2020 Research-status Report
    • Invited
  • [Remarks] 研究者ホームページ

    • URL

      http://www.jaist.ac.jp/~xie/

    • Related Report
      2022 Annual Research Report
  • [Remarks] プロジェクトHiVideoのホームページ

    • URL

      http://www.jaist.ac.jp/~xie/2022-hivideo.html

    • Related Report
      2022 Annual Research Report
  • [Remarks] XLIMB

    • URL

      http://www.jaist.ac.jp/~xie/xlimb.html

    • Related Report
      2021 Research-status Report
  • [Remarks] xBalloon

    • URL

      http://www.jaist.ac.jp/~xie/xballoon.html

    • Related Report
      2021 Research-status Report
  • [Remarks] 研究者ホームページ

    • URL

      http://www.jaist.ac.jp/~xie/index.html

    • Related Report
      2020 Research-status Report
  • [Remarks] dualFace

    • URL

      http://www.jaist.ac.jp/~xie/dualface.html

    • Related Report
      2020 Research-status Report
  • [Remarks] Sketch2Domino

    • URL

      http://www.jaist.ac.jp/~xie/sketch2domino.html

    • Related Report
      2020 Research-status Report
  • [Remarks] Body2Particles

    • URL

      http://www.jaist.ac.jp/~xie/firework.html

    • Related Report
      2020 Research-status Report
  • [Funded Workshop] 2nd International Symposium on Intelligence Design (ISID 2022)2022

    • Related Report
      2021 Research-status Report
  • [Funded Workshop] 1st International Symposium on Intelligence Design (ISID 2021)2021

    • Related Report
      2020 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi