• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to project page

2016 Fiscal Year Research-status Report

整形外科手術前計画に役立つ紙ベースのラピッドプロトタイピングシステムの開発

Research Project

Project/Area Number 16K01422
Research InstitutionMeiji University

Principal Investigator

ディアゴ ルイス・アリエル  明治大学, 研究・知財戦略機構, 研究推進員 (20467020)

Co-Investigator(Kenkyū-buntansha) 篠田 淳一  明治大学, 研究・知財戦略機構, 研究推進員 (60266880)
Project Period (FY) 2016-04-01 – 2019-03-31
Keywordsorigami engineering / medical robotics / neural networks / orthopedic surgery / surgery planning
Outline of Annual Research Achievements

As initially planned, we worked on the creation of 3D models from two X-ray images. We tested and implemented the method in [http://orthocad.iitb.ac.in/xrayto3d/] using images from the Cuban hospital CIMEQ. The printed 3D models were compared with paper models obtained by the algorithm in [1]. The preliminary results were presented in two conferences [7, 15]. We developed algorithms for extracting information from videos [6, 13] for use in machine learning and simulation [12]. As it is not clear in the videos, which are the most important parameters to teach the robot how to fold the paper, we used convolutional neural networks (CNN) for this task. CNNs were compared with our proposed HNNs and the preliminary results were presented at several national conferences [10, 11]. We proposed a new method to generate digital 3D models and crease patterns to create 3D paper models automatically by the robot without learning since the number of steps and manipulations that must be learned to teach the robot is very high. The new method creates a pattern from a 3D object that can be represented by a surface in revolution. We developed two machines that allow folding and gluing the paper automatically [5]. The machines include a new control algorithm based on HNN that reduces the error of the machines and speed-up the creation of the paper models [8, 14, 16]. The machines are being adapted to create complex shapes like the honeycomb [9]. More complex 3D shapes are created from the combination of HNN and IGA during quantification of personal perceptions [2, 4]

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

The results are better than initially planned. We participated in the ASME Student Mechanism & Robotics Design Competition Award 2016, developed in ASME (IDETC/CIE 2016) 21-24 August, Charlotte, USA and achieved the Third Place among more than 100 proposals from all over the world with the work entitled “Norigami Folding Machines For Complex 3D Shapes” by J. Romero, L. A. Diago, J. Shinoda, Chie Nara and I. Hagiwara. The volume of publications and national and international presentations is also higher than initially anticipated.

Strategy for Future Research Activity

Research 1.1) It was achieved the creation of 3D models from X-ray images following the following steps: 1) Extraction of the contours of the bones 2) Creation of 3D model from implicit functions. However, in order for the method to be used in the clinic, according to CIMEQ specialists, the following problems must be solved: Problem 1: quit step 1 to draw the contour, because it depends on the wrist pressure and that generates errors. Problem 2: current program is not faithful because it obviates some details that are important for guidance at the time of surgery for example the epiphysis in the tibia rod.Research 1.2*) ,1.3*) We will improve the quality of 3D models by using the bone database (http://lifesciencedb.jp/bp3d/) to create X-ray images with ray-tracing of implicit functions and matching of ray-tracing images with real images.Research 3.2) Continue exploring the collaboration between the robot and the human to create 3D models in paper from the following steps: 1) Record videos of people doing origami and play on PC using simulation and 2) Extract the steps of the video and give orders to the robot = Direct teaching.Research 3.3 *) As the information contained in the videos is so large and it is not clear which are the most important parameters to teach the robot how to fold the paper, we must extend the proposed FQHNN method as a deep learning method for this task.Research 3.4) Test the proposed new method with the bones of the database (lifesciencedb.jp/bp3d/) and evaluate the results from the comparison with the existing methods based on polygonal meshes.

Causes of Carryover

KUKA youBot 2 arms system was initially planned for the development of the robot hands but we developed a prototype of a robot including two machines (called Norigami Machines) designed with LEGO NXT Technology. The current LEGO machines use a width of A6 paper size that limit the size of the constructed 3D paper models. So, a new Norigami Machine able to deal with A4 paper size is under development and the fund will be used in next fiscal year for its construction.

Expenditure Plan for Carryover Budget

The fund will be used for the construction of a new Norigami Machine able to deal with A4 paper. The created prototype using A4 paper will be introduced in the Hospital for testing and comparison of the models created with previous approach (see paper [1]).

  • Research Products

    (16 results)

All 2017 2016

All Journal Article (3 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 3 results,  Open Access: 3 results,  Acknowledgement Compliant: 3 results) Presentation (13 results) (of which Int'l Joint Research: 4 results)

  • [Journal Article] Producing Physical Copies of the Digital Models via Generating 2D Patterns for “Origami 3D Printer” system2016

    • Author(s)
      [1]Bo Yu, Maria Savchenko, Junichi Shinoda, L. A. Diago, Ichiro Hagiwara,
    • Journal Title

      Journal of Advanced Simulation in Science and Engineering

      Volume: 3 Pages: 58-77

    • DOI

      10.15748/jasse.3.58

    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] "A Soft-Computing Approach for Quantification of Personal Perceptions",2016

    • Author(s)
      [2]L. A. Diago, J. Romero, Junichi Shinoda, H. Abe and Ichiro Hagiwara,
    • Journal Title

      Advances in Intelligent Systems and Computing

      Volume: 483 Pages: 199-210

    • DOI

      10.1007/978-3-319-41661-8_20

    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] “Norigami Folding Machines For Complex 3D Shapes”2016

    • Author(s)
      [3[J. Romero, L. A. Diago, J. Shinoda, Chie Nara and I. Hagiwara
    • Journal Title

      International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Volume 5B: 40th Mechanisms and Robotics Conference

      Volume: 5B Pages: -

    • DOI

      10.1115/DETC2016-60580

    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Presentation] Consideration on Control Method for Folding and Gluing Machine2017

    • Author(s)
      [16]Julian Romero, Luis Diago, and Ichiro Hagiwara
    • Organizer
      13th JSIAM conference
    • Place of Presentation
      The University of Electro- Communications, Tokyo
    • Year and Date
      2017-03-07 – 2017-03-07
  • [Presentation] ロボットに人間が紙を折る動作・手順を学習させる検討 (Deep Learning for Origami Performing Skill Transfer)2017

    • Author(s)
      [15]L. A. Diago
    • Organizer
      MIMS折紙式プリンターと数理の融合畳研究講演会 モデルの産業応用研究
    • Place of Presentation
      Meiji University, Nakano Campus
    • Year and Date
      2017-02-27 – 2017-02-27
  • [Presentation] Development of a Paper-based Rapid Prototyping System for Orthopedic Surgical Planning2016

    • Author(s)
      [7]L. A. Diago
    • Organizer
      International Conference on Mathematical Modeling and Applications 2016 (ICMMA 2016)
    • Place of Presentation
      Meiji University, Nakano Campus, Japan,
    • Year and Date
      2016-11-09 – 2016-11-12
    • Int'l Joint Research
  • [Presentation] “Emotion simulation using emoticons”2016

    • Author(s)
      [12]L. A. Diago, H. Abe and I. Hagiwara,
    • Organizer
      35th JSST Annual Conference International Conference on Simulation Technology (JSST2016)
    • Place of Presentation
      Kyoto University
    • Year and Date
      2016-10-27 – 2016-10-29
  • [Presentation] Extraction of instruction elements that affect the learning motivation2016

    • Author(s)
      [13]H. Abe, Luis Diago, Ichiro Hagiwara,
    • Organizer
      35th JSST Annual Conference International Conference on Simulation Technology (JSST2016)
    • Place of Presentation
      Kyoto University
    • Year and Date
      2016-10-27 – 2016-10-29
  • [Presentation] Norigami Model Construction for 3D-Shape Structures Using Paper-like Materials2016

    • Author(s)
      [14]Julian Romero, Luis Diago, Ichiro Hagiwara
    • Organizer
      35th JSST Annual Conference International Conference on Simulation Technology (JSST2016)
    • Place of Presentation
      Kyoto University
    • Year and Date
      2016-10-27 – 2016-10-29
  • [Presentation] "Deep Learning the Structure of Iyashi by Holographic Neural Networks“ (ホログラフィックニューラルネットワークによる 癒し構造の深層学習による検討)"2016

    • Author(s)
      [10]ルイスディアゴ, 安部博枝, 萩 原一郎
    • Organizer
      第 29 回 計算力学講演会(CMD2016)
    • Place of Presentation
      名古屋大学 東山キャンパス
    • Year and Date
      2016-09-22 – 2016-09-24
  • [Presentation] 多層ニューラルネットワークによる癒し構造 の深層学習による検討2016

    • Author(s)
      [11]安部博枝(明治大), ルイスディアゴ(明治大), 萩 原一郎(明治大)
    • Organizer
      第 29 回 計算力学講演会(CMD2016)
    • Place of Presentation
      名古屋大学 東山キャンパス
    • Year and Date
      2016-09-22 – 2016-09-24
  • [Presentation] ハニカムパターン設計のための切紙モデル2016

    • Author(s)
      [9]ロメロ ジュリアン, ディアゴ ルイス, 奈良 知惠, 萩原 一郎.
    • Organizer
      日本応用数理学会 2016年度 年会
    • Place of Presentation
      北九州国際会議場
    • Year and Date
      2016-09-12 – 2016-09-14
  • [Presentation] “Kansei analysis of facial expressions in motivational videos”2016

    • Author(s)
      [6]L. A. Diago, H. Abe and I. Hagiwara,
    • Organizer
      Kansei Engineering and Emotional Research Conference (KEER2016)
    • Place of Presentation
      University of Leeds, United Kingdom
    • Year and Date
      2016-08-31 – 2016-09-04
    • Int'l Joint Research
  • [Presentation] 世界初の糊付けまで可能な折紙ロボットの開発Design and Development of “Norigami” Folding Machines using Feedback Error Learning with Paper Spring-back Compensation2016

    • Author(s)
      [8]Luis DIAGO, Julian ROMERO, Junichi SHINODA, Chie NARA and Ichiro HAGIWARA
    • Organizer
      Dynamics and Design Conference 2016 (D&D2016)
    • Place of Presentation
      Yamaguchi University
    • Year and Date
      2016-08-23 – 2016-08-26
  • [Presentation] “Norigami Folding Machines For Complex 3D Shapes”2016

    • Author(s)
      [5]J. Romero, L. A. Diago, J. Shinoda, Chie Nara and I. Hagiwara,
    • Organizer
      In Proceedings of ASME (IDETC/CIE 2016)
    • Place of Presentation
      Charlotte, USA
    • Year and Date
      2016-08-21 – 2016-08-24
    • Int'l Joint Research
  • [Presentation] "A Soft-Computing Approach for Quantification of Personal Perceptions",2016

    • Author(s)
      [4]L. A. Diago, J. Romero, Junichi Shinoda, H. Abe and Ichiro Hagiwara,
    • Organizer
      AHFE 2016 International Conference on Affective and Pleasurable Design
    • Place of Presentation
      Walt Disney World, Florida, USA
    • Year and Date
      2016-07-27 – 2016-07-31
    • Int'l Joint Research

URL: 

Published: 2018-01-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi