• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Part-based 3D model retrieval queried by keywords representing parts

Research Project

Project/Area Number 16K16055
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Multimedia database
Research InstitutionUniversity of Yamanashi

Principal Investigator

FURUYA Takahiko  山梨大学, 大学院総合研究部, 助教 (00770835)

Project Period (FY) 2016-04-01 – 2019-03-31
Project Status Completed (Fiscal Year 2018)
Budget Amount *help
¥4,030,000 (Direct Cost: ¥3,100,000、Indirect Cost: ¥930,000)
Fiscal Year 2018: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2017: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2016: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Keywords3次元形状類似検索 / 部分検索 / キーワード検索 / 3次元形状解析 / 深層学習 / 3次元モデル検索 / キーワードタグ付与 / 3次元形状特徴量 / 局所特徴量 / 情報検索 / 機械学習
Outline of Final Research Achievements

This research addressed the problem of part-based 3D shape retrieval, which searches, from a database, 3D models that include parts a user desires. To achieve practical part-based 3D shape retrieval, I developed a 3D shape retrieval system queried by “keywords representing parts”. In particular, I focused on developing an auto-tagging algorithm for partial 3D shapes. Proposed algorithm associates geometric features of partial 3D shapes and semantic features of keywords by using deep learning technology. Tagging to partial 3D shapes is processed based on distances among the associated features. Empirical evaluation demonstrated that the proposed algorithm yields nearly 70% accuracy for tagging to partial 3D shapes and retrieval queried by keywords. This accuracy would be sufficient for some application scenarios.

Academic Significance and Societal Importance of the Research Achievements

3D形状類似検索の問題に対し,部分を表すキーワードという新たな問い合わせ手段を提供した点に意義がある.例えば,工業製品の設計において,本技術が機械CADデータの再利用効率を大きく改善すると期待できる.また,3Dプリンタで印刷可能な3Dモデルには「一部に羽の形を持つ指輪」等,部分的な装飾に趣向を凝らしたものが多い.本技術を利用すれば,これらの3Dモデルを効率的に探し出すことができる.さらには,医療診断において,脳血管や内臓の3D画像を蓄積したデータベースから,「動脈瘤」や「腫瘍」等のキーワードで検索できれば,経験の浅い医師の診断補助や学習支援に役立つと期待できる.

Report

(4 results)
  • 2018 Annual Research Report   Final Research Report ( PDF )
  • 2017 Research-status Report
  • 2016 Research-status Report
  • Research Products

    (20 results)

All 2019 2018 2017 2016 Other

All Journal Article (2 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 2 results) Presentation (12 results) (of which Int'l Joint Research: 6 results) Remarks (6 results)

  • [Journal Article] 敵対的生成ネットワークを用いた,3 次元点群形状特徴量の教師なし学習2019

    • Author(s)
      上西 和樹,古屋 貴彦,大渕 竜太郎
    • Journal Title

      情報処理学会論文誌

      Volume: 印刷中

    • NAID

      170000150489

    • Related Report
      2018 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Learning part-in-whole relation of 3D shapes for part-based 3D model retrieval2018

    • Author(s)
      Takahiko Furuya, Ryutarou Ohbuchi
    • Journal Title

      Computer Vision and Image Understanding (CVIU)

      Volume: 166 Pages: 102-114

    • DOI

      10.1016/j.cviu.2017.11.007

    • Related Report
      2018 Annual Research Report 2017 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] ANNOTATING 3D MODELS AND THEIR PARTS VIA DEEP FEATURE EMBEDDING2019

    • Author(s)
      Kouki Omata, Takahiko Furuya, Ryutarou Ohbuchi
    • Organizer
      IEEE International Conference on Multimedia and Expo 2019 workshop
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Data Augmentation via Photo-to-Sketch Translation for Sketch-based Image Retrieval2018

    • Author(s)
      Takahiko Furuya, Ryutarou Ohbuchi
    • Organizer
      International Conference on Graphics and Image Processing (ICGIP) 2018
    • Related Report
      2018 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 敵対的生成ネットワークを用いた,3次元点群形状特徴量の教師なし学習2018

    • Author(s)
      上西 和樹, 古屋 貴彦, 大渕 竜太郎
    • Organizer
      コンピュータグラフィックスとビジュアル情報学 (CG) 研究会
    • Related Report
      2018 Annual Research Report
  • [Presentation] Deep semantic hashing of 3D geometric features for efficient 3D model retrieval2017

    • Author(s)
      Takahiko Furuya, Ryutarou Ohbuchi
    • Organizer
      Computer Graphics International Conference (CGI) 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] Large-Scale 3D Shape Retrieval from ShapeNet Core552017

    • Author(s)
      M. Savva et al. (著者22名中,研究代表者は5番目に記載)
    • Organizer
      Eurographics Symposium on 3D Object Retrieval (EG3DOR) 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] Deformable Shape Retrieval with Missing Parts2017

    • Author(s)
      E. Rodola et al. (著者31名中,研究代表者は12番目に記載)
    • Organizer
      Eurographics Symposium on 3D Object Retrieval (EG3DOR) 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] 形の詳細を考慮した,手描きスケッチによる3Dモデル検索2017

    • Author(s)
      桑原 周太郎, 古屋 貴彦, 大渕 竜太郎
    • Organizer
      Visual Computing/グラフィクスとCAD合同シンポジウム 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] 深層学習を用いた3Dモデルへのキーワードタグ付与2017

    • Author(s)
      小俣 幸紀, 古屋 貴彦, 大渕 竜太郎
    • Organizer
      Visual Computing/グラフィクスとCAD合同シンポジウム 2017
    • Related Report
      2017 Research-status Report
  • [Presentation] Deep Aggregation of Local 3D Geometric Features for 3D Model Retrieval2016

    • Author(s)
      Takahiko Furuya, Ryutarou Ohbuchi
    • Organizer
      British Machine Vision Conference (BMVC) 2016
    • Place of Presentation
      University of York, UK
    • Year and Date
      2016-09-19
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Accurate Aggregation of Local Features by using K-sparse Autoencoder for 3D Model Retrieval2016

    • Author(s)
      Takahiko Furuya, Ryutarou Ohbuchi
    • Organizer
      ACM International Conference on Multimedia Retrieval (ICMR) 2016
    • Place of Presentation
      Columbia University, New York, USA
    • Year and Date
      2016-06-06
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] SHREC’16 Track: Partial Shape Queries for 3D Object Retrieval2016

    • Author(s)
      I. Pratikakis et al. (著者28名中,研究代表者は21番目に記載)
    • Organizer
      Eurographics Workshop on 3D Object Retrieval (3DOR) 2016
    • Place of Presentation
      Lisbon, Portugal
    • Year and Date
      2016-05-08
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Presentation] Aggregating sparse binarized local features by summing for efficient 3D model retrieval2016

    • Author(s)
      Takahiko Furuya, Ryutarou Ohbuchi
    • Organizer
      IEEE International Conference on Multimedia Big Data (BigMM) 2016
    • Place of Presentation
      Howard Civil Service International House, Taipei, Taiwan
    • Year and Date
      2016-04-20
    • Related Report
      2016 Research-status Report
    • Int'l Joint Research
  • [Remarks] Takahiko Furuya (古屋貴彦) Google Scholar

    • URL

      https://scholar.google.co.jp/citations?user=RZyMS5UAAAAJ&hl=ja

    • Related Report
      2018 Annual Research Report
  • [Remarks] Ohbuchi & Furuya Laboratory

    • URL

      http://www.kki.yamanashi.ac.jp/~ohbuchi/

    • Related Report
      2018 Annual Research Report
  • [Remarks] 山梨大学研究者総覧, 古屋貴彦

    • URL

      http://nerdb-re.yamanashi.ac.jp/Profiles/337/0033624/profile.html

    • Related Report
      2017 Research-status Report
  • [Remarks] Google scholar, Takahiko Furuya (古屋貴彦)

    • URL

      https://scholar.google.co.jp/citations?user=RZyMS5UAAAAJ

    • Related Report
      2017 Research-status Report 2016 Research-status Report
  • [Remarks] 大渕・古屋研究室

    • URL

      http://www.kki.yamanashi.ac.jp/~ohbuchi

    • Related Report
      2017 Research-status Report
  • [Remarks] 山梨大学研究者総覧, 古屋貴彦

    • URL

      http://nerdb-re.yamanashi.ac.jp/Profiles/322/0032104/profile.html

    • Related Report
      2016 Research-status Report

URL: 

Published: 2016-04-21   Modified: 2020-03-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi