• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research on High Performance 3D Shape Retrieval under Diversified Queries including 2D Inputs and Semantic Attributes such as Holes and Concavities

Research Project

Project/Area Number 26280038
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypePartial Multi-year Fund
Section一般
Research Field Multimedia database
Research InstitutionToyohashi University of Technology

Principal Investigator

AONO MASAKI  豊橋技術科学大学, 工学(系)研究科(研究院), 教授 (00372540)

Co-Investigator(Renkei-kenkyūsha) TATSUMA Atsushi  豊橋技術科学大学, 大学院工学研究科, 助教 (60711166)
Project Period (FY) 2014-04-01 – 2017-03-31
Project Status Completed (Fiscal Year 2016)
Budget Amount *help
¥7,020,000 (Direct Cost: ¥5,400,000、Indirect Cost: ¥1,620,000)
Fiscal Year 2016: ¥2,080,000 (Direct Cost: ¥1,600,000、Indirect Cost: ¥480,000)
Fiscal Year 2015: ¥1,950,000 (Direct Cost: ¥1,500,000、Indirect Cost: ¥450,000)
Fiscal Year 2014: ¥2,990,000 (Direct Cost: ¥2,300,000、Indirect Cost: ¥690,000)
Keywords情報検索 / 機械学習 / 3D / 特徴量 / 3D形状類似検索 / アノテーション / 注釈文 / シーングラフ / スケッチ検索 / 写真検索 / 意味属性 / 意味付与 / オントロジー
Outline of Final Research Achievements

We have developed high performance 3D shape retrieval called MRLBP, which stands for Multi-Resolution Local Binary Pattern. MRLBP has brought us, to our knowledge, the best search performance which can run without prior training. We have submitted a patent on MRLBP. 3D shape retrieval usually requires an arbitrary 3D shape as the query, but this is sometimes very burdensome. To cope with this problem, we have developed a novel method for 3D shape retrieval from an arbitrary 2D sketch, which we call OPHOG (Overlapped Pyramidal Histogram of Oriented Gradients). With OPHOG, we achieved world number 1 record for SHREC2014 international contest. For partial 3D shape retrieval, we have developed a new method based on 3D point clouds with a new feature vector, which we submitted another patent.

Report

(4 results)
  • 2016 Annual Research Report   Final Research Report ( PDF )
  • 2015 Annual Research Report
  • 2014 Annual Research Report
  • Research Products

    (51 results)

All 2017 2016 2015 2014 Other

All Journal Article (7 results) (of which Int'l Joint Research: 5 results,  Peer Reviewed: 7 results,  Open Access: 3 results,  Acknowledgement Compliant: 2 results) Presentation (39 results) (of which Int'l Joint Research: 14 results) Remarks (1 results) Patent(Industrial Property Rights) (4 results)

  • [Journal Article] Microblog Retrieval Using Ensemble of Feature Sets through Supervised Feature Selection2017

    • Author(s)
      Abu Nowshed Chy, Md Zia Ullah and Masaki Aono
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E100.D Issue: 4 Pages: 793-806

    • DOI

      10.1587/transinf.2016DAP0032

    • NAID

      130005529887

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Shape Retrieval of Non-rigid 3D Human Models2016

    • Author(s)
      D.Pickup, X.Sun, P.L.Rosin, R.R.Martin, Z.Cheng, Z.Lian, Masaki Aono
    • Journal Title

      International Journal of Computer Vision

      Volume: 120 Issue: 2 Pages: 169-193

    • DOI

      10.1007/s11263-016-0903-8

    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] A Bipartite Graph-Based Ranking Approach to Query Subtopics Diversification Focused on Word Embedding Features2016

    • Author(s)
      Md Zia Ullah and Masaki Aono
    • Journal Title

      IEICE Transactions on Information and Systems

      Volume: E99.D Issue: 12 Pages: 3090-3100

    • DOI

      10.1587/transinf.2016EDP7190

    • NAID

      130005170962

    • ISSN
      0916-8532, 1745-1361
    • Related Report
      2016 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research / Acknowledgement Compliant
  • [Journal Article] Retrieval and classification methods for textured 3D models: A comparative study2016

    • Author(s)
      S. Biasotti, A. Cerri, Masaki Aono, A. Ben Hamza, V. Garro, A. Giachetti, D. Giorgi, A. Godil, C. Li , Chika Sanada, M. Spagnuolo, Atsushi Tatsuma, S. Velasco-Forero
    • Journal Title

      Visual Computer

      Volume: 32 Issue: 2 Pages: 217-241

    • DOI

      10.1007/s00371-015-1146-3

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Estimating a Ranked List of Human Genetic Diseases by Associating Phenotype-Gene with Gene-Disease Bipartite Graphs2015

    • Author(s)
      Md Zia Ullah, Masaki Aono, Md Hanif Seddiqui
    • Journal Title

      ACM Transactions on Intelligent Systems and Technology

      Volume: 6 Issue: 4 Pages: 1-21

    • DOI

      10.1145/2700487

    • Related Report
      2015 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A comparison of 3D shape retrieval methods based on a large-scale benchmark supporting multimodal queries2015

    • Author(s)
      B. Li, Y. Lu, C. Li, A. Godil, T. Schreck, M. Aono, M. Burtscher, Q. Chen, N. Chowdhury, B. Fang, H. Fu, T. Furuya, H. Li, J. Liu, H. Johan, R. Kosaka, H. Koyanagi, R. Ohbuchi, A. Tatsuma, Y. Wan, C. Zhang, C. Zou
    • Journal Title

      Computer Vision and Image Understanding

      Volume: 131 Pages: 1-27

    • DOI

      10.1016/j.cviu.2014.10.006

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Intelligent Interface for Textual Attitude Analysis2014

    • Author(s)
      Alena Neviarouskaya, Masaki Aono, Helmut Prendinger, and Mitsuru Ishizuka
    • Journal Title

      ACM Transactions on Intelligent Systems and Technology

      Volume: 5 Issue: 3 Pages: 1-20

    • DOI

      10.1145/2535912

    • Related Report
      2014 Annual Research Report
    • Peer Reviewed
  • [Presentation] 単語分散表現と文法的な表現に着目したカスタマーレビューの観点ごとの評価値推定2017

    • Author(s)
      大塚 達也, 青野雅樹
    • Organizer
      DEIM2017 (第9回データ工学と情報マネジメントに関するフォーラム)
    • Place of Presentation
      高山グリーンホテル
    • Related Report
      2016 Annual Research Report
  • [Presentation] 化粧品レビューサイトにおけるクチコミの有用性判定2017

    • Author(s)
      髙島侑里, 青野雅樹
    • Organizer
      言語処理学会第23回年次大会(NLP2017)
    • Place of Presentation
      筑波大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] 単語のポジティブ・ネガティブでの出現比率に着目したツイートの極性分類2017

    • Author(s)
      姫野晋之介, 青野雅樹
    • Organizer
      言語処理学会第23回年次大会(NLP2017)
    • Place of Presentation
      筑波大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] LSTMとCNNを用いたボクセル表現に基づく三次元形状類似検索手法の提案2017

    • Author(s)
      宮城諒, 青野雅樹
    • Organizer
      パターン認識・メディア理解(PRMU)研究会
    • Place of Presentation
      名城大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] 再構成誤差の重みを類似度としたスケッチによる三次元物体の検索2017

    • Author(s)
      小林将也, 立間淳司,青野雅樹
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      名城大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] 近傍集合類似度を用いた多様体ランキングによる三次元物体の形状類似検索,2017

    • Author(s)
      真田知佳,立間淳司,青野雅樹
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      名城大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] 時空間自己相似ヒストグラムと統計量を用いた人物動作認識2017

    • Author(s)
      髙垣幸秀, 立間淳司, 青野雅樹
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      名城大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] 重要単語からなる料理テキストと料理画像のマルチモーダル特徴量を用いた料理名推定2016

    • Author(s)
      小田将規, 青野雅樹
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      九州大学伊都キャンパス
    • Year and Date
      2016-03-15
    • Related Report
      2015 Annual Research Report
  • [Presentation] Shape Retrieval of Low-Cost RGB-D Captures2016

    • Author(s)
      Pedro B. Pascoal, Pedro Proença, Filipe Gaspar, Miguel Sales Dias, Alfredo Ferreira, Atsushi Tatsuma, Masaki Aono
    • Organizer
      9th Eurographics Workshop on 3D Object Retrieval
    • Place of Presentation
      Lisbon, Portugal
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Partial Shape Queries for 3D Object Retrieval2016

    • Author(s)
      Ioannis Pratikakis, Michalis A. Saveloys, Takahiko Furuya, Ryutarou Ohbuchi, Masaki Aono, Shoki Tashiro
    • Organizer
      9th Eurographics Workshop on 3D Object Retrieval
    • Place of Presentation
      Lisbon, Portugal
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Large-Scale 3D Shape Retrieval from ShapeNet Core552016

    • Author(s)
      M. Savva, F. Yu, Hao Su, M. Aono, B. Chen, D. Cohen-Or
    • Organizer
      9th Eurographics Workshop on 3D Object Retrieval
    • Place of Presentation
      Lisbon, Portugal
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] KDETM at NTCIR-12 Temporalia Task: Combining a Rule-based Classifier with Weakly Supervised Learning for Temporal Intent Disambiguation2016

    • Author(s)
      Abu Nowshed Chy, Md Zia Ullah, Md Shajalal and Masaki Aono
    • Organizer
      NTCIR12, Temporalia-2
    • Place of Presentation
      Tokyo, Japan
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] KDEIM at NTCIR-12 IMine-2 Search Intent Mining Task: Query Understanding through Diversified Ranking of Subtopics2016

    • Author(s)
      Md Zia Ullah, Md Shajalal and Masaki Aono
    • Organizer
      NTCIR12, IMine-2
    • Place of Presentation
      Tokyo, Japan
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Query Subtopic Diversification based on Cluster Ranking and Semantic Feature,2016

    • Author(s)
      Md Shajalala, Md Zia Ullahb, Abu Nowshed Chy, and Masaki Aono
    • Organizer
      The 2016 International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA 2016)
    • Place of Presentation
      Penang, Malaysia
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Bluefield (KDE TUT) at LifeCLEF 2016 Plant Identification Task2016

    • Author(s)
      Siang Thye Hang, Atsushi Tatsuma, and Masaki Aono
    • Organizer
      LifeCLEF 2016 Workshop in Conference and Labs of the Evaluation Forum (CLEF2016)
    • Place of Presentation
      University of Évora, Portugal
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Query Subtopic Mining Exploiting Word Embedding for Search Result Diversification2016

    • Author(s)
      Md. Zia Ullah, Md. Shajalal, Abu Nowshed Chy, and Masaki Aono
    • Organizer
      12th Asia Information Retrieval Societies Conference (AIRS2016)
    • Place of Presentation
      Beijing, China
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Open World Plant Image Identification Based on Convolutional Neural Network2016

    • Author(s)
      Siang Thye Hang and Masaki Aono
    • Organizer
      Asia Pacific Signal and Information Processing Association (APSIPA2016)
    • Place of Presentation
      Jeju, Korea
    • Related Report
      2016 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 顕著性マップを用いた画像の説明文自動生成2016

    • Author(s)
      吉井和輝, エリック・ニコルズ, 船越孝太郎, 中野幹生, 青野雅樹
    • Organizer
      人工知能学会全国大会
    • Place of Presentation
      北九州国際会議センター
    • Related Report
      2016 Annual Research Report
  • [Presentation] テキストクエリで指定した画像中の領域を特定する一手法2016

    • Author(s)
      遠藤 昂, 船越孝太郎, エリック・ニコルズ, 青野雅樹
    • Organizer
      電子情報通信学会 画像工学研究会
    • Place of Presentation
      福岡大学
    • Related Report
      2016 Annual Research Report
  • [Presentation] 3D Shape Retrieval from a Photo Using Intrinsic Image2015

    • Author(s)
      Shoki Tashiro and Masaki Aono
    • Organizer
      Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA2015)
    • Place of Presentation
      Hong Kong
    • Year and Date
      2015-12-19
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 料理レシピサイトから抽出される特徴に基づいた調理時間予測2015

    • Author(s)
      阿部卓也, 立間淳司, 青野雅樹
    • Organizer
      第43回情報科学技術フォーラム (FIT2015)
    • Place of Presentation
      愛媛大学
    • Year and Date
      2015-09-06
    • Related Report
      2015 Annual Research Report
  • [Presentation] 文法的な表現を手がかりとした宿泊施設レビュー文の意見分類2015

    • Author(s)
      大塚達也, 立間淳司, 青野雅樹
    • Organizer
      第43回情報科学技術フォーラム (FIT2015)
    • Place of Presentation
      愛媛大学
    • Year and Date
      2015-09-06
    • Related Report
      2015 Annual Research Report
  • [Presentation] Combining Temporal and Content Aware Features for Microblog Retrieval2015

    • Author(s)
      Abu Nowshed Chy, Md Zia Ullah and Masaki Aono
    • Organizer
      The 2015 International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA 2015)
    • Place of Presentation
      Chonburi, Thailand
    • Year and Date
      2015-08-20
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] New Composite Shape and Texture Descriptors for 3D Model Retrieval2015

    • Author(s)
      Hero Yudo Martono, Masaki Aono
    • Organizer
      4th International Conference on Computing and Computer Vision (ICCCV2015)
    • Place of Presentation
      Hong Kong
    • Year and Date
      2015-06-23
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Time and Context Aware Re-ranker for Microblog Retrieval2015

    • Author(s)
      Chy Abu Nowshed, Ullah Md Zia, 青野 雅樹
    • Organizer
      人工知能学会全国大会
    • Place of Presentation
      はこだて未来大学
    • Year and Date
      2015-05-31
    • Related Report
      2015 Annual Research Report
  • [Presentation] 日本語単語ベクトルの構築とその評価2015

    • Author(s)
      吉井和輝,ニコルズエリック,中野 幹生, 青野 雅樹
    • Organizer
      情報処理学会第221回自然言語処理研究会
    • Place of Presentation
      東北大学
    • Year and Date
      2015-05-25
    • Related Report
      2015 Annual Research Report
  • [Presentation] Retrieval of Non-rigid (Textured) Shapes Using Low Quality 3D Models2015

    • Author(s)
      Andrea Giachetti, Francesco Farina, Francesco Fornasa, Atsushi Tatsuma, Chika Sanada, Masaki Aono, Silvia Biasotti, Andrea Cerri, Sungbin Choi
    • Organizer
      Eurographics Workshop on 3D Object Retrieval
    • Place of Presentation
      Zurich, Switzerland
    • Year and Date
      2015-05-02
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Retrieval of Objects Captured with Kinect One Camera2015

    • Author(s)
      Pedro B. Pascoal, Pedro Proença, Filipe Gaspar, Miguel Sales Dias, Filipe Teixeira, Alfredo Ferreira, Viktor Seib, Norman Link, Dietrich Paulus, Atsushi Tatsuma, Masaki Aono
    • Organizer
      Eurographics Workshop on 3D Object Retrieval
    • Place of Presentation
      Zurich, Switzerland
    • Year and Date
      2015-05-02
    • Related Report
      2015 Annual Research Report
    • Int'l Joint Research
  • [Presentation] クロスドメイン推薦に向けたユーザ嗜好の予測手法の提案2015

    • Author(s)
      吉井和輝,立間淳司,青野雅樹
    • Organizer
      情報処理学会第77回全国大会
    • Place of Presentation
      京都大学
    • Year and Date
      2015-03-19
    • Related Report
      2014 Annual Research Report
  • [Presentation] 株価急変動要因に着目した株価予測2015

    • Author(s)
      桜田亮太, 青野雅樹
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      立命館大学
    • Year and Date
      2015-03-13
    • Related Report
      2014 Annual Research Report
  • [Presentation] 分類器の予測確率情報を用いた葉画像分類の提案2015

    • Author(s)
      Siang Thye Hang, 立間淳司, 青野雅樹
    • Organizer
      電子情報通信学会総合大会
    • Place of Presentation
      立命館大学
    • Year and Date
      2015-03-10
    • Related Report
      2014 Annual Research Report
  • [Presentation] レビュー文書を用いた観点ベースの単語極性判定法の検討2014

    • Author(s)
      奥村泰明, 青野雅樹
    • Organizer
      第12回情報学ワークショップ (Winf2014)
    • Place of Presentation
      静岡大学
    • Year and Date
      2014-11-29
    • Related Report
      2014 Annual Research Report
  • [Presentation] KDEVIR at ImageCLEF 2014 Scalable Concept Image Annotation Task: Ontology-based Automatic Image Annotation2014

    • Author(s)
      Ismat Ara Reshma, Md Zia Ullah, and Masaki Aono
    • Organizer
      Working Notes for CLEF2014 Conference
    • Place of Presentation
      Sheffield, UK
    • Year and Date
      2014-09-15 – 2014-09-18
    • Related Report
      2014 Annual Research Report
  • [Presentation] 単語位置と強弱表現に着目したツイートの感情分析2014

    • Author(s)
      三和未佐希, 立間淳司, 青野雅樹
    • Organizer
      第13回情報科学技術フォーラム (FIT2014)
    • Place of Presentation
      筑波大学
    • Year and Date
      2014-09-04
    • Related Report
      2014 Annual Research Report
  • [Presentation] 株式掲示板を用いた投稿数のバースト発生時における株価・株式関連指標動向の予測2014

    • Author(s)
      桜田亮太,青野雅樹
    • Organizer
      第13回情報科学技術フォーラム (FIT2014)
    • Place of Presentation
      筑波大学
    • Year and Date
      2014-09-03
    • Related Report
      2014 Annual Research Report
  • [Presentation] 地理情報を埋込んだ画像特徴量に基づく写真画像の位置情報推定2014

    • Author(s)
      Pav Vanna, 青野雅樹, 立間淳司
    • Organizer
      第13回情報科学技術フォーラム (FIT2014)
    • Place of Presentation
      筑波大学
    • Year and Date
      2014-09-03
    • Related Report
      2014 Annual Research Report
  • [Presentation] Query Subtopic Mining for Search Result Diversification2014

    • Author(s)
      Md Zia Ullah, Masaki Aono
    • Organizer
      The 2014 International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA 2014)
    • Place of Presentation
      Bandung, Indonesia
    • Year and Date
      2014-08-20 – 2014-08-22
    • Related Report
      2014 Annual Research Report
  • [Presentation] Ontology based Classification for Multi-label Image Annotation2014

    • Author(s)
      Ismat Ara Reshma, Md Zia Ullah, Masaki Aono
    • Organizer
      International Conference on Advanced Informatics: Concepts, Theory and Applications (ICAICTA 2014)
    • Place of Presentation
      Bandung, Indonesia
    • Year and Date
      2014-08-20 – 2014-08-22
    • Related Report
      2014 Annual Research Report
  • [Presentation] Ontology based Supervised Learning for Image Annotation2014

    • Author(s)
      Ismat Ara Reshma, Md Zia Ullah, Masaki Aono
    • Organizer
      電子情報通信学会 画像工学研究会
    • Place of Presentation
      千葉工業大学
    • Year and Date
      2014-08-01
    • Related Report
      2014 Annual Research Report
  • [Remarks] 知識データ工学・情報検索研究室 研究業績

    • URL

      http://www.kde.cs.tut.ac.jp/publications/?preview=true&preview_id=15&preview_nonce=b8cacb0cb4

    • Related Report
      2014 Annual Research Report
  • [Patent(Industrial Property Rights)] 三次元モデル検索方法及び三次元モデル検索システム2017

    • Inventor(s)
      青野雅樹、小林祐輝
    • Industrial Property Rights Holder
      青野雅樹、小林祐輝
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2017-029425
    • Filing Date
      2017-02-20
    • Related Report
      2016 Annual Research Report
  • [Patent(Industrial Property Rights)] 画像特徴量及びそれを用いる三次元形状検索システム2017

    • Inventor(s)
      立間淳司、小林将也、青野雅樹
    • Industrial Property Rights Holder
      立間淳司、小林将也、青野雅樹
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2017-042156
    • Filing Date
      2017-03-06
    • Related Report
      2016 Annual Research Report
  • [Patent(Industrial Property Rights)] 画像認識装置、画像認識方法、及び画像認識プログラム2016

    • Inventor(s)
      立間淳司、青野雅樹
    • Industrial Property Rights Holder
      立間淳司、青野雅樹
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2016-008273
    • Filing Date
      2016-01-19
    • Related Report
      2015 Annual Research Report
  • [Patent(Industrial Property Rights)] 三次元モデル検索システム、及び三次元モデル検索方法2014

    • Inventor(s)
      青野雅樹、立間淳司
    • Industrial Property Rights Holder
      青野雅樹、立間淳司
    • Industrial Property Rights Type
      特許
    • Industrial Property Number
      2014-088578
    • Filing Date
      2014-04-04
    • Related Report
      2014 Annual Research Report

URL: 

Published: 2014-04-04   Modified: 2018-03-22  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi