• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Research and Development of a Data Integration and Management Platform for Utilizing Heterogeneous Open Data

Research Project

Project/Area Number 23K21726
Project/Area Number (Other) 21H03555 (2021-2023)
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeMulti-year Fund (2024)
Single-year Grants (2021-2023)
Section一般
Review Section Basic Section 62020:Web informatics and service informatics-related
Research InstitutionNagoya University

Principal Investigator

Komamizu Takahiro  名古屋大学, 数理・データ科学・人工知能教育研究センター, 准教授 (30756367)

Co-Investigator(Kenkyū-buntansha) 井手 一郎  名古屋大学, 情報学研究科, 教授 (10332157)
石川 佳治  名古屋大学, 情報学研究科, 教授 (80263440)
波多野 賢治  同志社大学, 文化情報学部, 教授 (80314532)
Project Period (FY) 2024-04-01 – 2025-03-31
Project Status Completed (Fiscal Year 2024)
Budget Amount *help
¥17,160,000 (Direct Cost: ¥13,200,000、Indirect Cost: ¥3,960,000)
Fiscal Year 2024: ¥3,640,000 (Direct Cost: ¥2,800,000、Indirect Cost: ¥840,000)
Fiscal Year 2023: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2022: ¥3,380,000 (Direct Cost: ¥2,600,000、Indirect Cost: ¥780,000)
Fiscal Year 2021: ¥4,940,000 (Direct Cost: ¥3,800,000、Indirect Cost: ¥1,140,000)
Keywords異種データ統合 / オープンデータ活用 / シーングラフ生成 / マルチモーダル情報処理 / メトリック学習 / データ統合 / マルチメディア / 探索的情報検索 / Linked Open Data / 異種データ / 不均衡性 / 検索 / 分類 / モデル軽量化 / テキスト / テキスト分類 / 画像キャプショニング / グラフデータベース / 不均衡データ / データ分類 / データ循環
Outline of Research at the Start

昨年度までに,異種データの統合に関する基礎技術(特に,データにラベルを付与する分類問題における不均衡性の問題や大量のデータから必要な情報を効果的かつ効率的に検索する手法)を構築してきた.依然として課題はあるため,これらを更に改善することが今年度の研究内容の一つである.
一方で,これらの成果を受け,さらなる発展として,特に異種モーダルにおいてデータの統合するための基礎技術から応用技術に向けて研究を進行する.

Outline of Final Research Achievements

This study aimed to develop an integration and management platform for effectively utilizing heterogeneous open data by leveraging multimodal information and graph structures. For tasks such as caption generation and summarization of image collections, semantic integration was achieved through the use of scene graphs combined with external knowledge. The research also proposed models addressing practical challenges involving heterogeneous data, including prescription matching, recipe recommendation, and disease detection in agriculture. Furthermore, techniques such as zero-shot learning and multi-task learning were applied to build flexible and reliable information processing methods, contributing to the cross-domain utilization of diverse open data.

Academic Significance and Societal Importance of the Research Achievements

本研究は、異種オープンデータを横断的に結び付け、意味的に統合するための基盤技術を構築した点で学術的意義がある。特に、シーングラフやマルチモーダル情報処理、メトリック学習などの先端技術を応用し、従来困難であったデータ連携を可能にした点が新しい。社会的には、医療・農業・行政など多様な分野でのオープンデータ活用を促進し、知識発見や意思決定支援、サービスの効率化に貢献できる可能性を示した。特に、軽量モデルによる省リソース環境での活用や、信頼性の高い情報提供による公共サービス向上が期待される。

Report

(5 results)
  • 2024 Annual Research Report   Final Research Report ( PDF )
  • 2023 Annual Research Report
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • Research Products

    (33 results)

All 2025 2024 2023 2022 2021

All Journal Article (8 results) (of which Int'l Joint Research: 1 results,  Peer Reviewed: 7 results,  Open Access: 3 results) Presentation (25 results) (of which Int'l Joint Research: 17 results)

  • [Journal Article] SPQ: Similarity-Preserving Posttraining Quantization for Portable Crop Disease Detection2025

    • Author(s)
      Padeiro Carlos Victorino、Chen Tse-Wei、Komamizu Takahiro、Ide Ichiro
    • Journal Title

      IEEE Transactions on AgriFood Electronics

      Volume: 1 Issue: 1 Pages: 1-13

    • DOI

      10.1109/tafe.2025.3533416

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Multi-proposal collaboration and multi-task training for weakly-supervised video moment retrieval2025

    • Author(s)
      Zhang Bolin、Yang Chao、Jiang Bin、Komamizu Takahiro、Ide Ichiro
    • Journal Title

      International Journal of Machine Learning and Cybernetics

      Volume: 1 Issue: 7-8 Pages: 1-10

    • DOI

      10.1007/s13042-024-02520-w

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Interpolating the text-to-image correspondence based on phonetic and phonological similarities for nonword-to-image generation2024

    • Author(s)
      Chihaya Matsuhira, Marc Aurel Kastner, Takahiro Komamizu, Takatsugu Hirayama, Keisuke Doman, Yasutomo Kawanishi, Ichiro Ide
    • Journal Title

      IEEE Access

      Volume: 12 Pages: 41299-41316

    • DOI

      10.1109/access.2024.3378095

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Zero-Shot Pill-Prescription Matching With Graph Convolutional Network and Contrastive Learning2024

    • Author(s)
      Nguyen Trung Thanh、Le Nguyen Phi、Kawanishi Yasutomo、Komamizu Takahiro、Ide Ichiro
    • Journal Title

      IEEE Access

      Volume: 12 Pages: 55889-55904

    • DOI

      10.1109/access.2024.3390153

    • Related Report
      2024 Annual Research Report 2023 Annual Research Report
  • [Journal Article] Image-Collection Summarization Using Scene-Graph Generation With External Knowledge2024

    • Author(s)
      Phueaksri Itthisak、Kastner Marc A.、Kawanishi Yasutomo、Komamizu Takahiro、Ide Ichiro
    • Journal Title

      IEEE Access

      Volume: 12 Pages: 17499-17512

    • DOI

      10.1109/access.2024.3360113

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Towards Captioning an Image Collection from a Combined Scene Graph Representation Approach2023

    • Author(s)
      Phueaksri Itthisak、Kastner Marc A.、Kawanishi Yasutomo、Komamizu Takahiro、Ide Ichiro
    • Journal Title

      Lecture Notes in Computer Science book series

      Volume: 13833 Pages: 178-190

    • DOI

      10.1007/978-3-031-27077-2_14

    • ISBN
      9783031270765, 9783031270772
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Towards Efficient Data Access Through Multiple Relationship in Graph-Structured Digital Archives2022

    • Author(s)
      Kazuma Kusu, Takahiro Komamizu, and Kenji Hatano
    • Journal Title

      From Born-Physical to Born-Virtual: Augmenting Intelligence in Digital Libraries

      Volume: - Pages: 377-391

    • DOI

      10.1007/978-3-031-21756-2_29

    • ISBN
      9783031217555, 9783031217562
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Combining Multi-ratio Undersampling and Metric Learning for Imbalanced Classification2021

    • Author(s)
      Komamizu Takahiro
    • Journal Title

      Journal of Data Intelligence

      Volume: 2 Issue: 4 Pages: 462-475

    • DOI

      10.26421/jdi2.4-5

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Quantifying Image-Adjective Associations by Leveraging Large-Scale Pretrained Models2025

    • Author(s)
      Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Ichiro Ide
    • Organizer
      MMM
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Visual Storytelling by Understanding Narrative Context Through Scene-Graphs2025

    • Author(s)
      Itthisak Phueaksri, Marc A. Kastner, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide
    • Organizer
      MMM
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Lightweight Maize Disease Detection through Post-Training Quantization with Similarity Preservation2024

    • Author(s)
      Carlos Victorino Padeiro, Tse-Wei Chen, Takahiro Komamizu, Ichiro Ide
    • Organizer
      CVPR Workshops
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] R-DiP: Re-ranking Based Diffusion Pre-computation for Image Retrieval2024

    • Author(s)
      Tatsuya Kato, Takahiro Komamizu, Ichiro Ide
    • Organizer
      DEXA
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] One-Stage Open-Vocabulary Temporal Action Detection Leveraging Temporal Multi-Scale and Action Label Features2024

    • Author(s)
      Trung Thanh Nguyen, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide
    • Organizer
      FG
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Feature Extraction for Claim Check-Worthiness Prediction Tasks Using LLM2024

    • Author(s)
      Yuka Teramoto, Takahiro Komamizu, Mitsunori Matsushita, Kenji Hatano
    • Organizer
      iiWAS
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Investigating Conceptual Blending of a Diffusion Model for Improving Nonword-to-Image Generation2024

    • Author(s)
      Chihaya Matsuhira, Marc A. Kastner, Takahiro Komamizu, Takatsugu Hirayama, Ichiro Ide
    • Organizer
      ACM MM
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Action Selection Learning for Multi-label Multi-view Action Recognition2024

    • Author(s)
      Trung Thanh Nguyen, Yasutomo Kawanishi, Takahiro Komamizu, Ichiro Ide
    • Organizer
      MMAsia
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] L3Masking: Multi-task Fine-tuning for Language Models by Leveraging Lessons Learned from Vanilla Model2024

    • Author(s)
      Yusuke Kimura, Takahiro Komamizu, Kenji Hatano
    • Organizer
      CustomNLP4U@EMNLP
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Ensemble-Based Imbalanced Text Classification Using Metric Learning2023

    • Author(s)
      Komamizu Takahiro
    • Organizer
      Database and Expert Systems Applications - 34th International Conference, DEXA 2023, Penang, Malaysia, August 28-30, 2023, Proceedings, Part II.
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Visual Passage Score Aggregation for Image Retrieval2023

    • Author(s)
      Komamizu Takahiro
    • Organizer
      6th IEEE International Conference on Multimedia Information Processing and Retrieval, MIPR 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] RecipeMeta: Metapath-enhanced Recipe Recommendation on Heterogeneous Recipe Network2023

    • Author(s)
      Shi Jialiang、Komamizu Takahiro、Doman Keisuke、Kyutoku Haruya、Ide Ichiro
    • Organizer
      ACM Multimedia Asia 2023, MMAsia 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Image Impression Estimation by Clustering People with Similar Tastes2023

    • Author(s)
      Kojima Banri、Komamizu Takahiro、Kawanishi Yasutomo、Doman Keisuke、Ide Ichiro
    • Organizer
      18th International Conference on Machine Vision and Applications, MVA 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Towards Achieving Lightweight Deep Neural Network for Precision Agriculture with Maize Disease Detection2023

    • Author(s)
      Padeiro Carlos Victorino、Komamizu Takahiro、Ide Ichiro
    • Organizer
      18th International Conference on Machine Vision and Applications, MVA 2023
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] PiDP: 処方箋に対する GCN の対照学習に基づく錠剤検出2023

    • Author(s)
      Trung Thanh Nguyen, Phi Le Nguyen, 川西 康友, 駒水 孝裕 , 井手 一郎
    • Organizer
      2023 年電子情報通信学会総合大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 文書分類における効果的なマルチタスク学習のための汎用的サブタスクの要件分析2023

    • Author(s)
      木村 優介, 駒水 孝裕 , 波多野 賢治
    • Organizer
      言語理解とコミュニケーション研究会,
    • Related Report
      2022 Annual Research Report
  • [Presentation] 固有表現タグおよびPOSタグによる交換制約付きデータ拡張手法2023

    • Author(s)
      寺本 優香, 駒水 孝裕 , 波多野 賢治
    • Organizer
      第15回データ工学と情報マネジメントに関するフォーラム
    • Related Report
      2022 Annual Research Report
  • [Presentation] Multi-task Learning-based Text Classification with Subword-Phrase Extraction2022

    • Author(s)
      Kimura Yusuke、Komamizu Takahiro、Hatano Kenji
    • Organizer
      the 11th International Symposium on Information and Communication Technology
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Action Semantic Alignment for Image Captioning2022

    • Author(s)
      Huo Da、Kastner Marc A.、Komamizu Takahiro、Ide Ichiro
    • Organizer
      IEEE 5th International Conference on Multimedia Information Processing and Retrieval (MIPR)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 法令間の関係を利用したモビリティ関連法令検索に関する一考察2022

    • Author(s)
      駒水 孝裕 , 外山 勝彦, 河口 信夫, 佐野 智也
    • Organizer
      第57回人工知能学会セマンティックウェブとオントロジー (SWO) 研究会
    • Related Report
      2022 Annual Research Report
  • [Presentation] Towards Constructing Destination Node Index for Repetition Paths2022

    • Author(s)
      Kazuma Kusu, Takahiro Komamizu , Kenji Hatano
    • Organizer
      WebDB夏のワークショップ2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] サブワードフレーズ抽出を併用した文書分類2022

    • Author(s)
      木村 優介, 駒水 孝裕 , 波多野 賢治
    • Organizer
      WebDB夏のワークショップ2022
    • Related Report
      2022 Annual Research Report
  • [Presentation] 類似した感性を持つ人物集合抽出に基づく画像の印象推定の検討2022

    • Author(s)
      小嶋 万理, 駒水 孝裕 , 川西 康友, 道満 恵介, 井手 一郎
    • Organizer
      ディアエクスペリエンス・バーチャル環境基礎研究会 (MVE)
    • Related Report
      2022 Annual Research Report
  • [Presentation] ストップフレーズ抽出を併用した文書分類2022

    • Author(s)
      木村 優介, 駒水 孝裕 , 波多野 賢治
    • Organizer
      第14回データ工学と情報マネジメントに関するフォーラム
    • Related Report
      2021 Annual Research Report
  • [Presentation] MMEnsemble: Imbalanced Classification Framework Using Metric Learning and Multi-sampling Ratio Ensemble2021

    • Author(s)
      Takahiro Komamizu
    • Organizer
      DEXA 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2021-04-28   Modified: 2026-01-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi