• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

A New AI Method for Bridge Inspection and Diagnosis that Combines CNN with Highly Accurate Damage Detection and Expertises

Research Project

Project/Area Number 21H01417
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 22020:Structure engineering and earthquake engineering-related
Research InstitutionThe University of Tokyo

Principal Investigator

Chun Pang-jo  東京大学, 大学院工学系研究科(工学部), 特任准教授 (60605955)

Co-Investigator(Kenkyū-buntansha) 宮本 崇  山梨大学, 大学院総合研究部, 准教授 (30637989)
浅本 晋吾  埼玉大学, 理工学研究科, 准教授 (50436333)
党 紀  埼玉大学, 理工学研究科, 准教授 (60623535)
Project Period (FY) 2021-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥17,420,000 (Direct Cost: ¥13,400,000、Indirect Cost: ¥4,020,000)
Fiscal Year 2023: ¥4,810,000 (Direct Cost: ¥3,700,000、Indirect Cost: ¥1,110,000)
Fiscal Year 2022: ¥5,720,000 (Direct Cost: ¥4,400,000、Indirect Cost: ¥1,320,000)
Fiscal Year 2021: ¥6,890,000 (Direct Cost: ¥5,300,000、Indirect Cost: ¥1,590,000)
Keywords橋梁点検診断 / 損傷検知 / CNN / Deep learning / 維持管理 / Image captioning / VQA / 画像処理 / SfM / 人工知能 / AI / 橋梁点検
Outline of Research at the Start

橋梁点検診断の効率化および高精度化のため,CNNにより橋梁撮影画像を解析し,損傷を自動で評価する手法の実現が期待されている.本研究ではまず,構造・環境条件が多様であるため撮影画像の性質が統一されないという課題に対応できるCNN構造を開発し,損傷検出の精度を向上させる.次いで,その結果を言語化して専門知モデルと連携させ,損傷発生要因の解明や深刻度評価を行う手法を構築する.
本研究は,橋梁点検診断AIの実現における重要課題である,多様な環境への対応と専門知との連携を一気通貫させ取り組むものである.また,橋梁全自動点検診断への道筋を拓くものとしても位置づけられ,維持管理サイクルの枠組みを大きく変える.

Outline of Final Research Achievements

This research aims to develop a high-precision AI method for bridge inspection and diagnosis. With aging bridges and a shortage of skilled engineers, an AI that uses Convolutional Neural Networks (CNN) to detect damage and integrate expert knowledge is essential. The research developed a domain-adaptive CNN model combining Self-Training approaches with Bayesian Neural Networks, achieving precise damage detection despite varied bridge environments. Additionally, an Image Captioning model was created to generate texts explaining detected damage, making results understandable for both engineers and non-specialists. The study shows significant improvements in detection accuracy and explanation clarity, enhancing decision-making in maintenance. This AI-based approach automates and improves bridge inspection efficiency, addressing engineer shortages and contributing to better infrastructure maintenance.

Academic Significance and Societal Importance of the Research Achievements

本研究の学術的意義は,自己訓練アプローチとベイズニューラルネットワークを組み合わせたドメイン適応型CNNモデルを開発し,異なる環境に対応可能な高精度な橋梁損傷検出手法を実現した点にある.これにより,従来の学習データとの乖離を克服し,検出精度を大幅に向上させた.

社会的意義としては,技術者不足の課題に対処しつつ,非技術者にも理解しやすい損傷説明文を生成するImage Captioningモデルを開発した点が挙げられる.これにより,維持管理業務の効率化が図られ,インフラの安全性向上に寄与する.本研究は,橋梁点検診断の自動化と効率化を促進し,将来的なインフラ維持管理の革新に繋がるものである.

Report

(4 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • Research Products

    (21 results)

All 2024 2023 2022

All Journal Article (12 results) (of which Peer Reviewed: 12 results,  Open Access: 11 results) Presentation (9 results) (of which Int'l Joint Research: 4 results,  Invited: 9 results)

  • [Journal Article] Development of an action classification method for construction sites combining pose assessment and object proximity evaluation2024

    • Author(s)
      Kikuta Toshiya、Chun Pang-jo
    • Journal Title

      Journal of Ambient Intelligence and Humanized Computing

      Volume: - Issue: 4 Pages: 2255-2267

    • DOI

      10.1007/s12652-024-04753-7

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Deep Learning-Based Bridge Damage Cause Estimation from Multiple Images Using Visual Question Answering2024

    • Author(s)
      Tatsuro Yamane, Pang-jo Chun, Ji Dang, Takayuki Okatani
    • Journal Title

      Structure and Infrastructure Engineering

      Volume: -

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Recording of bridge damage areas by 3D integration of multiple images and reduction of the variability in detected results2023

    • Author(s)
      Yamane Tatsuro、Chun Pang‐jo、Dang Ji、Honda Riki
    • Journal Title

      Computer-Aided Civil and Infrastructure Engineering

      Volume: Early View Issue: 17 Pages: 2391-2407

    • DOI

      10.1111/mice.12971

    • Related Report
      2023 Annual Research Report 2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Iterative application of generative adversarial networks for improved buried pipe detection from images obtained by ground‐penetrating radar2023

    • Author(s)
      Chun Pang Jo、Suzuki M.、Kato Y.
    • Journal Title

      Computer-Aided Civil and Infrastructure Engineering

      Volume: 38 Issue: 17 Pages: 2472-2490

    • DOI

      10.1111/mice.13070

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Corrosion Damage Detection in Headrace Tunnel Using YOLOv7 with Continuous Wall Images2023

    • Author(s)
      Kubo Shiori、Nakayama Nobuhiro、Matsuda Sadanori、Chun Pang-jo
    • Journal Title

      Applied Sciences

      Volume: 13 Issue: 16 Pages: 9388-9388

    • DOI

      10.3390/app13169388

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Automatic detection of concrete floating and delamination by analyzing thermal images through self-supervised learning2023

    • Author(s)
      Sota Kawanowa, Shogo Hayashi, Takayuki Okatani, Kang-Jun Liu, Pang-jo Chun
    • Journal Title

      Intelligence, Informatics and Infrastructure

      Volume: 4(2) Pages: 21-30

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] 背景増強訓練による橋梁複数損傷セグメンテーションの検証と 3D 損傷モデル2023

    • Author(s)
      藤嶋 斗南, 党 紀, 全 邦釘
    • Journal Title

      AI・データサイエンス論文集

      Volume: 4(3) Pages: 705-714

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Study on Accuracy Improvement of Slope Failure Region Detection Using Mask R-CNN with Augmentation Method2022

    • Author(s)
      Kubo Shiori、Yamane Tatsuro、Chun Pang-jo
    • Journal Title

      Sensors

      Volume: 22 Issue: 17 Pages: 6412-6412

    • DOI

      10.3390/s22176412

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Detecting and localising damage based on image recognition and structure from motion, and reflecting it in a 3D bridge model2022

    • Author(s)
      Yamane Tatsuro、Chun Pang-jo、Honda Riki
    • Journal Title

      Structure and Infrastructure Engineering

      Volume: - Issue: 4 Pages: 1-13

    • DOI

      10.1080/15732479.2022.2131845

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed
  • [Journal Article] AUTOMATIC DETECTION OF INNER DEFECTS OF CONCRETE BY ANALYZING THERMAL IMAGES USING SELF-SUPERVISED LEARNING2022

    • Author(s)
      川野輪 壮太、林 詳悟、岡谷 貴之、Kang-Jun Liu、全 邦釘
    • Journal Title

      Intelligence, Informatics and Infrastructure

      Volume: 3 Issue: J2 Pages: 47-55

    • DOI

      10.11532/jsceiii.3.J2_47

    • ISSN
      2435-9262
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] DEVELOPING A WEB SYSTEM FOR BRIDGE INSPECTION UTILIZING IMAGE CAPTIONING TECHNOLOGY2022

    • Author(s)
      設楽 広太、全 邦釘
    • Journal Title

      Intelligence, Informatics and Infrastructure

      Volume: 3 Issue: J2 Pages: 65-75

    • DOI

      10.11532/jsceiii.3.J2_65

    • ISSN
      2435-9262
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] BASIC FUNCTIONS REQUIRED FOR INFRAOS FOR DATA PLATFORM OF INFRASTRUCTURE MANAGEMENT2022

    • Author(s)
      阿部 雅人、杉崎 光一、全 邦釘
    • Journal Title

      Intelligence, Informatics and Infrastructure

      Volume: 3 Issue: J2 Pages: 608-620

    • DOI

      10.11532/jsceiii.3.J2_608

    • ISSN
      2435-9262
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] AI・3次元プラットフォームによるインフラ維持管理2024

    • Author(s)
      全 邦釘
    • Organizer
      NIMSインフラ構造材料パートナーシップ 2023年度第3回研究会
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Advancing Infrastructure Inspection with AI and 3D Data Platform Integration for Improved Damage Assessment and Enhanced Modeling2024

    • Author(s)
      Pang-jo Chun
    • Organizer
      University-Industry Collaborations for Sustainable Development (ICSD)
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Advanced Infrastructure Inspection using UAVs and AI2024

    • Author(s)
      Pang-jo Chun
    • Organizer
      The Asian Civil Engineering Coordinating Council "Robotics Technology in Construction"
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] AIとi-Constructionが切り拓く社会インフラの未来2023

    • Author(s)
      全 邦釘
    • Organizer
      第696回建設技術講習会
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] AIとデータプラットフォームが拓くインフラメンテナンス2023

    • Author(s)
      全 邦釘
    • Organizer
      メンテナンス・レジリエンスTOKYO2023
    • Related Report
      2023 Annual Research Report
    • Invited
  • [Presentation] Recent Application of AI & i-Constuction to Infrastructure Maintenance in Japan2023

    • Author(s)
      Pang-jo Chun
    • Organizer
      One Day Workshop on Maintenance of Concrete Structures - Durability Assessment, Repair, New NDT Method Introduction
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Recent Application of AI & i-Constuction to Infrastructure Maintenance in Japan2023

    • Author(s)
      Pang-jo Chun
    • Organizer
      One Day Workshop on Maintenance of Concrete Structures - Durability Assessment, Repair, New NDT Method Introduction, AI & i-Construction Application in Japan
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] 建設分野におけるAI技術の役割と研究動向2022

    • Author(s)
      全 邦釘
    • Organizer
      JTS Tech Conference 2022
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] AIとi-Constructionが切り拓く社会インフラの未来およびMoonshotプロジェクトの展望2022

    • Author(s)
      全 邦釘
    • Organizer
      第686回建設技術講習会(Society5.0に向けた公共事業における新技術の活用)
    • Related Report
      2022 Annual Research Report
    • Invited

URL: 

Published: 2021-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi