• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Dynamic observation of dislocation glide by machine-learning-assisted in-situ electron microscopy

Research Project

Project/Area Number 20K21093
Research Category

Grant-in-Aid for Challenging Research (Exploratory)

Allocation TypeMulti-year Fund
Review Section Medium-sized Section 26:Materials engineering and related fields
Research InstitutionKyushu University

Principal Investigator

Saito Hikaru  九州大学, 先導物質化学研究所, 准教授 (50735587)

Co-Investigator(Kenkyū-buntansha) 波多 聡  九州大学, 総合理工学研究院, 教授 (60264107)
Project Period (FY) 2020-07-30 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥6,500,000 (Direct Cost: ¥5,000,000、Indirect Cost: ¥1,500,000)
Fiscal Year 2022: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2021: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2020: ¥3,510,000 (Direct Cost: ¥2,700,000、Indirect Cost: ¥810,000)
Keywords透過電子顕微鏡 / 転位 / その場観察 / 機械学習 / ノイズフィルタリング
Outline of Research at the Start

本研究は、結晶材料の塑性変形を担う線状欠陥である転位運動を直接観察可能な高速電子顕微鏡法の開発に取り組む。高速カメラの開発等、透過電子顕微鏡の撮像速度は近年飛躍的に向上しており、遅い転位運動であればその動的観察の実現が期待できる。しかしながら1フレームあたりの最大ドーズ量には制約があり、極低信号画像から目的の情報を抽出する画像処理技術が必要とされる。そこで本研究では機械学習を用いた転位線抽出アルゴリズムを開発し、信号量不足を克服する。これにより、ミリ秒オーダーでの転位運動観察を可能にし、転位運動ダイナミクスの解明へと繋げる。

Outline of Final Research Achievements

Current temporal resolution of STEM is far below that of conventional TEM. Rapid image acquisition in the millisecond per frame or faster generally causes image distortion, poor electron signals, and unidirectional blurring, which are obstacles for realizing video-rate STEM observation. In this study, we have developed a deep learning (DL)-based denoising and image distortion correction for STEM rapid image acquisition, which can remove not only the statistical noise but also the unidirectional blurring. By using this DL-based denoising method, we have achieved rapid STEM tomography visualizing 3D dislocation arrangement only within five-second acquisition of all the tilt-series images even in a 300 nm thick steel specimen. Video-rate STEM observation of thermally activated dislocation glide was also realized.

Academic Significance and Societal Importance of the Research Achievements

豊かで安全な生活の追求、継続的な社会インフラの整備には材料開発が欠かせない。材料組織の変形過程をナノスケールで直接観察することが可能になれば、マクロスケールでの材料機能や特性を材料微細組織と結びつけた理解がより進展し、開発速度の飛躍的な向上や新たな開発アプローチのヒントを得ることが期待できる。本開発手法は転位運動だけでなく種々の材料中の動的現象のナノイメージングによる解析に広く応用可能である。また、試料 への電子線照射量の大幅な低減を可能とし、電子線に対して耐久力の低いソフトマテリアルや反応性物質、生体の電子顕微鏡解析にも役立つ。

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (11 results)

All 2023 2022 2021

All Journal Article (6 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 6 results,  Open Access: 4 results) Presentation (5 results) (of which Invited: 3 results)

  • [Journal Article] Yield and flow properties of ultra-fine, fine, and coarse grain microstructures of FeCoNi equiatomic alloy at ambient and cryogenic temperatures2023

    • Author(s)
      Lavakumar Avala、Yoshida Shuhei、Punyafu Jesada、Ihara Shiro、Chong Yan、Saito Hikaru、Tsuji Nobuhiro、Murayama Mitsuhiro
    • Journal Title

      Scripta Materialia

      Volume: 230 Pages: 115392-115392

    • DOI

      10.1016/j.scriptamat.2023.115392

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Three-dimensional electron tomography and recent expansion of its applications in materials science2023

    • Author(s)
      Norio Baba, Satoshi Hata, Hikaru Saito, Kenji Kaneko
    • Journal Title

      Microscopy

      Volume: 72 Issue: 2 Pages: 111-134

    • DOI

      10.1093/jmicro/dfac071

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Microstructural factors dictating the initial plastic deformation behavior of an ultrafine-grained Fe?22Mn-0.6C TWIP steel2023

    • Author(s)
      Punyafu Jesada、Hwang Sukyoung、Ihara Shiro、Saito Hikaru、Tsuji Nobuhiro、Murayama Mitsuhiro
    • Journal Title

      Materials Science and Engineering: A

      Volume: 862 Pages: 144506-144506

    • DOI

      10.1016/j.msea.2022.144506

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Recent Studies on TEM/STEM Tomography2022

    • Author(s)
      波多聰、趙一方、井原史朗、斉藤光、光原昌寿、村山光宏
    • Journal Title

      Materia Japan

      Volume: 61 Issue: 2 Pages: 84-88

    • DOI

      10.2320/materia.61.84

    • NAID

      130008149701

    • ISSN
      1340-2625, 1884-5843
    • Year and Date
      2022-02-01
    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Deep learning-based noise filtering toward millisecond order imaging by using scanning transmission electron microscopy2022

    • Author(s)
      Shiro Ihara, Hikaru Saito, Mizumo Yoshinaga, Lavakumar Avala, Mitsuhiro Murayama
    • Journal Title

      Scientific reports

      Volume: 12 Issue: 1 Pages: 13462-13462

    • DOI

      10.1038/s41598-022-17360-3

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Five-second STEM dislocation tomography for 300?nm thick specimen assisted by deep-learning-based noise filtering2021

    • Author(s)
      Zhao Yifang、Koike Suguru、Nakama Rikuto、Ihara Shiro、Mitsuhara Masatoshi、Murayama Mitsuhiro、Hata Satoshi、Saito Hikaru
    • Journal Title

      Scientific Reports

      Volume: 11 Issue: 1 Pages: 20720-20720

    • DOI

      10.1038/s41598-021-99914-5

    • Related Report
      2021 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] 高分子材料のTEM内引張その場観察およびEELSによる破壊状態解析2023

    • Author(s)
      井原史朗、根北翔、加來公子、斉藤光、村山光宏
    • Organizer
      日本物理学会2023年春季大会
    • Related Report
      2022 Annual Research Report
  • [Presentation] 材料熱処理過程のその場トモグラフィー観察手法の開発2022

    • Author(s)
      斉藤 光
    • Organizer
      日本顕微鏡学会 超高分解能顕微鏡法分科会 研究討論会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] STEM を用いた加熱その場観察における機械学習の応用2022

    • Author(s)
      井原史朗
    • Organizer
      日本顕微鏡学会 超高分解能顕微鏡法分科会 研究討論会
    • Related Report
      2022 Annual Research Report
    • Invited
  • [Presentation] 結晶性金属材料におけるき裂進展過程のナノスケール解析2022

    • Author(s)
      井原史朗、斉藤光、木原孝太郎、村山光宏
    • Organizer
      日本材料学会第8回材料WEEK
    • Related Report
      2022 Annual Research Report
  • [Presentation] 機械学習支援高速STEMの開発とトモグラフィーへの応用2021

    • Author(s)
      斉藤光、井原史朗、波多聰、村山光宏
    • Organizer
      日本顕微鏡学会第64回シンポジウム
    • Related Report
      2021 Research-status Report
    • Invited

URL: 

Published: 2020-08-03   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi