• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Comprehensive Analysis and Repairing Techniques for Stateful Deep Learning Systems

Research Project

Project/Area Number 20H04168
Research Category

Grant-in-Aid for Scientific Research (B)

Allocation TypeSingle-year Grants
Section一般
Review Section Basic Section 60050:Software-related
Research InstitutionKyushu University

Principal Investigator

MA LEI  九州大学, システム情報科学研究院, 准教授 (70842061)

Co-Investigator(Kenkyū-buntansha) 佐藤 周行  東京大学, 情報基盤センター, 准教授 (20225999)
趙 建軍  九州大学, システム情報科学研究院, 教授 (20299580)
石川 冬樹  国立情報学研究所, アーキテクチャ科学研究系, 准教授 (50455193)
鵜林 尚靖  九州大学, システム情報科学研究院, 教授 (80372762)
Project Period (FY) 2020-04-01 – 2023-03-31
Project Status Completed (Fiscal Year 2022)
Budget Amount *help
¥17,680,000 (Direct Cost: ¥13,600,000、Indirect Cost: ¥4,080,000)
Fiscal Year 2022: ¥5,070,000 (Direct Cost: ¥3,900,000、Indirect Cost: ¥1,170,000)
Fiscal Year 2021: ¥5,200,000 (Direct Cost: ¥4,000,000、Indirect Cost: ¥1,200,000)
Fiscal Year 2020: ¥7,410,000 (Direct Cost: ¥5,700,000、Indirect Cost: ¥1,710,000)
Keywords知能ソフトウェア分析 / 深層学習 / 回帰型ニューラルネットワーク分析 / 機械学習品質保証 / ソフトウェア工学 / 機械学習工学 / 知能ソフトウェア解析 / 回帰型ニューラルネットワーク解析 / 深層学習システム / ソフトウエア解析 / ソフトウエアテスト / ソフトウエア修復 / 回帰型ニューラルネットワーク
Outline of Research at the Start

深層学習(DL)は画像処理、音声認識、自然言語処理、及ひ囲碁なとの応用面て華々しい成功をおさめ、自動運転車やロボットなと、社会基盤に関わる重要な分野ての成果か益々期待されている。それと同時に、DLシステムにおける障害か発生する場合、社会に巨大な災害をもたらす可能性かあるため、その信頼性と安全性に対する要求か益々高くなっている。本研究ては、ステートフル深層学習システム(RNN)に対する系統的解析と修復技術の確立を目的としている。本研究の進展により、RNNにおける系統的な解析やテスト技術とその支援環境か整い、信頼性と安全性の高いRNNシステムを構築することか期待てきる。

Outline of Final Research Achievements

The purpose of this research is to establish a systematic analysis technique for recurrent neural networks (RNN). Specifically, the following outcome were achieved: 1) we design and develop a platform that can extract abstract models that can approximate the internal behavior of RNNs, which enables the in-depth analysis of RNN behaviors. 2) We design and develop a framework for automatic analysis, testing, repair, and interpretation of RNNs. 3) We evaluate and demonstrate the effectiveness and usefulness of the proposed technique by applying it to real-world RNN systems.
In this research, we have established a foundation for early interpretable analysis techniques and developed tools for RNNs. As RNN-liked AI models are expected to become more influential with more real-world applications in the future, it is expected that this research would inspire future research along this direction and facilitate the building of more trustworthy RNNs for real-world applications.

Academic Significance and Societal Importance of the Research Achievements

RNNは、自然言語処理などの時系列信号処理において、社会基盤に関わる重要な分野での成果がますます期待されている。しかし、RNNはフィードバックと内部状態を使用するため、ブラックボックスの特性により、信頼性保証などが非常に困難となることがある。特に、信頼性が重要な産業界や日常社会の様々な応用において、誤った動作をする悪い影響に直面する可能性がある。そこで、本研究では、RNNに対する系統的解釈ができる分析技術の確立により、RNNにおける解釈可能な分析などにおいて、品質・安全保証技術の基盤とその支援環境が整い、信頼性と品質の高いRNNシステムを構築することができるようになるでしょう。

Report

(4 results)
  • 2022 Annual Research Report   Final Research Report ( PDF )
  • 2021 Annual Research Report
  • 2020 Annual Research Report
  • Research Products

    (53 results)

All 2023 2022 2021 2020 Other

All Int'l Joint Research (12 results) Journal Article (10 results) (of which Int'l Joint Research: 9 results,  Peer Reviewed: 10 results,  Open Access: 6 results) Presentation (31 results) (of which Int'l Joint Research: 31 results)

  • [Int'l Joint Research] Nanyang Technological University(シンガポール)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] University of Luxembourg(ルクセンブルク)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Purdue University(米国)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] University of Alberta(カナダ)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Tsinghua University(中国)

    • Related Report
      2022 Annual Research Report
  • [Int'l Joint Research] Nanyang Technological University(シンガポール)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] University of Calgary(カナダ)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Peking University/Tianjin University(中国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Iowa State University(米国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] Nanyang Technological University(シンガポール)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Concordia University(カナダ)

    • Related Report
      2020 Annual Research Report
  • [Int'l Joint Research] Peking University(中国)

    • Related Report
      2020 Annual Research Report
  • [Journal Article] ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks2023

    • Author(s)
      Hua Qi, Zhijie Wang, Qing Guo, Jianlang Chen, Felix Juefei-Xu, Fuyuan Zhang, Lei Ma, Jianjun Zhao
    • Journal Title

      ACM Transactions on Software Engineering and Methodology (TOSEM 2023, CORE Rank A*, Impact Factor 3.685)

      Volume: n.a.

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] PatchCensor: Patch Robustness Certification for Transformers via Exhaustive Testing.2023

    • Author(s)
      Yuheng Huang, Lei Ma, Yuanchun Li
    • Journal Title

      ACM Transactions on Software Engineering and Methodology (TOSEM 2023, CORE Rank A*, Impact Factor 3.685)

      Volume: n.a. Issue: 6 Pages: 1-34

    • DOI

      10.1145/3591870

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] PAFL: Probabilistic Automaton-based Fault Localization for Recurrent Neural Networks2023

    • Author(s)
      Yuta Ishimoto, Masanari Kondo, Naoyasu Ubayashi, Yasutaka Kamei
    • Journal Title

      Information and Software Technology

      Volume: 155 Pages: 107117-107117

    • DOI

      10.1016/j.infsof.2022.107117

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] A Survey on Automated Driving System Testing: Landscapes and Trends.2023

    • Author(s)
      Shuncheng Tang, Zhenya Zhang, Yi Zhang, Jixiang Zhou, Yan Guo, Shuang Liu, Shengjian Guo, Yan-Fu Li, Lei Ma, Yinxing Xue, Yang Liu
    • Journal Title

      ACM Transactions on Software Engineering and Methodology (TOSEM 2023, CORE Rank A*, impact factor 3.685)

      Volume: n.a. Issue: 5 Pages: 1-62

    • DOI

      10.1145/3579642

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] FalsifAI: Falsification of AI-Enabled Hybrid Control Systems Guided by Time-Aware Coverage Criteria2023

    • Author(s)
      Zhang Zhenya、Lyu Deyun、Arcaini Paolo、Ma Lei、Hasuo Ichiro、Zhao Jianjun
    • Journal Title

      IEEE Transactions on Software Engineering

      Volume: 49 Issue: 4 Pages: 1842-1859

    • DOI

      10.1109/tse.2022.3194640

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] NPC: Neuron Path Coverage via Characterizing Decision Logic of Deep Neural Networks2022

    • Author(s)
      Xie Xiaofei、Li Tianlin、Wang Jian、Ma Lei、Guo Qing、Juefei-Xu Felix、Liu Yang
    • Journal Title

      ACM Transactions on Software Engineering and Methodology

      Volume: 31 Issue: 3 Pages: 1-27

    • DOI

      10.1145/3490489

    • Related Report
      2022 Annual Research Report 2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] DARTSRepair: Core-failure-set guided DARTS for network robustness to common corruptions2022

    • Author(s)
      Ren Xuhong、Chen Jianlang、Juefei-Xu Felix、Xue Wanli、Guo Qing、Ma Lei、Zhao Jianjun、Chen Shengyong
    • Journal Title

      Pattern Recognition

      Volume: 131 Pages: 108864-108864

    • DOI

      10.1016/j.patcog.2022.108864

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] On the usage and development of deep learning compilers: an empirical study on TVM2022

    • Author(s)
      Xiongfei Wu, Jinqiu Yang, Lei Ma, Yinxing Xue, and Jianjun Zhao
    • Journal Title

      Empirical Software Engineering volume 27, 172, Sep. 2022 (EMSE 2022, Impact Factor 3.762)

      Volume: 27

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Formalism-Driven Development: Concepts, Taxonomy, and Practice2022

    • Author(s)
      Ding Yepeng、Sato Hiroyuki
    • Journal Title

      Applied Sciences

      Volume: 12 Issue: 7 Pages: 3415-3415

    • DOI

      10.3390/app12073415

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] DeepRepair: Style-Guided Repairing for Deep Neural Networks in the Real-World Operational Environment2021

    • Author(s)
      Yu Bing、Qi Hua、Qing Guo、Juefei-Xu Felix、Xie Xiaofei、Ma Lei、Zhao Jianjun
    • Journal Title

      IEEE Transactions on Reliability

      Volume: - Issue: 4 Pages: 1-16

    • DOI

      10.1109/tr.2021.3096332

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] DeepSeer: Interactive RNN Explanation and Debugging via State Abstraction2023

    • Author(s)
      Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
    • Organizer
      The ACM CHI Conference on Human Factors in Computing Systems (CHI 2023, CORE Rank A*)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepLens: Interactive Out-of-Distribution Data Detection in NLP Models2023

    • Author(s)
      Da Song, Zhijie Wang, Yuheng Huang, Lei Ma, Tianyi Zhang
    • Organizer
      The ACM CHI Conference on Human Factors in Computing Systems (CHI 2023, CORE Rank A*)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Aries: Efficient Testing of Deep Neural Networks via Labeling-Free Accuracy Estimation2023

    • Author(s)
      Qiang Hu, Yuejun Guo, Xiaofei Xie, Maxime Cordy, Lei Ma, Mike Papadakis, Yves Le Traon
    • Organizer
      The 45th International Conference on Software Engineering (ICSE 2023, CORE Rank A*)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CodeS: Towards Code Model Generalization Under Distribution Shift2023

    • Author(s)
      Qiang Hu, Yuejun Guo, Xiaofei Xie, Maxime Cordy, Lei Ma, Mike Papadakis, Yves Le Traon
    • Organizer
      The 45th International Conference on Software Engineering, NIER Track (ICSE 2023, CORE Rank A* )
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepGemini: Verifying Dependency Fairness for Deep Neural Network2023

    • Author(s)
      Xuan Xie, Fuyuan Zhang, Xinwen Hu, Lei Ma
    • Organizer
      The Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023, CORE Rank A*)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Traceable In-Air Signature 3D Restoration Record Structure and In-Air Dominant Hand Biometric Based on Dynamic Time Warping Algorithm2023

    • Author(s)
      Yuheng Guo, Hiroyuki Sato
    • Organizer
      The 6th International Conference on Artificial Intelligence and Big Data (ICAIBD 2023) , 2023.
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] An Initial Analysis of Repair and Side-effect Prediction for Neural Networks2023

    • Author(s)
      Yuta Ishimoto, Ken Matsui, Masanari Kondo, Naoyasu Ubayashi, Yasutaka Kamei
    • Organizer
      The 2nd International Conference on AI Engineering - Software Engineering for AI (CAIN 2023)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 3D Segmenter: 3D Transformer based Semantic Segmentation via 2D Panoramic Distillation2023

    • Author(s)
      Zhennan Wu, Yang Li, Yifei Huang, Lin Gu, Tatsuya Harada, Hiroyuki Sato
    • Organizer
      The 11th Int'l Conference on Learning Representations (ICLR Core rank A*), 2023.
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] When Cyber-Physical Systems Meet AI: A Benchmark, an Evaluation, and a Way Forward2022

    • Author(s)
      Jiayang Song, Deyun Lyu, Zhenya Zhang, Zhijie Wang, Tianyi Zhang, Lei Ma
    • Organizer
      The 44th International Conference on Software Engineering, SEIP Track (ICSE 2022, CORE Rank A*)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] NeuRecover: Regression-Controlled Repair of Deep Neural Networks with Training History2022

    • Author(s)
      Shogo Tokui, Susumu Tokumoto, Akihito Yoshii, Fuyuki Ishikawa, Takao Nakagawa, Kazuki Munakata and Shinji Kikuchi
    • Organizer
      The 29th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2022), March 2022
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Formalism-Driven Development of Decentralized Systems2022

    • Author(s)
      Yepeng Ding, Hiroyuki Sato
    • Organizer
      Proc. 26th Int'l Conf. Engineering of Complex Computer Systems, March, 2022
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Learning to Adversarially Blur Visual Object Tracking2021

    • Author(s)
      Qing Guo, Ziyi Cheng, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yang Liu, and Jianjun Zhao
    • Organizer
      International Conference on Computer Vision, Montreal, Canada, 2021 (ICCV 2021, CORE Rank A*)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automatic RNN Repair via Model-based Analysis2021

    • Author(s)
      Xiaofei Xie, Wenbo Guo, Lei Ma, Wei Le, Jian Wang, Lingjun Zhou, Yang Liu, Xinyu Xing
    • Organizer
      The 38th International Conference on Machine Learning, 2021 (ICML 2021, CORE Rank A*)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Effective Hybrid System Falsification Using Monte Carlo Tree Search Guided by QB-Robustness2021

    • Author(s)
      Zhenya Zhang, Deyun Lyu, Paolo Arcaini, Lei Ma, Ichiro Hasuo and Jianjun Zhao
    • Organizer
      The 33rd International Conference on Computer-Aided Verification, 2021 (CAV 2021, CORE Rank A*)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automatic Web Testing using Curiosity-Driven Reinforcement Learning2021

    • Author(s)
      Yan Zheng, Yi Liu, Xiaofei Xie, Yepang Liu, Lei Ma, Jianye Hao, and Yang Liu
    • Organizer
      The 43rd International Conference on Software Engineering (ICSE 2021, CORE Rank A*)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Search-Based Testing Framework for Deep Neural Networks of Source Code Embedding2021

    • Author(s)
      Maryam V. Pour, Li Zhuo, Lei Ma and Hadi Hemmati
    • Organizer
      IEEE International Conference on Software Testing, Verification and Validation (ICST 2021, CORE Rank A)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Decision-Guided Weighted Automata Extraction from Recurrent Neural Networks2021

    • Author(s)
      Xiyue Zhang, Xiaoning Du, Xiaofei Xie, Lei Ma, Yang Liu, Meng Sun
    • Organizer
      Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021, CORE Rank A*)
    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] EfficientDeRain: Learning Pixel-wise Dilation Filtering for High-Efficiency Single-Image Deraining2021

    • Author(s)
      Qing Guo, Jingyang Sun, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Wei Feng, Yang Liu, and Jianjun Zhao
    • Organizer
      Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021, CORE Rank A*)
    • Related Report
      2021 Annual Research Report 2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] What to Blame? On the Granularity of Fault Localization for Deep Neural Networks2021

    • Author(s)
      Matias Duran, Xiao-Yi Zhang, Paolo Arcaini, Fuyuki Ishikawa
    • Organizer
      The 32nd International Symposium on Software Reliability Engineering (ISSRE 2021 Practical Experience Reports), pp.264-275, October 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Model-based Data-Complexity Estimator for Deep Learning Systems2021

    • Author(s)
      Yuta Ojima, Shingo Horiuchi, Fuyuki Ishikawa
    • Organizer
      The 3rd IEEE International Conference on Artificial Intelligence Testing (IEEE AI Tests 2021), pp.1-8, August 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Dynamic resource allocation among collocated applications via reinforcement learning2021

    • Author(s)
      Li Shaowen, Li Gen, SATO Hiroyuki
    • Organizer
      Proc. IEEE 6th Int'l Conf. Cloud Computing and Big Data Analytics, A0014, Chengdu, April, 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] In-air Signature Authentication Using Smartwatch Motion Sensors2021

    • Author(s)
      G. Li, L. Zhang and H. Sato
    • Organizer
      2021 IEEE 45th Annual Computers, Software, and Applications Conference (COMPSAC), 2021
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Watch out! Motion is Blurring the Vision of Your Deep Neural Networks2020

    • Author(s)
      Qing Gu, Felix Juefei-Xu, Xiaofei Xie, Lei Ma, Jian Wang, Bing Yu, Wei Feng, Yang Liu
    • Organizer
      Thirty-fourth Conference on Neural Information Processing Systems (NeurIPS 2020, CORE Rank A*)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A First Look at the Integration of Machine Learning Models in Complex Autonomous Driving Systems: a Case Study on Apollo2020

    • Author(s)
      Zi Peng, Jinqiu Yang, Tse-Hsun Chen, Lei Ma
    • Organizer
      The 28th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2020, CORE Rank A*)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] MARBLE: Model-Based Robustness Analysis of Stateful Deep Learning Systems2020

    • Author(s)
      Xiaoning Du, Yi Li, Xiaofei Xie, Lei Ma, Yang Liu, Jianjun Zhao
    • Organizer
      The 35th IEEE/ACM International Conference on Automated Software Engineering. (ASE 2020, CORE Rank A)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Cats Are Not Fish: Deep Learning Testing Calls for Out-Of-Distribution Awareness2020

    • Author(s)
      David Berend, Xiaofei Xie, Lei Ma, Lingjun Zhou, Yang Liu, Chi Xu, Jianjun Zhao
    • Organizer
      The 35th IEEE/ACM International Conference on Automated Software Engineering. (ASE 2020, CORE Rank A)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Few-Shot Guided Mix for DNN Repairing2020

    • Author(s)
      Xuhong Ren, Bing Yu, Hua Qi, Felix Juefei-Xu, Zhuo Li, Wanli Xue, Lei Ma and Jianjun Zhao
    • Organizer
      The 36th IEEE International Conference on Software Maintenance and Evolution, NIER Track (CORE Rank A)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms2020

    • Author(s)
      Hua Qi, Qing Guo, Felix Juefei-Xu, Xiaofei Xie, Lei Ma, Wei Feng, Yang Liu, Jianjun Zhao
    • Organizer
      Proceedings of the 28th ACM International Conference on Multimedia (ACM MM, CORE Rank A*)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices2020

    • Author(s)
      Run Wang,Felix Juefei-Xu, Yihao Huang, Qing Guo, Xiaofei Xie, Lei Ma, Yang Liu
    • Organizer
      Proceedings of the 28th ACM International Conference on Multimedia (ACM MM, CORE Rank A*)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Amora: Black-box Adversarial Morphing Attack2020

    • Author(s)
      Run Wang,Felix Juefei-Xu, Yihao Huang, Qing Guo, Xiaofei Xie, Lei Ma, Yang Liu
    • Organizer
      Proceedings of the 28th ACM International Conference on Multimedia (ACM MM, CORE Rank A*)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Automated Test Input Generation for Convolutional Neural Networks by Implementing Multi-objective Evolutionary Algorithms2020

    • Author(s)
      Lingfeng ZHANG, Hiroyuki SATO
    • Organizer
      2020 Eighth International Symposium on Computing and Networking Workshops (CANDARW)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2020-04-28   Modified: 2024-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi