• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Evaluating reliability for data-driven hypotheses generated by exploratory analysis, and its validation in life science

Research Project

Project/Area Number 20H00601
Research Category

Grant-in-Aid for Scientific Research (A)

Allocation TypeSingle-year Grants
Section一般
Review Section Medium-sized Section 61:Human informatics and related fields
Research InstitutionNagoya University (2022-2024)
Nagoya Institute of Technology (2020-2021)

Principal Investigator

Takeuchi Ichiro  名古屋大学, 工学研究科, 教授 (40335146)

Co-Investigator(Kenkyū-buntansha) 花田 博幸  国立研究開発法人理化学研究所, 革新知能統合研究センター, 研究員 (00793035)
寺田 吉壱  大阪大学, 大学院基礎工学研究科, 准教授 (10738793)
稲津 佑  名古屋工業大学, 工学(系)研究科(研究院), 助教 (20869896)
本谷 秀堅  名古屋工業大学, 工学(系)研究科(研究院), 教授 (60282688)
津田 宏治  東京大学, 大学院新領域創成科学研究科, 教授 (90357517)
Project Period (FY) 2020-04-01 – 2025-03-31
Project Status Completed (Fiscal Year 2024)
Budget Amount *help
¥43,290,000 (Direct Cost: ¥33,300,000、Indirect Cost: ¥9,990,000)
Fiscal Year 2024: ¥6,110,000 (Direct Cost: ¥4,700,000、Indirect Cost: ¥1,410,000)
Fiscal Year 2023: ¥10,010,000 (Direct Cost: ¥7,700,000、Indirect Cost: ¥2,310,000)
Fiscal Year 2022: ¥10,010,000 (Direct Cost: ¥7,700,000、Indirect Cost: ¥2,310,000)
Fiscal Year 2021: ¥10,920,000 (Direct Cost: ¥8,400,000、Indirect Cost: ¥2,520,000)
Fiscal Year 2020: ¥6,240,000 (Direct Cost: ¥4,800,000、Indirect Cost: ¥1,440,000)
Keywords機械学習 / 統計的推測 / 不確実性定量化 / 統計科学 / 人工知能 / 選択的推論 / 生命科学 / データサイエンス / 統計的仮説検定 / 教師なし学習 / 医療情報学
Outline of Research at the Start

機械学習などのデータ科学に基づく科学研究はデータ駆動型科学と呼ばれ,データ分析によって仮説を自動生成するため,研究者の知識や経験からは想起できないような新しい仮説を生み出せる可能性がある.しかし,複雑なデータを複雑なアルゴリズムで分析して得られる「データ駆動型仮説」はデータに過剰に適合している可能性があり,信頼性評価が難しい.生命医療分野など誤った判断のもたらすリスクが大きい場合,データ駆動型仮説の信頼性を適切に評価する枠組が不可欠である.本研究では,探索的データ分析によって得られたデータ駆動型仮説の信頼性評価を行う方法を開発する.

Outline of Final Research Achievements

This study aims to evaluate the reliability of AI, particularly deep learning models, by advancing both the theoretical and computational aspects of a novel statistical framework -selective inference- so that it can be effectively applied to deep learning. Traditionally, the complex computational processes involved in deep learning have made it difficult to assess statistical significance. However, this research enables accurate quantification of such significance. As a result, even in high-stakes fields such as medicine, where erroneous decisions can have serious consequences, the reliability of AI outputs can be explicitly demonstrated, thereby supporting the safe and trustworthy deployment of AI. This represents a major achievement that contributes to the development of highly reliable AI systems.

Academic Significance and Societal Importance of the Research Achievements

本研究は,選択的推論という新たな統計的推測手法を,理論および計算の両面から発展させることで,深層学習モデルによる意思決定の統計的有意性評価を可能とした.これにより,誤った判断が深刻な影響を及ぼす医療などの高リスク分野においても,AIの判断結果に対する信頼性を明確に示すことが可能となり,リスクを制御した上でAIを安心して活用できる環境の構築に貢献する.急速に進展するAI技術の活用に対し,その信頼性を担保する手法の整備は,学術的にも社会的にも極めて重要であり,本研究はその基盤を提供する意義深い成果である.

Report

(7 results)
  • 2024 Annual Research Report   Final Research Report ( PDF )
  • 2023 Annual Research Report
  • 2022 Annual Research Report
  • 2021 Annual Research Report
  • 2020 Comments on the Screening Results   Annual Research Report
  • Research Products

    (41 results)

All 2024 2023 2022 2021 2020

All Journal Article (25 results) (of which Int'l Joint Research: 7 results,  Peer Reviewed: 25 results,  Open Access: 17 results) Presentation (16 results) (of which Int'l Joint Research: 15 results,  Invited: 1 results)

  • [Journal Article] Bounded p-values in Parametric Programming-based Selective Inference.2024

    • Author(s)
      Tomohiro Shiraishi, Daiki Miwa, Vo Nguyen Le Duy and Ichiro Takeuchi.
    • Journal Title

      Japanese Journal of Statistics and Data Science

      Volume: -

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Selective Inference for Changepoint Detection by Recurrent Neural Network2024

    • Author(s)
      Tomohiro Shiraishi, Daiki Miwa, Vo Nguyen Le Duy, Ichiro Takeuchi.
    • Journal Title

      Neural Computation

      Volume: -

    • Related Report
      2024 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] A Confidence Machine for Sparse High-Order Interaction Model2024

    • Author(s)
      Das D., Ndiaye E. and Takeuchi I.
    • Journal Title

      Stat

      Volume: -

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Case-based Similar Image Retrieval for Weakly Annotated Large Histopathological Images of Malignant Lymphoma Using Deep Metric Learning2023

    • Author(s)
      Hashimoto N., Takagi Y., Masuda H., Miyoshi H., Kohno K., Nagaishi M., Sato K., Takeuchi M., Furuta T., Kawamoto K., Yamada K., Moritsubo M., Inoue K., Shimasaki Y., Ogura Y., Imamoto T., Mishina T., Tanaka K., Kawaguchi Y., Nakamura S., Ohshima K., Hontani H., Takeuchi I.
    • Journal Title

      Medical Image Analysis

      Volume: -

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Generalized Low-Rank Update: Model Parameter Bounds for Low-Rank Training Data Modifications2023

    • Author(s)
      Hanada H., Hashimoto N., Taji K. and Takeuchi I.
    • Journal Title

      Neural Computation

      Volume: -

    • Related Report
      2023 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Root-finding Approaches for Computing Conformal Prediction Set.2022

    • Author(s)
      Ndiaye E., Takeuchi I.
    • Journal Title

      Machine Learning

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] More Powerful Conditional Selective Inference for Generalized Lasso by Parametric Programming.2022

    • Author(s)
      Duy V.N.L., Takeuchi I.
    • Journal Title

      Journal of Machine Learning Research

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Conditional Selective Inference for Robust Regression and Outlier Detection using Piecewise-Linear Homotopy Continuation.2022

    • Author(s)
      Tsukurimichi T., Inatsu Y., Duy V.N.L., Takeuchi I.
    • Journal Title

      Annals of Institute of Statistical Mathematics

      Volume: -

    • Related Report
      2022 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Subtype Classification of Malignant Lymphoma Using Immunohistochemical Staining Pattern2022

    • Author(s)
      Noriaki Hashimoto, Kaho Ko, Tatsuya Yokota, Kei Kohno, Masato Nakaguro, Shigeo Nakamura, Ichiro Takeuchi, Hidekata Hontani
    • Journal Title

      International Journal of Computer Assisted Radiology and Surgery

      Volume: 17

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Fast and More Powerful Selective Inference for Sparse High-order Interaction Model2022

    • Author(s)
      Diptesh Das, Vo Nguyen Le Duy, Hiroyuki Hanada, Koji Tsuda, Ichiro Takeuchi
    • Journal Title

      Proceedings of AAAI Conference on Artificial Intelligence (AAAI2022)

      Volume: NA

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Bayesian Quadrature Optimization for Probability Threshold Robustness Measure2021

    • Author(s)
      Shogo Iwazaki, Yu Inatsu, Ichiro Takeuchi
    • Journal Title

      Neural Computation

      Volume: 33 Pages: 3413-3466

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Distance Metric Learning for Graph Structured Data2021

    • Author(s)
      Tomoki Yoshida, Ichiro Takeuchi, Masayuki Karasuyama
    • Journal Title

      Machine Learning

      Volume: 110 Pages: 1765-1811

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Parametric Programming Approach for More Powerful and General Lasso Selective Inference2021

    • Author(s)
      Vo Nguyen Le Duy, Ichiro Takeuchi
    • Journal Title

      Proceedings of International Conference on Artifical Intelligence and Statistics (AISTATS2021)

      Volume: NA

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Mean-Variance Analysis in Bayesian Optimization under Uncertainty2021

    • Author(s)
      Shogo Iwazaki, Yu Inatsu, Ichiro Takeuchi
    • Journal Title

      Proceedings of International Conference on Artifical Intelligence and Statistics (AISTATS2021)

      Volume: NA

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Active Learning for Distributionally Robust Level-Set Estimation2021

    • Author(s)
      Yu Inatsu, Shogo Iwazaki, Ichiro Takeuchi
    • Journal Title

      Proceedings of International Conference on Machine Learning 2021 (ICML2021)

      Volume: NA

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] More Powerful and General Selective Inference for Stepwise Feature Selection using Homotopy Method2021

    • Author(s)
      Kazuya Sugiyama, Vo Nguyen Le Duy, Ichiro Takeuchi
    • Journal Title

      Proceedings of International Conference on Machine Learning 2021 (ICML2021)

      Volume: NA

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Exploration of natural red-shifted rhodopsins using a machine learning-based Bayesian experimental design2021

    • Author(s)
      Inoue Keiichi、Karasuyama Masayuki、Nakamura Ryoko、Konno Masae、Yamada Daichi、Mannen Kentaro、Nagata Takashi、Inatsu Yu、Yawo Hiromu、Yura Kei、Beja Oded、Kandori Hideki、Takeuchi Ichiro
    • Journal Title

      Communications Biology

      Volume: 4 Issue: 1 Pages: 362-362

    • DOI

      10.1038/s42003-021-01878-9

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Selective inference for high-order interaction features selected in a stepwise manner2021

    • Author(s)
      Shinya Suzumura, Kazuya Nakagawa, Yuta Umezu, Koji Tsuda, Ichiro Takeuchi
    • Journal Title

      IPSJ Transactions on Bioinformatics

      Volume: 14 Issue: 0 Pages: 1-11

    • DOI

      10.2197/ipsjtbio.14.1

    • NAID

      130007985966

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Bayesian Experimental Design for Finding Reliable Level Set under Input Uncertainty2020

    • Author(s)
      Shogo Iwazaki, Yu Inatsu, Ichiro Takeuchi.
    • Journal Title

      IEEE Access

      Volume: 8 Pages: 203982-203993

    • DOI

      10.1109/access.2020.3036863

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Computing Valid p-value for Optimal Changepoint by Selective Inference using Dynamic Programming.2020

    • Author(s)
      Vo Nguyen Le Duy, Hiroki Toda, Ryota Sugiyama, Ichiro Takeuchi
    • Journal Title

      Proceedings of 34th Conference on Neural Information Processing Systems (NeurIPS2020)

      Volume: NA

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Active Learning for Level Set Estimation Under Input Uncertainty and Its Extensions2020

    • Author(s)
      Yu Inatsu, Masayuki Karasuyama, Keiichi Inoue, Ichiro Takeuchi
    • Journal Title

      Neural Computation

      Volume: 32 Issue: 12 Pages: 2486-2531

    • DOI

      10.1162/neco_a_01332

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Active Learning of Bayesian Linear Models with High-Dimensional Binary Features by Parameter Confidence-Region Estimation2020

    • Author(s)
      Inatsu Yu、Karasuyama Masayuki、Inoue Keiichi、Kandori Hideki、Takeuchi Ichiro
    • Journal Title

      Neural Computation

      Volume: 32 Issue: 10 Pages: 1998-2031

    • DOI

      10.1162/neco_a_01310

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Active Learning for Enumerating Local Minima Based on Gaussian Process Derivatives2020

    • Author(s)
      Inatsu Yu、Sugita Daisuke、Toyoura Kazuaki、Takeuchi Ichiro
    • Journal Title

      Neural Computation

      Volume: 32 Issue: 10 Pages: 2032-2068

    • DOI

      10.1162/neco_a_01307

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed
  • [Journal Article] Computing Valid P-Values for Image Segmentation by Selective Inference2020

    • Author(s)
      Tanizaki Kosuke、Hashimoto Noriaki、Inatsu Yu、Hontani Hidekata、Takeuchi Ichiro
    • Journal Title

      Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020 (CVPR2020)

      Volume: - Pages: 9550-9559

    • DOI

      10.1109/cvpr42600.2020.00957

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype Classification with Unannotated Histopathological Images2020

    • Author(s)
      Hashimoto Noriaki、Fukushima Daisuke、Koga Ryoichi、Takagi Yusuke、Ko Kaho、Kohno Kei、Nakaguro Masato、Nakamura Shigeo、Hontani Hidekata、Takeuchi Ichiro
    • Journal Title

      Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020 (CVPR2020)

      Volume: - Pages: 3851-3860

    • DOI

      10.1109/cvpr42600.2020.00391

    • Related Report
      2020 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Statistical Test for Attention Maps in Vision Transformers2024

    • Author(s)
      Tomohiro Shiraishi, Daiki Miwa, Teruyuki Katsuoka, Vo Nguyen Le Duy, Kouichi Taji, Ichiro Takeuchi
    • Organizer
      International Conference on Machine Learning (ICML)The International Conference on AI and Statistics
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] CAD-DA: Controllable Anomaly Detection after Domain Adaptation by Statistical Inference2024

    • Author(s)
      Duy Vo Nguyen Le, Hsuan-Tien Lin, Ichiro Takeuchi.
    • Organizer
      AI&Statistics
    • Related Report
      2024 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multi-objective Bayesian Optimization with Active Preference Learning2024

    • Author(s)
      Ozaki R., Ishikawa K., Kanzaki Y., Takeno S., Takeuchi I., Karasuyama M.
    • Organizer
      AAAI Conference on Artificial Intelligence
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] A Stopping Criterion for Bayesian Optimization by The Gap of Expected Minimum Simple Regrets2023

    • Author(s)
      Ishibashi H., Karasuyama M., Takeuchi I., Hino H.
    • Organizer
      The International Conference on AI and Statistics
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Valid P-Value for Deep Learning-driven Salient Region2023

    • Author(s)
      Miwa D., Duy V.N.L., Takeuchi I.
    • Organizer
      International Conference on Learning Representation
    • Related Report
      2023 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Quantifying Statistical Significance of Neural Network-based Image Segmentation by Selective Inference.2022

    • Author(s)
      Duy V.N.L., Iwazaki S., Takeuchi I.
    • Organizer
      Neural Information Processing Systems (NeurIPS)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Bayesian Optimization for Distributionally Robust Chance-constrained Problem.2022

    • Author(s)
      Inatsu Y., Takeno S., Karasuyama M., Takeuchi I.
    • Organizer
      International Conference on Machine Learning (ICML)
    • Related Report
      2022 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Fast and More Powerful Selective Inference for Sparse High-order Interaction Model2022

    • Author(s)
      Diptesh Das, Vo Nguyen Le Duy, Hiroyuki Hanada, Koji Tsuda, Ichiro Takeuchi
    • Organizer
      AAAI Conference on Artificial Intelligence (AAAI2022)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Parametric Programming Approach for More Powerful and General Lasso Selective Inference2021

    • Author(s)
      Vo Nguyen Le Duy, Ichiro Takeuchi
    • Organizer
      International Conference on Artifical Intelligence and Statistics (AISTATS2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Mean-Variance Analysis in Bayesian Optimization under Uncertainty2021

    • Author(s)
      Shogo Iwazaki, Yu Inatsu, Ichiro Takeuchi
    • Organizer
      International Conference on Artifical Intelligence and Statistics (AISTATS2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] More Powerful and General Selective Inference for Stepwise Feature Selection using Homotopy Method2021

    • Author(s)
      Kazuya Sugiyama, Vo Nguyen Le Duy, Ichiro Takeuchi
    • Organizer
      International Conference on Machine Learning 2021 (ICML2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Active Learning for Distributionally Robust Level-Set Estimation2021

    • Author(s)
      Yu Inatsu, Shogo Iwazaki, Ichiro Takeuchi
    • Organizer
      International Conference on Machine Learning 2021 (ICML2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] パラメトリック計画法による選択的推論とその応用2020

    • Author(s)
      竹内一郎
    • Organizer
      電子情報通信学会IBISML研究会
    • Related Report
      2020 Annual Research Report
    • Invited
  • [Presentation] Computing Valid p-value for Optimal Changepoint by Selective Inference using Dynamic Programming.2020

    • Author(s)
      Vo Nguyen Le Duy, Hiroki Toda, Ryota Sugiyama, Ichiro Takeuchi
    • Organizer
      34th Conference on Neural Information Processing Systems (NeurIPS2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Computing Valid P-values for Image Segmentation by Selective Inference.2020

    • Author(s)
      Kosuke Tanizaki, Noriaki Hashimoto, Yu Inatsu, Hidekata Hontani, Ichiro Takeuchi
    • Organizer
      IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020 (CVPR2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research
  • [Presentation] Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype Classification with Non-annotated Histopathological Images2020

    • Author(s)
      Noriaki Hashimoto, Daisuke Fukushima, Ryoichi Koga, Yusuke Takagi, Kaho Ko, Kei Kohno, Masato Nakaguro, Shigeo Nakamura, Hidekata Hontani, Ichiro Takeuchi
    • Organizer
      IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020 (CVPR2020)
    • Related Report
      2020 Annual Research Report
    • Int'l Joint Research

URL: 

Published: 2020-04-28   Modified: 2026-01-16  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi