• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Improving Information Geometry of Markov Chains for Data-Science

Research Project

Project/Area Number 23K13024
Research Category

Grant-in-Aid for Early-Career Scientists

Allocation TypeMulti-year Fund
Review Section Basic Section 12040:Applied mathematics and statistics-related
Research InstitutionInstitute of Physical and Chemical Research

Principal Investigator

Wolfer Geoffrey  国立研究開発法人理化学研究所, 革新知能統合研究センター, 基礎科学特別研究員 (10965784)

Project Period (FY) 2023-04-01 – 2026-03-31
Project Status Granted (Fiscal Year 2023)
Budget Amount *help
¥4,420,000 (Direct Cost: ¥3,400,000、Indirect Cost: ¥1,020,000)
Fiscal Year 2025: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2024: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Fiscal Year 2023: ¥1,820,000 (Direct Cost: ¥1,400,000、Indirect Cost: ¥420,000)
KeywordsInformation geometry / Markov chains / Identity testing / Markov Chain Monte Carlo / Data science
Outline of Research at the Start

This project has three objectives: (1) to deepen our theoretical understanding of the information geometry of Markov models (2) to develop new geometrical tools and methods for the data-science community (3) to demonstrate their applicability by addressing modern inference problems in Markov chains.

Outline of Annual Research Achievements

The primary focus of my research in FY23 was demonstrating how geometric techniques can be applied to modern problems in Markov chains within the field of data science.

In the theory we developed, allowable mappings between Markov chains all possess an operational (data-processing) interpretation, and as a result, the applicability of our theory follows by design. This year, we showed how our Markov embeddings aid in developing reduction techniques for modern Markov chain inference problems. Specifically, we devised a method to reduce identity testing of reversible Markov chains to that of symmetric ones. Our method recovers state-of-the-art sample complexity in most regimes and applies beyond the immediate problem, including tolerant testing settings.

In parallel work, we observed that one could recover many of the established “reversiblizations” of (non-reversible) Markov chains by regarding them as a geometric projection of the chain onto the reversible set. In particular, although it was previously understood that the Metropolis-Hastings algorithm is a form of reversiblization corresponding to a specific divergence, we demonstrated how exploring different notions of divergences can give rise to other widely used sampling algorithms. Notably, we recover the Markov Chain Monte Carlo (MCMC) algorithm based on Barker dynamics, which has recently gained popularity. This is important because it can help practioners develop new MCMC algorithms using a similar approach.

Current Status of Research Progress
Current Status of Research Progress

1: Research has progressed more than it was originally planned.

Reason

The progress on the applicative side of the project is already considerable.

In terms of output, we successfully secured immediate acceptance of both our works at our top choices of venues: one oral presentation at the international conference on Geometric Science of Information (GSI'2023) and one publication in the IEEE Transactions on Information Theory journal, the reference in the field of information theory. These achievements serve as significant milestones, demonstrating the applicability of our framework to modern problems in probability and statistics.

Furthermore, our research has ignited interest within the statistical physics community, as we were invited to write an academic survey on the topic of information geometry of Markov chains.

Strategy for Future Research Activity

Given the substantial progress in the more applicative aspects of the project in FY23, I will recenter the emphasis on the theoretical facets of my project in FY24.

Specifically, I will make progress on geometric classifications of families of transition matrices, at least for spaces of size up to 3. This will be a significant stepping stone towards a Cencov-type theorem in the context of Markov chains.

In parallel, I will continue to explore connection between information geometry of Markov chains and core questions in statistics such as mixing properties of Markov chains, Markov Chain Monte Carlo algorithms or hypothesis testing in order to further demonstrate the value of my approach.

Report

(1 results)
  • 2023 Research-status Report
  • Research Products

    (6 results)

All 2024 2023 Other

All Int'l Joint Research (1 results) Journal Article (4 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 4 results,  Open Access: 4 results) Presentation (1 results)

  • [Int'l Joint Research] National University of Singapore(シンガポール)

    • Related Report
      2023 Research-status Report
  • [Journal Article] Geometric Aspects of Data-Processing of Markov Chains2024

    • Author(s)
      Wolfer Geoffrey、Watanabe Shun
    • Journal Title

      Transactions of Mathematics and Its Applications

      Volume: - Issue: 1

    • DOI

      10.1093/imatrm/tnae001

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Systematic Approaches to Generate Reversiblizations of Markov Chains2024

    • Author(s)
      Choi Michael C. H.、Wolfer Geoffrey
    • Journal Title

      IEEE Transactions on Information Theory

      Volume: 70 Issue: 5 Pages: 3145-3161

    • DOI

      10.1109/tit.2023.3304685

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Information geometry of Markov Kernels: a survey2023

    • Author(s)
      Wolfer Geoffrey、Watanabe Shun
    • Journal Title

      Frontiers in Physics

      Volume: 11 Pages: 1195562-1195562

    • DOI

      10.3389/fphy.2023.1195562

    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access
  • [Journal Article] Geometric Reduction for Identity Testing of Reversible Markov Chains2023

    • Author(s)
      Wolfer Geoffrey、Watanabe Shun
    • Journal Title

      Geometric Science of Information (GSI 2023). Lecture Notes in Computer Science.

      Volume: 14071 Pages: 328-337

    • DOI

      10.1007/978-3-031-38271-0_32

    • ISBN
      9783031382703, 9783031382710
    • Related Report
      2023 Research-status Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Presentation] マルコフ埋め込みを用いた対称性から可逆性への性質変換とマルコフ連鎖の同一性テストへの応用2023

    • Author(s)
      Wolfer Geoffrey、Watanabe Shun
    • Organizer
      第46回情報理論とその応用シンポジウム(SITA 2023)
    • Related Report
      2023 Research-status Report

URL: 

Published: 2023-04-13   Modified: 2024-12-25  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi