• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Scalable Bayesian analysis of high-dimensional streaming counts

Research Project

Project/Area Number 17K17659
Research Category

Grant-in-Aid for Young Scientists (B)

Allocation TypeMulti-year Fund
Research Field Economic statistics
Statistical science
Research InstitutionThe University of Tokyo

Principal Investigator

Irie Kaoru  東京大学, 大学院経済学研究科(経済学部), 講師 (20789169)

Project Period (FY) 2017-04-01 – 2022-03-31
Project Status Completed (Fiscal Year 2021)
Budget Amount *help
¥4,160,000 (Direct Cost: ¥3,200,000、Indirect Cost: ¥960,000)
Fiscal Year 2020: ¥650,000 (Direct Cost: ¥500,000、Indirect Cost: ¥150,000)
Fiscal Year 2019: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Fiscal Year 2018: ¥1,430,000 (Direct Cost: ¥1,100,000、Indirect Cost: ¥330,000)
Fiscal Year 2017: ¥1,040,000 (Direct Cost: ¥800,000、Indirect Cost: ¥240,000)
Keywords計数データ / 時系列データ / 状態空間モデル / 逐次モンテカルロ法 / 縮小事前分布 / ロバスト統計 / 経済統計 / ベイズ統計学 / 時系列分析 / 経済統計学 / 統計数学
Outline of Final Research Achievements

Research on sequential analysis of streaming counts. I developed a state-space model of the Poisson observations, utilizing the gamma-beta Markov chain as the state evolution. The conjugacy of gamma distributions enables the filtering of posterior and predictive distributions. I also considered an extension to the model with dynamic discount factors, providing a custom sequential Monte Carlo method. It is a slight extension, but crucial in adapting the predictions to an abrupt burst of counts, which is often observed in the access log data of websites.

Academic Significance and Societal Importance of the Research Achievements

計数時系列データは様々な分野で見られるデータの一形態であり、本研究課題で開発・提案した統計モデルおよび分析手法が広く応用されることが期待される。また、短時間で計算を完了しなければならないという設定は、実務上よくみられる状況であり、実データに対する予測や意思決定の問題に現実的な解答を与えている点でも本研究の成果には意義がある。本研究の成果をもとに多くの研究プロジェクトが派生していることから、純粋に統計学上の問題としての意義もおおいに認められる。

Report

(6 results)
  • 2021 Annual Research Report   Final Research Report ( PDF )
  • 2020 Research-status Report
  • 2019 Research-status Report
  • 2018 Research-status Report
  • 2017 Research-status Report
  • Research Products

    (31 results)

All 2022 2021 2020 2019 2018 2017 Other

All Int'l Joint Research (5 results) Journal Article (5 results) (of which Int'l Joint Research: 2 results,  Peer Reviewed: 5 results,  Open Access: 3 results) Presentation (21 results) (of which Int'l Joint Research: 15 results,  Invited: 10 results)

  • [Int'l Joint Research] University of New Hampshire/City University of New York(米国)

    • Related Report
      2021 Annual Research Report
  • [Int'l Joint Research] University of New Hampshire/City University of New York(米国)

    • Related Report
      2020 Research-status Report
  • [Int'l Joint Research] University of New Hampshire(米国)

    • Related Report
      2019 Research-status Report
  • [Int'l Joint Research] University of New Hampshire/Vassar College/Duke University(米国)

    • Related Report
      2018 Research-status Report
  • [Int'l Joint Research] Vassar College/University of New Hampshire/Duke University(米国)

    • Related Report
      2017 Research-status Report
  • [Journal Article] Sequential modeling, monitoring and forecasting of streaming web traffic data.2022

    • Author(s)
      Irie, K., Glynn, C. and Aktekin, T.
    • Journal Title

      Annals of Applied Statistics

      Volume: 16 Pages: 300-325

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access / Int'l Joint Research
  • [Journal Article] Score-adjusted methods for estimation of shape parameters in Gamma-Poisson and Beta-Binomial distributions2022

    • Author(s)
      Tamae, H., Irie, K. and Kubokawa, T.
    • Journal Title

      Communication in Statistics - Simulation and Computation

      Volume: -

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed
  • [Journal Article] On global-local shrinkage for count data2021

    • Author(s)
      Hamura, Y., Irie, K., and Sugasawa, S.
    • Journal Title

      Bayesian Analysis

      Volume: -

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Journal Article] On the relationship between beta-Bartlett and Uhlig extended processes2021

    • Author(s)
      Pena, V. and Irie, K.
    • Journal Title

      Journal of Time Series Analysis

      Volume: 43 Pages: 147-153

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Contributed discussion of: Multilevel linear models, Gibbs samplers and multigrid decompositions, by Zanella, G. and Roberts, G.2021

    • Author(s)
      Irie, K. and Sugasawa, S.
    • Journal Title

      Bayesian Analysis

      Volume: 16 Pages: 1378-1380

    • Related Report
      2021 Annual Research Report
    • Peer Reviewed / Open Access
  • [Presentation] Bayesian dynamic fused lasso2021

    • Author(s)
      Kaoru Irie
    • Organizer
      Bayesian Inference in Stochastic Processes 12 (BISP12)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research / Invited
  • [Presentation] Robust regression with log-regularly varying error distributions2021

    • Author(s)
      Kaoru Irie (Yasuyuki Hamura and Shonosuke Sugasawa)
    • Organizer
      Eastern Asia Chapter of the International Society for Bayesian Analysis (EAC-ISBA 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] On the conjugate multivariate stochastic volatility processes2021

    • Author(s)
      Kaoru Irie (Victor Pena)
    • Organizer
      The 14th International Conference of the ERCIM WG on Computational and Methodological Statistics (CMStatistics 2021)
    • Related Report
      2021 Annual Research Report
    • Int'l Joint Research
  • [Presentation] 単調回帰のための事前分布2021

    • Author(s)
      入江薫(岡野遼、羽村靖之、菅澤翔之助)
    • Organizer
      2021年度統計関連学会連合大会
    • Related Report
      2021 Annual Research Report
  • [Presentation] Robust regression with log-regularly varying error distributions2021

    • Author(s)
      Kaoru Irie
    • Organizer
      日本統計学会春季大会
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] On the conjugate multivariate stochastic volatility processes2020

    • Author(s)
      Kaoru Irie
    • Organizer
      Webinar of Bayesian Econometrics 2020
    • Related Report
      2020 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Bayesian dynamic fused LASSO2019

    • Author(s)
      Kaoru Irie
    • Organizer
      EAC-ISBA 2019 (The 4th Eastern Asia meeting on Bayesian Statistics)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Bayesian dynamic fused LASSO2019

    • Author(s)
      Kaoru Irie
    • Organizer
      Japanese Joint Statistical Meeting (日本統計関連学会連合大会)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] Bayesian dynamic fused LASSO2019

    • Author(s)
      Kaoru Irie
    • Organizer
      CFE 2019 (The 13th International Conference on Computational and Financial Econometrics)
    • Related Report
      2019 Research-status Report
    • Int'l Joint Research
  • [Presentation] 縮小事前分布と状態空間モデル2019

    • Author(s)
      入江 薫
    • Organizer
      科研費シンポジウム「多様な分野における統計科学に関する諸問題」
    • Related Report
      2019 Research-status Report
  • [Presentation] 繰り返し対数関数を用いた縮小事前分布のクラスについて2019

    • Author(s)
      入江 薫
    • Organizer
      科研費研究集会「ベイズ計量経済学研究集会」
    • Related Report
      2019 Research-status Report
  • [Presentation] Adaptive Monitoring of Steaming Counts by Poisson-gamma State Space Models2018

    • Author(s)
      Kaoru Irie
    • Organizer
      International Society of Bayesian Analysis, world meeting (ISBA2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research
  • [Presentation] On-line analysis of count-valued time series by dynamic discount factors2018

    • Author(s)
      Kaoru Irie
    • Organizer
      2018年度統計関連学会連合大会
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] 状態空間モデルにおけるスパース性2018

    • Author(s)
      入江薫
    • Organizer
      科研費研究集会「ベイズ計量経済分析研究集会」
    • Related Report
      2018 Research-status Report
  • [Presentation] 割引因子ポアソン-ガンマ状態空間モデルによる計数時系列モデルの逐次分析2018

    • Author(s)
      入江薫
    • Organizer
      科研費研究集会「融合する統計科学」
    • Related Report
      2018 Research-status Report
    • Invited
  • [Presentation] Filtering for stochastic volatility with leverage by mixture approximation2018

    • Author(s)
      Kaoru Irie
    • Organizer
      The 12th International Conference on Computational and Financial Econometrics (CFE 2018)
    • Related Report
      2018 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Fox News Network Data Analysis: Bayesian Dynamic Modeling2017

    • Author(s)
      Kaoru Irie
    • Organizer
      2017 CSA-KSS-JSS International Conference
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Scalable Bayesian modeling, monitoring and analysis of dynamic network flow data2017

    • Author(s)
      Kaoru Irie
    • Organizer
      International Workshop on Bayesian Econometric Analysis
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] ベイジアン・モデリングによるポートフォリオ最適化2017

    • Author(s)
      入江 薫
    • Organizer
      2017年度統計関連学会連合大会
    • Related Report
      2017 Research-status Report
  • [Presentation] Bayesian Emulation for High-Dimensional Portfolio Problems2017

    • Author(s)
      Kaoru Irie
    • Organizer
      The 1st International Conference on Econometrics and Statistics (EcoSta 2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] Bayesian Emulation for Multi-Step Optimization in Portfolio Decisions2017

    • Author(s)
      Kaoru Irie
    • Organizer
      The Third International Conference on Engineering and Computational Mathematics (ECM2017)
    • Related Report
      2017 Research-status Report
    • Int'l Joint Research / Invited

URL: 

Published: 2017-04-28   Modified: 2023-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi