• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Development of new high-dimensional statistical analysis to deal with skewness of sample distribution

Research Project

Project/Area Number 20K11712
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeMulti-year Fund
Section一般
Review Section Basic Section 60030:Statistical science-related
Research InstitutionKanagawa University

Principal Investigator

Hyodo Masashi  神奈川大学, 経済学部, 教授 (00711764)

Project Period (FY) 2020-04-01 – 2024-03-31
Project Status Completed (Fiscal Year 2023)
Budget Amount *help
¥4,290,000 (Direct Cost: ¥3,300,000、Indirect Cost: ¥990,000)
Fiscal Year 2023: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2022: ¥780,000 (Direct Cost: ¥600,000、Indirect Cost: ¥180,000)
Fiscal Year 2021: ¥1,560,000 (Direct Cost: ¥1,200,000、Indirect Cost: ¥360,000)
Fiscal Year 2020: ¥1,170,000 (Direct Cost: ¥900,000、Indirect Cost: ¥270,000)
Keywords高次元データ / 正規化変換 / 誤差限界 / 多重比較 / 多変量分散分析 / 歪度 / 漸近正規性 / 一致性 / エッジワース展開
Outline of Research at the Start

高次元データ解析において、平均ベクトルの同等性検定のための検定統計量の近似分布として正規分布が利用される。高次元における検定理論では、このような正規近似が主流であり、次元が1,000~10,000程度であれば実用上十分な精度を有することが既に明らかにされている。一方で、次元が10~500程度(中程度)の場合は、高次元統計解析における検定統計量の実際の分布は、正規分布に比べて歪みをもつため正規近似の近似精度が極端に悪化するという問題がある。本研究では、検定統計量へ適当な変換を施すことで、標本分布の歪みを緩和させることを目的とする。

Outline of Final Research Achievements

Many approximate tests based on normal approximation have been proposed for hypothesis testing in high-dimensional statistical analysis. It has been revealed that these tests have sufficient accuracy when the dimension p is very large, such as 1000 to 10000. On the other hand, there is a problem that normal approximation does not work for data with medium dimension p, such as 10 to 500, because the distribution of test statistics is distorted. To address these problems, we proposed a new approximation test method that deals with distribution distortion by applying several analytical methods.

Academic Significance and Societal Importance of the Research Achievements

高次元データにおける近似的な仮説検定の多くは、中心極限定理を利用した漸近的な精度保証を行っている。しかし、漸近理論と有限次元のデータに乖離があるため実用性と説得性に欠ける。そこで、本研究では、エッジワース展開や検定統計量の適切な変換を与えることでより正確な漸近分布を導出する。このようなアプローチは古典的な大標本統計学ではよく用いられるが、高次元データにおいては十分に研究されているとは言えないため、古典的な多変量解析における漸近理論を大幅に発展させる可能性があると期待できる。

Report

(5 results)
  • 2023 Annual Research Report   Final Research Report ( PDF )
  • 2022 Research-status Report
  • 2021 Research-status Report
  • 2020 Research-status Report
  • Research Products

    (20 results)

All 2023 2022 2021 2020 Other

All Int'l Joint Research (4 results) Journal Article (6 results) (of which Int'l Joint Research: 3 results,  Peer Reviewed: 6 results) Presentation (7 results) (of which Int'l Joint Research: 2 results,  Invited: 1 results) Book (2 results) Remarks (1 results)

  • [Int'l Joint Research] Uppsala University(スウェーデン)

    • Related Report
      2023 Annual Research Report
  • [Int'l Joint Research] Uppsala University(スウェーデン)

    • Related Report
      2022 Research-status Report
  • [Int'l Joint Research] Tatjana Pavlenko(スウェーデン)

    • Related Report
      2021 Research-status Report
  • [Int'l Joint Research] スウェーデン王立工科大学(スウェーデン)

    • Related Report
      2020 Research-status Report
  • [Journal Article] A Behrens-Fisher problem for general factor models in high dimensions2023

    • Author(s)
      Hyodo Masashi、Nishiyama Takahiro、Pavlenko Tatjana
    • Journal Title

      Journal of Multivariate Analysis

      Volume: 195 Pages: 105162-105162

    • DOI

      10.1016/j.jmva.2023.105162

    • Related Report
      2023 Annual Research Report 2022 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] Normalizing transformation of Dempster type statistic in high-dimensional settings2022

    • Author(s)
      Hyodo Masashi、Watanabe Hiroki、Nakagawa Shigekazu、Nakagawa Tomoyuki
    • Journal Title

      Communications in Statistics - Theory and Methods

      Volume: ? Issue: 22 Pages: 1-18

    • DOI

      10.1080/03610926.2022.2056749

    • Related Report
      2021 Research-status Report
    • Peer Reviewed
  • [Journal Article] Kick-one-out-based variable selection method for Euclidean distance-based classifier in high-dimensional settings2021

    • Author(s)
      Nakagawa Tomoyuki、Watanabe Hiroki、Hyodo Masashi
    • Journal Title

      Journal of Multivariate Analysis

      Volume: 184 Pages: 104756-104756

    • DOI

      10.1016/j.jmva.2021.104756

    • Related Report
      2021 Research-status Report 2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Two-way MANOVA with unequal cell sizes and unequal cell covariance matrices in high-dimensional settings2020

    • Author(s)
      Watanabe Hiroki、Hyodo Masashi、Nakagawa Shigekazu
    • Journal Title

      Journal of Multivariate Analysis

      Volume: 179 Pages: 104625-104625

    • DOI

      10.1016/j.jmva.2020.104625

    • Related Report
      2020 Research-status Report
    • Peer Reviewed
  • [Journal Article] Testing for independence of high-dimensional variables: ρV-coefficient based approach2020

    • Author(s)
      Hyodo Masashi、Nishiyama Takahiro、Pavlenko Tatjana
    • Journal Title

      Journal of Multivariate Analysis

      Volume: 178 Pages: 104627-104627

    • DOI

      10.1016/j.jmva.2020.104627

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Journal Article] On error bounds for high-dimensional asymptotic distribution of L2-type test statistic for equality of means2020

    • Author(s)
      Hyodo Masashi、Nishiyama Takahiro、Pavlenko Tatjana
    • Journal Title

      Statistics & Probability Letters

      Volume: 157 Pages: 108637-108637

    • DOI

      10.1016/j.spl.2019.108637

    • Related Report
      2020 Research-status Report
    • Peer Reviewed / Int'l Joint Research
  • [Presentation] Tests for the equality of covariance matrices under a low dimensional factor structure2023

    • Author(s)
      兵頭昌, 西山貴弘, 渡邉弘己, 中川智之, 田畑耕治
    • Organizer
      日本計算機統計学会 第37回シンポジウム
    • Related Report
      2023 Annual Research Report
  • [Presentation] 高次元枠組みにおける分散共分散行列の同等性2023

    • Author(s)
      兵頭 昌, 西山 貴弘, 中川 智之, 田畑 耕治, 渡邉 弘己
    • Organizer
      統計関連学会連合大会
    • Related Report
      2023 Annual Research Report
  • [Presentation] A two sample Behrens-Fisher problem for factor models in high dimensions2021

    • Author(s)
      Takahiro Nishiyama, Masashi Hyodo, Tatjana Pavlenko
    • Organizer
      International Symposium on New Developments of Theories and Methodologies for Large Complex Data
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research / Invited
  • [Presentation] On the multiple comparison procedures among mean vectors for high-dimensional data under covariance heterogeneity2021

    • Author(s)
      Takahiro Nishiyama, Masashi Hyodo
    • Organizer
      International Conference on Econometrics and Statistics
    • Related Report
      2021 Research-status Report
    • Int'l Joint Research
  • [Presentation] ユークリッド距離に基づく判別分析の変数選択について2021

    • Author(s)
      中川智之,渡邉弘己,兵頭昌
    • Organizer
      2021年度応用統計学会年会
    • Related Report
      2021 Research-status Report
  • [Presentation] Normalized transformation of Dempster type statistic in high-dimensional setting2020

    • Author(s)
      兵頭昌, 渡邉弘己, 中川重和
    • Organizer
      日本計算機統計学会第34回大会
    • Related Report
      2020 Research-status Report
  • [Presentation] 楕円母集団から得られた2-step単調欠測データに基づく平均ベクトルの尤度比検定と検出力について2020

    • Author(s)
      米口貴誠, 首藤信通, 兵頭昌
    • Organizer
      日本計算機統計学会第34回シンポジウム
    • Related Report
      2020 Research-status Report
  • [Book] よくわかる!Rで身につく 統計学 入門2022

    • Author(s)
      兵頭 昌、中川 智之、渡邉 弘己
    • Total Pages
      208
    • Publisher
      共立出版
    • ISBN
      9784320114791
    • Related Report
      2022 Research-status Report
  • [Book] R・Pythonによる 統計データ科学2020

    • Author(s)
      杉山 高一, 櫻井 哲朗, 土屋 高宏, 兵頭 昌, 中村 好宏, 川崎 玉恵, 伊谷 陽祐, 杉山 高聖, 藤越 康祝, 塚田 真一, 西山 貴弘, 首藤 信通, 村上 秀俊, 小椋 透, 竹田 裕一, 榎本 理恵
    • Total Pages
      272
    • Publisher
      勉誠出版
    • ISBN
      458524011X
    • Related Report
      2020 Research-status Report
  • [Remarks]

    • URL

      https://scholar.google.com/citations?user=r7r9T-AAAAAJ&hl=en

    • Related Report
      2022 Research-status Report

URL: 

Published: 2020-04-28   Modified: 2025-01-30  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi