• Search Research Projects
  • Search Researchers
  • How to Use
  1. Back to previous page

Empirical Study on Applying Meta-analysis Methods in the Social Sciences and Psychological Research

Research Project

Project/Area Number 17530484
Research Category

Grant-in-Aid for Scientific Research (C)

Allocation TypeSingle-year Grants
Section一般
Research Field Educational psychology
Research InstitutionTokyo Kasei University

Principal Investigator

INOUE Shunya  Tokyo Kasei University, Home Economics, Associate Professor (90232537)

Co-Investigator(Kenkyū-buntansha) SUN Yuan  National Institute of Informatics, Information and Society Research, Associate Professor (00249939)
Project Period (FY) 2005 – 2007
Project Status Completed (Fiscal Year 2007)
Budget Amount *help
¥3,800,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥300,000)
Fiscal Year 2007: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2006: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 2005: ¥1,400,000 (Direct Cost: ¥1,400,000)
Keywordsmeta-analysis / review / literature collectinr / effect siz / standardized mean difference / confidence intervals / ブートストラップBCa法 / Excelマクロ / データベース / 分散説明率
Research Abstract

In the social sciences and psychological research, it is not unusual for plural research with the same research problems to have inconsistent results, or even have diametrically apposite results. Integrating separate research results into a coherent and comprehensive whole involves inferences as central to the validity of knowledge as the inferences involved in drawing conclusions from primary data analysis. As a method of research integrating, meta-analysis is recognized as useful and important, that it has rapidly gained acceptance and becomes popular in many foreign countries.
However in Japan meta-analysis methods are still not being widely used in the social sciences and psychological research The process of meta-analysis can be conceptualized as containing five stages: (1) problem formulation, (2) data collection or the literature search, (3) data evaluation: literature coding, (4) analysis and interpretation, and (5) presentation of results. In this study, we especially focused o … More n stages (2) and (4) which are considered as big obstacles to practice the meta-analysis methods for Japanese researchers.
For (2) data collection part, we used PsychInfo, Scopus and CJP (Citation Database for Japanese Papers) for selecting the relevant literatures based on bibliometric strategies, such as by using citation indexing, author indexing, number of citations and keywords extracting from the research papers. The effective strategies for searching the literatures comprehensively were investigated and discussed in our study. Concerning the stage (4), we paid attention to effect sizes, the base of the statistical methods in meta-analysis. In the social sciences and psychological research it seems that hypothesis significance testing has been given too much emphasis. In our study, we have shown the importance of reporting effect sizes which indude those information people can never obtain just from significance testing. The results of the studies were presented in a number of annual meetings ofJapanese academic societies.
Various factors may hinder using meta-analysis methods, and one of the reasons could be that there is currently no software available for calculating effect sizes and confidence intervals easily ; as we know it is practically impossible to calculate the values without computers. In this study, we developed an Excel macro computer program to estimate confidence intervals around the standardized mean difference 6 based on the bootstrap BC_a procedure. The results of our simulation show that our program can precisely estimate confidence intervals except when all the following situations happen simultaneously : the normality assumption is extremely violated, effect sizp is large, and sample size is very small. Less

Report

(4 results)
  • 2007 Annual Research Report   Final Research Report Summary
  • 2006 Annual Research Report
  • 2005 Annual Research Report
  • Research Products

    (27 results)

All 2008 2007 2006 2005

All Journal Article (12 results) Presentation (15 results)

  • [Journal Article] ブートストラップBCa法による効果量δの信頼区間2008

    • Author(s)
      井上 俊哉
    • Journal Title

      東京家政大学研究紀要、人文社会科学 48

      Pages: 1-7

    • NAID

      110006544783

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] 効果量に注目することの重要さ2008

    • Author(s)
      井上 俊哉
    • Journal Title

      東京家政大学附属臨床相談センター紀要 8

      Pages: 87-91

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Journal Article] BCa bootstrap confidence intervals for effect size S2008

    • Author(s)
      Shunya, Inoue
    • Journal Title

      Bulletin of Tokyo Kasei University Vol. 48

      Pages: 1-7

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Importance of reporting effect sizes2008

    • Author(s)
      Shunya, Inoue
    • Journal Title

      Bulletin of Center for Clinical Psychology of Tokyo Kasei University Vol. 8

      Pages: 87-91

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] ブートストラップBCa法による効果量δの信頼区間2008

    • Author(s)
      井上 俊哉
    • Journal Title

      東京家政大学研究紀要 第48集・人文社会科学 48

      Pages: 1-7

    • NAID

      110006544783

    • Related Report
      2007 Annual Research Report
  • [Journal Article] サンプルサイズと検定力分析2007

    • Author(s)
      井上 俊哉
    • Journal Title

      東京家政大学附属臨床相談センター紀要 7

      Pages: 57-62

    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] Sample size and power analysis2007

    • Author(s)
      Shunya, Inoue
    • Journal Title

      Bulletin of Center for Clinical Psychology of Tokyo Kasei University Vol. 7

      Pages: 57-62

    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Journal Article] サンプルサイズと検定力分析2007

    • Author(s)
      井上俊哉, 孫媛
    • Journal Title

      東京家政大学附属臨床相談センター紀要 7(印刷中)

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 教育心理学研究における効果量について2006

    • Author(s)
      井上俊哉, 孫媛
    • Journal Title

      日本教育心理学会第48回総会発表論文集 48

      Pages: 94-94

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 日本におけるメタ分析研究の現状2006

    • Author(s)
      孫媛, 井上俊哉
    • Journal Title

      日本教育心理学会第48回総会発表論文集 48

      Pages: 95-95

    • Related Report
      2006 Annual Research Report
  • [Journal Article] 心理学研究における効果量とその信頼区間2006

    • Author(s)
      井上俊哉, 孫媛
    • Journal Title

      日本行動計量学会第34回大会論文抄録集 34

      Pages: 50-51

    • Related Report
      2006 Annual Research Report
  • [Journal Article] メタ分析における文献収集方略の研究2005

    • Author(s)
      孫 媛, 井上 俊哉
    • Journal Title

      日本教育心理学会第47回総会発表論文集 47

      Pages: 3-3

    • Related Report
      2005 Annual Research Report
  • [Presentation] 日本語による研究のメタ分析の可能性2007

    • Author(s)
      孫 媛, 井上 俊哉
    • Organizer
      日本教育心理学会第49回総会
    • Place of Presentation
      文教大学
    • Year and Date
      2007-09-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] 教育心理学研究における効果量報告の意義2007

    • Author(s)
      井上 俊哉, 孫 媛
    • Organizer
      日本教育心理学会第49回総会
    • Place of Presentation
      文教大学
    • Year and Date
      2007-09-15
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Annual Research Report 2007 Final Research Report Summary
  • [Presentation] A study on the significance of reporting effect size in educational psychology research2007

    • Author(s)
      Shunya, Inoue, et. al.
    • Organizer
      The 49th annual meeting of the Japanese Association of Educational Psychology
    • Place of Presentation
      Bunkyo University
    • Year and Date
      2007-09-15
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Applicability of meta-analysis for research in Japanese2007

    • Author(s)
      Yuan, Sun, et. al.
    • Organizer
      The 49th annual meeting of the Japanese Association of Educational Psychology
    • Place of Presentation
      Bunkyo University
    • Year and Date
      2007-09-15
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 効果量δとその信頼区間2007

    • Author(s)
      井上 俊哉, 孫 媛
    • Organizer
      日本行動計量学会第35回大会
    • Place of Presentation
      同志社大学
    • Year and Date
      2007-09-04
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 効果量δとその信頼区間2007

    • Author(s)
      井上 俊哉
    • Organizer
      日本行動欝量学会第35回大会
    • Place of Presentation
      同志社大学
    • Year and Date
      2007-09-04
    • Related Report
      2007 Annual Research Report
  • [Presentation] 教育心理学研究における効果量について2006

    • Author(s)
      井上 俊哉, 孫 媛
    • Organizer
      日本教育心理学会第48回総会
    • Place of Presentation
      岡山大学
    • Year and Date
      2006-09-16
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 日本におけるメタ分析研究の現状2006

    • Author(s)
      孫 媛, 井上 俊哉
    • Organizer
      日本教育心理学会第48回総会
    • Place of Presentation
      岡山大学
    • Year and Date
      2006-09-16
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Study on effect sizes in educational psychology research2006

    • Author(s)
      Shunya, Inoue, et. al.
    • Organizer
      The 48th annual meeting of the Japanese Association of Educational Psychology
    • Place of Presentation
      Okayama University
    • Year and Date
      2006-09-16
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Meta-analysis research in Japan2006

    • Author(s)
      Yuan, Sun, et. al.
    • Organizer
      The 48th annual meeting of the Japanese Association of Educational Psychology
    • Place of Presentation
      Okayama University
    • Year and Date
      2006-09-16
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] 心理学研究における効果量とその信頼区間2006

    • Author(s)
      井上 俊哉, 孫 媛
    • Organizer
      日本行動計量学会第34回大会
    • Place of Presentation
      聖学院大学
    • Year and Date
      2006-09-12
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Confidence intervals and effect sizes in psychological research2006

    • Author(s)
      Shunya, Inoue, et. al.
    • Organizer
      The 34th annual meeting of the Behaviormetric Society of Japan
    • Place of Presentation
      Seigakuin University
    • Year and Date
      2006-09-12
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Effect size 6 and its confidence intervals2006

    • Author(s)
      Shunya, Inoue, et. al.
    • Organizer
      The 35th annual meeting of the Behaviormetric Society of Japan
    • Place of Presentation
      Doshisha University
    • Year and Date
      2006-09-12
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] メタ分析における文献収集方略の研究2005

    • Author(s)
      孫 媛, 井上 俊哉
    • Organizer
      日本教育心理学会第47回総会
    • Place of Presentation
      北海道浅井学園大学
    • Year and Date
      2005-09-17
    • Description
      「研究成果報告書概要(和文)」より
    • Related Report
      2007 Final Research Report Summary
  • [Presentation] Research on bibliometric tool in meta-analysis2005

    • Author(s)
      Yuan, Sun, et. al.
    • Organizer
      The 47th annual meeting of the Japanese Association of Educational Psychology
    • Place of Presentation
      Hokkaidou Asaigakuen University
    • Year and Date
      2005-09-17
    • Description
      「研究成果報告書概要(欧文)」より
    • Related Report
      2007 Final Research Report Summary

URL: 

Published: 2005-04-01   Modified: 2016-04-21  

Information User Guide FAQ News Terms of Use Attribution of KAKENHI

Powered by NII kakenhi