Empirical Study on Applying Meta-analysis Methods in the Social Sciences and Psychological Research
Project/Area Number |
17530484
|
Research Category |
Grant-in-Aid for Scientific Research (C)
|
Allocation Type | Single-year Grants |
Section | 一般 |
Research Field |
Educational psychology
|
Research Institution | Tokyo Kasei University |
Principal Investigator |
INOUE Shunya Tokyo Kasei University, Home Economics, Associate Professor (90232537)
|
Co-Investigator(Kenkyū-buntansha) |
SUN Yuan National Institute of Informatics, Information and Society Research, Associate Professor (00249939)
|
Project Period (FY) |
2005 – 2007
|
Project Status |
Completed (Fiscal Year 2007)
|
Budget Amount *help |
¥3,800,000 (Direct Cost: ¥3,500,000、Indirect Cost: ¥300,000)
Fiscal Year 2007: ¥1,300,000 (Direct Cost: ¥1,000,000、Indirect Cost: ¥300,000)
Fiscal Year 2006: ¥1,100,000 (Direct Cost: ¥1,100,000)
Fiscal Year 2005: ¥1,400,000 (Direct Cost: ¥1,400,000)
|
Keywords | meta-analysis / review / literature collectinr / effect siz / standardized mean difference / confidence intervals / ブートストラップBCa法 / Excelマクロ / データベース / 分散説明率 |
Research Abstract |
In the social sciences and psychological research, it is not unusual for plural research with the same research problems to have inconsistent results, or even have diametrically apposite results. Integrating separate research results into a coherent and comprehensive whole involves inferences as central to the validity of knowledge as the inferences involved in drawing conclusions from primary data analysis. As a method of research integrating, meta-analysis is recognized as useful and important, that it has rapidly gained acceptance and becomes popular in many foreign countries. However in Japan meta-analysis methods are still not being widely used in the social sciences and psychological research The process of meta-analysis can be conceptualized as containing five stages: (1) problem formulation, (2) data collection or the literature search, (3) data evaluation: literature coding, (4) analysis and interpretation, and (5) presentation of results. In this study, we especially focused o
… More
n stages (2) and (4) which are considered as big obstacles to practice the meta-analysis methods for Japanese researchers. For (2) data collection part, we used PsychInfo, Scopus and CJP (Citation Database for Japanese Papers) for selecting the relevant literatures based on bibliometric strategies, such as by using citation indexing, author indexing, number of citations and keywords extracting from the research papers. The effective strategies for searching the literatures comprehensively were investigated and discussed in our study. Concerning the stage (4), we paid attention to effect sizes, the base of the statistical methods in meta-analysis. In the social sciences and psychological research it seems that hypothesis significance testing has been given too much emphasis. In our study, we have shown the importance of reporting effect sizes which indude those information people can never obtain just from significance testing. The results of the studies were presented in a number of annual meetings ofJapanese academic societies. Various factors may hinder using meta-analysis methods, and one of the reasons could be that there is currently no software available for calculating effect sizes and confidence intervals easily ; as we know it is practically impossible to calculate the values without computers. In this study, we developed an Excel macro computer program to estimate confidence intervals around the standardized mean difference 6 based on the bootstrap BC_a procedure. The results of our simulation show that our program can precisely estimate confidence intervals except when all the following situations happen simultaneously : the normality assumption is extremely violated, effect sizp is large, and sample size is very small. Less
|
Report
(4 results)
Research Products
(27 results)
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
[Presentation] 効果量δとその信頼区間2007
Author(s)
井上 俊哉, 孫 媛
Organizer
日本行動計量学会第35回大会
Place of Presentation
同志社大学
Year and Date
2007-09-04
Description
「研究成果報告書概要(和文)」より
Related Report
-
-
-
[Presentation] 日本におけるメタ分析研究の現状2006
Author(s)
孫 媛, 井上 俊哉
Organizer
日本教育心理学会第48回総会
Place of Presentation
岡山大学
Year and Date
2006-09-16
Description
「研究成果報告書概要(和文)」より
Related Report
-
-
-
-
-
-
-