|
|
Pub Date: |
2013-00-00 |
Pub Type(s): |
Journal Articles; Reports - Evaluative |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Effect Size; Test Bias; Item Analysis; Statistical Analysis; Sample Size; Research Design; Decision Making; Graphs; Scores
Abstract:
There are numerous statistical procedures for detecting items that function differently across subgroups of examinees that take a test or survey. However, in endeavouring to detect items that may function differentially, selection of the statistical method is only one of many important decisions. In this article, we discuss the important decisions that affect investigations of differential item functioning (DIF) such as choice of method, sample size, effect size criteria, conditioning variable, purification, DIF amplification, DIF cancellation, and research designs for evaluating DIF. Our review highlights the necessity of matching the DIF procedure to the nature of the data analysed, the need to include effect size criteria, the need to consider the direction and balance of items flagged for DIF, and the need to use replication to reduce Type I errors whenever possible. Directions for future research and practice in using DIF to enhance the validity of test scores are provided. (Contains 2 tables, 3 figures, and 1 note.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
Author(s): |
Huang, Chiungjung |
Source: |
European Journal of Psychology of Education, v28 n1 p1-35 Mar 2013 |
|
Pub Date: |
2013-03-00 |
Pub Type(s): |
Information Analyses; Journal Articles; Reports - Evaluative |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Self Efficacy; Social Sciences; Males; Effect Size; Gender Differences; Meta Analysis; Language Arts; Mathematics Skills; Age Differences; Research Needs; Longitudinal Studies; Incidence; Computer Literacy
Abstract:
A meta-analysis of 187 studies containing 247 independent studies (N = 68,429) on gender differences in academic self-efficacy identified an overall effect size of 0.08, with a small difference favoring males. Moderator analysis demonstrated that content domain was a significant moderator in explaining effect size variation. Females displayed higher language arts self-efficacy than males. Meanwhile, males exhibited higher mathematics, computer, and social sciences self-efficacy than females. Gender differences in academic self-efficacy also varied with age. The largest effect size occurred for respondents aged over 23 years old. For mathematics self-efficacy, the significant gender differences emerged in late adolescence. Future research should longitudinally examine gender differences in academic self-efficacy to determine the prevalence of gender differences during different life stages.
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-03-00 |
Pub Type(s): |
Information Analyses; Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Memory; Teaching Methods; Foreign Countries; Correlation; Chinese; Visual Perception; Reading Research; Meta Analysis; Effect Size; Reading Skills; Reading Processes; Verbal Ability; Elementary School Students
Abstract:
This paper used meta-analysis to synthesize the relation between visual skills and Chinese reading acquisition based on the empirical results from 34 studies published from 1991 to 2011. We obtained 234 correlation coefficients from 64 independent samples, with a total of 5,395 participants. The meta-analysis revealed that visual skills as a global construct had a medium correlation effect size (r = 0.32) associated with Chinese reading acquisition. The various visual processing skills differed in their relation to Chinese reading acquisition in different stages. Visual perception, speed of processing visual information, and pure visual memory had low-to-moderate correlations with Chinese reading acquisition in the lower grades (i.e., below second grade), whereas these relations did not retain their magnitude for children in the higher grades (i.e., second through sixth grades). By contrast, visual-verbal association skill was found to account for 34 and 41 % of the variance in children's Chinese reading acquisition in both lower and higher grade levels, respectively. Greater attention to this construct can significantly benefit reading research and instructional practice. No regional differences between studies in Mainland China and Hong Kong were found in the meta-analysis.
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-03-00 |
Pub Type(s): |
Information Analyses; Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Spatial Ability; Effect Size; Visualization; Gender Differences; Meta Analysis; Cognitive Ability; Visual Measures
Abstract:
This meta-analysis was conducted to estimate the magnitude of gender difference in three-dimensional (3-D) mental rotation ability and to investigate how factors related to test administration conditions play a role in varying gender difference effect sizes and threatening validity. Individuals' 3-D mental rotation ability was measured by the Purdue Spatial Visualization Tests: Visualization of Rotations (PSVT:R). We integrated 70 effect sizes of gender differences in mental rotation ability measured by the PSVT:R which were obtained from 40 primary studies. The results indicated that male participants outperformed females on the test (Hedges' "g" = 0.57). The I[superscript 2] statistic indicated 41.7 % of variation in effect sizes reflects real heterogeneity. The moderator analysis indicated that male superiority on spatial ability tasks measured by the PSVT:R is related to the implementation of time limits. The gender difference became larger when stringent time limits (equal or less than 30 s per item) were implemented.
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-01-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Grade Point Average; Outcome Measures; Video Games; Effect Size; Academic Achievement; Case Studies; Aggression; Spatial Ability; Mathematics Skills; Violence; Hispanic Americans; Adolescents; Preadolescents; Age Differences; Correlation; Visual Perception
Abstract:
The United States Supreme Court's recent decision relating to violent video games revealed divisions within the scientific community about the potential for negative effects of such games as well as the need for more, higher quality research. Scholars also have debated the potential for violent games to have positive effects such as on visuospatial cognition or math ability. The current study sought to extend previous literature by using well-validated clinical outcome measures for relevant constructs, which have generally been lacking in past research. Cross-section data on aggression, visuospatial cognition, and math achievement were available for a sample of 333 (51.7% female) mostly Hispanic youth (mean age = 12.76). Prospective 1-year data on aggression and school GPA were available for 143 (46.2% female) of those youth. Results from both sets of analysis revealed that exposure to violent game had neither short-term nor long-term predictive influences on either positive or negative outcomes. A developmental analysis of the cross-sectional data revealed that results did not differ across age categories of older children, preadolescents or adolescents. Analysis of effect sizes largely ruled out Type II error as a possible explanation for null results. Suggestions for new directions in the field of video game research are proffered.
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-04-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Gifted; Identification; Cognitive Ability; Intelligence; Screening Tests; Talent Development; Predictive Validity; Disproportionate Representation; Grade 2; Comparative Analysis; English Language Learners; Kindergarten; Grade 1; Correlation; Effect Size; Scores; Elementary School Students
Abstract:
The Naglieri Nonverbal Ability Test, Second Edition (NNAT2), is used widely to screen students for possible inclusion in talent development programs. The NNAT2 claims to provide a more culturally neutral evaluation of general ability than tests such as Form 6 of the Cognitive Abilities Test (CogAT6), which has Verbal and Quantitative batteries in addition to a Nonverbal battery. This study compared the performance of 5,833 second graders who took the CogAT6 and 4,038 kindergartners, first graders, and second graders who took the NNAT2 between 2005 and 2011 as part of a grade-wide screening for a gifted program. Comparison between minorities and Whites on the CogAT6 and the NNAT2 found slightly larger gaps on the CogAT6 Composite for Hispanics and English-Language Learners (ELL) but the same gap for Black students. Considered alone, the Nonverbal battery of CogAT6 produced smaller gaps than the NNAT2 for Blacks, Hispanics, Asians, and ELL students. Fisher's exact tests showed no significant differences between the CogAT6 Composite and the NNAT2 in subgroup identification rates at hypothetical cuts for gifted identification (top 20%, 10%, or 5%), except for Asian and ELL students. The CogAT6 Nonverbal score appeared to identify as many or more high-ability students from underrepresented groups as the NNAT2. Wechsler Intelligence Scale for Children, Fourth Edition, follow-up on the top 5% showed greater predictive validity for the CogAT6 Composite. These results suggest that gifted programs should not assume that using a figural screening test such as the NNAT2, without other adjustments to selection protocol, will address minority underrepresentation. (Contains 5 tables.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-03-00 |
Pub Type(s): |
Information Analyses; Journal Articles; Reports - Evaluative |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Meta Analysis; Psychological Studies; Clinical Psychology; Intervention; Evidence; Parent Education; Parent Child Relationship; Child Behavior; Behavior Problems; Behavior Modification; Effect Size; Outcomes of Treatment
Abstract:
Evidence-based interventions are often unavailable in everyday clinical settings. This may partly reflect practitioners' assumptions that research evidence does not reflect "real-world" conditions. To examine this further, we systematically assessed the clinical effectiveness of parent management training (PMT) for the treatment of child disruptive behavior across different real-world practice contexts. We identified 28 relevant randomized controlled trials from a systematic search of electronic bibliographic databases and conducted a meta-analysis of child outcomes across trials. Planned subgroup analyses involved comparisons between studies grouped according to individual real-world practice criteria and total real-world practice criteria scores, reflecting the extent to which PMT was delivered by non-specialist therapists, to a clinic-referred population, in a routine setting, and as part of a routine service. Meta-analysis revealed a significant overall advantage for PMT compared with waitlist control conditions. Subgroup analyses did not demonstrate significant differences in effect size estimates according to the total number of real-world practice criteria met by studies. Moreover, no consistent relationships were found between specific practice criteria and effect size estimates. In conclusion, PMT appears to be an effective treatment for children with disruptive behavior problems. There was no clear evidence that conducting PMT in real-world practice contexts is a deterrent to achieving effective child behavior outcomes, although relative advantage to "usual care" was not directly examined and the power of the analysis was limited as a result of significant heterogeneity. More research is needed to investigate whether this finding is generalizable to other psychological interventions. Suggestions are also made for developing more differentiated criteria to assist with evaluating the specific applicability of research evidence to different care providers.
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|