Author(s): |
Zhou, Mingming |
Source: |
Educational Psychology, v33 n1 p1-13 2013 |
|
Pub Date: |
2013-00-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Academic Achievement; Item Analysis; Undergraduate Students; Goal Orientation; Prediction; Futures (of Society); Pretests Posttests; Scores; Reading Tests; Correlation; Statistical Analysis; Profiles
Abstract:
In this study, undergraduate students provided confidence ratings to predict future performance in answering questions drawn from the text before reading the text, after reading the text and after rereading the text. Self-reports of achievement goal orientations during reading and posttest scores were also collected. Student's calibration index was the comparison between their predicted posttest performance and actual performance in the posttest. Correlational analyses did not reveal any statistically detectable relationships between self-reported goal orientations and monitoring accuracy, except that bias scores were marginally related to goal orientations. Further cluster analyses and analyses of variance (ANOVA) also showed that student's multiple goal profiles failed to clearly differentiate the groups in terms of their calibration accuracy, yet performance-approach goals did distinguish overconfident from underconfident students. Plausible reasons for the finding were provided and implications for future research were also discussed. (Contains 3 tables.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-00-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
English (Second Language); Language Tests; Essay Tests; Factor Structure; Academic Discourse; Reading Comprehension; Listening Comprehension; Factor Analysis; Correlation; Scores; Listening Comprehension Tests; Reading Tests
Abstract:
The present study examined the factor structures across features of 446 examinees' responses to a writing task that integrates reading and listening modalities as well as reading and listening comprehension items of the TOEFL iBT[R] (Internet-based test). Both human and automated scores obtained for the integrated essays were utilized. Based on a series of preliminary factor analyses, a confirmatory factor analysis (CFA) identified a model that specified a higher order factor for comprehension. In the model, the Comprehension factor underlay factors representing content of the written essay as well as reading and listening comprehension. The Comprehension factor correlated with two writing factors--Productive Vocabulary and Sentence Conventions. Furthermore, follow-up CFA models with covariates (multiple indicators multiple causes models, or MIMIC models) were tested to compare performance between a group of 190 examinees scoring above a frequently used TOEFL iBT Total score requirement for international student admission and the other group of 128 examinees scoring below the requirement. The higher ability group performed significantly better than the lower ability group on all three constructs: Comprehension, Productive Vocabulary, and Sentence Conventions. The identification of the multiple distinct factors in this study may hold promise for obtaining writing profiles that inform instruction in contexts such as test preparation. (Contains 9 tables, 4 figure and 1 footnote.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-00-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Language Tests; Reading Processes; Reading Tests; Test Format; Integrated Activities; Reading Comprehension; Language Usage; Writing (Composition); English for Academic Purposes; Test Validity; Cognitive Processes; Foreign Students; English Language Learners; College Students
Abstract:
Integrated reading/writing tasks are becoming more common in large-scale language tests. Much of the research on these tasks has focused on writing through reading; assessing reading through writing is a less explored area. In this article we describe a reading-into-writing task that is intended to measure both reading comprehension and language use on an academic English test. The task involves responding to short-answer questions (SAQs) that require examinees to use their own words to state the main idea of a text, draw inferences, or synthesize information across multiple texts. The article presents results of a two-part study addressing the validity of this method of assessing reading by investigating the cognitive processes involved in responding to SAQs. First, we present the results of a qualitative study of five nonnative English-speaking students, who provided verbal protocols as they read the texts and responded to the SAQs. Next, we present data from a larger sample of students focusing specifically on the cognitive processes used when reading the texts for the purpose of responding to SAQs. Implications of the study for the validity of this method of testing are discussed. (Contains 4 tables and 2 figures.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-00-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Curriculum Based Assessment; High Stakes Tests; Reading Achievement; Achievement Tests; Reading Tests; Reading Fluency; Middle School Students; Grade 7; Correlation; Scores
Abstract:
The purpose of this study was to investigate the relationship between oral reading fluency and performance on a statewide reading achievement test for middle grades students. Participants in this study were 75 seventh grade students. One month before the students were administered the state test, each student read three probes from their current basal reader to determine an oral reading fluency rate. The Ohio Grade 7 Reading Test scores were correlated with oral reading fluency rates to determine the extent of the relationship between the results. Results support the use of oral reading fluency assessment as a valid tool for identifying students at risk of not passing the statewide reading achievement test. (Contains 1 figure and 3 tables.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
ERIC
Full Text (431K)
|
More Info:
Help
Find in a Library
|
Author(s): |
Singh, Malkeet |
Source: |
Educational Research and Evaluation, v19 n1 p4-18 2013 |
|
Pub Date: |
2013-00-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Reading Tests; Educational Assessment; Measurement; Longitudinal Studies; English Language Learners; Socioeconomic Status; Special Education; Reading Achievement; Achievement Gap; Disadvantaged; Elementary School Students; Middle School Students; High School Students; Individual Characteristics; Institutional Characteristics; Cohort Analysis; Federal Legislation; Educational Legislation; Hierarchical Linear Modeling
Abstract:
Eliminating inequity in public education is a central goal of the No Child left Behind (NCLB) act. Controlling for 3rd-grade performance, the impact of English language learner (ELL) status, socioeconomic status (SES), and special education (SPED) status on a cohort's reading performance was investigated from elementary to high school through a multilevel framework. Results in Hawaii show that the negative impact of low SES and SPED status persists up to high school, while the disadvantage of ELL status is restricted within the elementary grades. Moreover, individual characteristics, not school characteristics, have a dominant impact on future reading performance. Among individual characteristics, early performance is a crucial factor for future academic achievement. The findings show that educational policies that use incentives and sanctions such as NCLB to close achievement gaps may not be successful. (Contains 5 tables and 3 figures.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|
|
Pub Date: |
2013-00-00 |
Pub Type(s): |
Journal Articles; Reports - Research |
Peer Reviewed: |
Yes |
|
|
|
Descriptors:
Reading Tests; Reading Comprehension; Cognitive Processes; Models; Validity; Matrices; Protocol Analysis; Expertise; College Students; English (Second Language); Markov Processes; Monte Carlo Methods; Goodness of Fit
Abstract:
Cognitive diagnostic analyses have been advocated as methods that allow an assessment to function as a formative assessment to inform instruction. To use this approach, it is necessary to first identify the skills required for each item in the test, known as a Q-matrix. However, because the construct being tested and the underlying cognitive processes associated with it are usually not fully understood, establishing a Q-matrix, especially for an existing test, is a challenging task. This study reports the process of constructing and validating a Q-matrix for the reading comprehension section of the Michigan English Language Assessment Battery (MELAB). An initial Q-matrix was first generated based on evidence gathered from related literature, students' think-aloud protocols, and expert ratings. This initial Q-matrix was then validated empirically by applying the fusion model to a large MELAB data set. A well-supported Q-matrix was produced for potential future diagnostic applications. (Contains 10 tables and 4 figures.)
Note:The following two links
are not-applicable for text-based browsers or screen-reading software.
Show
Hide
Full Abstract
Related Items: Show Related Items
Full-Text Availability Options:
More Info:
Help |
Tutorial
Help Finding Full Text
|
More Info:
Help
Find in a Library
|
Publisher's website
|
|