NotesFAQContact Us
Collection
Advanced
Search Tips
Audience
What Works Clearinghouse Rating
Showing 1 to 15 of 57 results Save | Export
Peer reviewed Peer reviewed
Direct linkDirect link
Cole, Brian S.; Lima-Walton, Elia; Brunnert, Kim; Vesey, Winona Burt; Raha, Kaushik – Journal of Applied Testing Technology, 2020
Automatic item generation can rapidly generate large volumes of exam items, but this creates challenges for assembly of exams which aim to include syntactically diverse items. First, we demonstrate a diminishing marginal syntactic return for automatic item generation using a saturation detection approach. This analysis can help users of automatic…
Descriptors: Artificial Intelligence, Automation, Test Construction, Test Items
Peer reviewed Peer reviewed
Direct linkDirect link
Hodge, Kari J.; Morgan, Grant B. – Journal of Applied Testing Technology, 2020
The purpose of this study was to examine the use of a misspecified calibration model and its impact on proficiency classification. Monte Carlo simulation methods were employed to compare competing models when the true structure of the data is known (i.e., testlet conditions). The conditions used in the design (e.g., number of items, testlet to…
Descriptors: Item Response Theory, Accuracy, Decision Making, Classification
Peer reviewed Peer reviewed
Direct linkDirect link
van Groen, Maaike M.; Eggen, Theo J. H. M. – Journal of Applied Testing Technology, 2020
When developing a digital test, one of the first decisions that need to be made is which type of Computer-Based Test (CBT) to develop. Six different CBT types are considered here: linear tests, automatically generated tests, computerized adaptive tests, adaptive learning environments, educational simulations, and educational games. The selection…
Descriptors: Computer Assisted Testing, Formative Evaluation, Summative Evaluation, Adaptive Testing
Peer reviewed Peer reviewed
Direct linkDirect link
Furter, Robert T. – Journal of Applied Testing Technology, 2019
Standard setting is the process of identifying the point(s) on a scale that serve to differentiate between individuals of distinct proficiency levels. While standard setting is ultimately a policy decision, most of the process is carried out by subject matter experts who are tasked with reconciling item-level or examinee-level information (e.g.…
Descriptors: Standard Setting, Cutting Scores, Decision Making, Test Construction
Peer reviewed Peer reviewed
Direct linkDirect link
Betts, Joe; Muntean, William; Kim, Doyoung; Jorion, Natalie; Dickison, Philip – Journal of Applied Testing Technology, 2019
Clinical judgment has become an increasingly important aspect of modern health service professionals. To ensure public safety, licensure exams must go beyond assessing only knowledge and skills when evaluating entry-level professions to evaluating clinical judgment. This importance necessitates licensure and certification examinations in these…
Descriptors: Decision Making, Licensing Examinations (Professions), Certification, Nursing Education
Peer reviewed Peer reviewed
Direct linkDirect link
Burch, Vanessa C. – Journal of Applied Testing Technology, 2019
Health professions education has undergone radical changes over the past 100 years. This has necessitated a shift away from education programmes largely focused on testing knowledge and skills using predominantly written examinations. There has been a shift towards programmes which are intentionally designed with the end product in mind, a…
Descriptors: Workplace Learning, Clinical Experience, Situated Learning, Health Personnel
Peer reviewed Peer reviewed
Direct linkDirect link
Schuwirth, Lambert W. T.; Van Der Vleuten, Cees P. M. – Journal of Applied Testing Technology, 2019
Programmatic assessment is both a philosophy and a method for assessment. It has been developed in medical education as a response to the limitation of the dominant testing or measurement approaches and to better align with changes in how medical competence was conceptualised. It is based on continual collection of assessment and feedback…
Descriptors: Program Evaluation, Medical Education, Competency Based Education, Feedback (Response)
Peer reviewed Peer reviewed
Direct linkDirect link
Lipner, Rebecca S.; Brossman, Bradley G.; Grosso, Louis J. – Journal of Applied Testing Technology, 2019
Changes to the American Board of Internal Medicine's Maintenance of Certification Program: Preserving Core Assessment Values As Maintenance of Certification (MoC) for practicing physicians has evolved into more continuous programs, controversy has arisen over how physicians should self-regulate their profession and serve the public trust in doing…
Descriptors: Internal Medicine, Certification, Educational Change, High Stakes Tests
Peer reviewed Peer reviewed
Direct linkDirect link
Keehn, Suzanne; Claggett, Stuart – Journal of Applied Testing Technology, 2019
The educational game industry struggles from a lack of standardization around collecting, analyzing and managing student learning data, which is potentially jeopardizing millions of dollars of investment in educational games. Investors, administrators, and educators require data to support quantitative and qualitative learning measurement in…
Descriptors: Educational Games, Game Based Learning, Data Collection, Elementary Secondary Education
Peer reviewed Peer reviewed
Direct linkDirect link
Smith, Ginny; Shute, Valerie; Muenzenberger, Amber – Journal of Applied Testing Technology, 2019
The following research focuses on Game-Based Learning (GBL) for assessment through the lens of designing and validating a stealth assessment for the calculus game Variant: Limits™. The process of using Evidence-Centered Design (ECD) to create a valid assessment is highlighted through the development of a competency model and scoring rubrics. A…
Descriptors: Calculus, Game Based Learning, Student Evaluation, College Students
Peer reviewed Peer reviewed
Direct linkDirect link
Heinzen, Thomas E.; Ivezaj, Stephanie – Journal of Applied Testing Technology, 2019
The hallmark of a well-designed game is player persistence -- the same characteristic professors hope to cultivate in their students, especially in the face of the student retention crisis. The four studies reported here include an archival study, a focus group, and two experiments. They each test a minor game mechanic that may have a small but…
Descriptors: Student Motivation, Student Attitudes, Negative Attitudes, Games
Peer reviewed Peer reviewed
Direct linkDirect link
McNamara, Jennifer; Bent, Margaret; Grace, Paul – Journal of Applied Testing Technology, 2019
Certification is often viewed to promote lifelong professional development. Industry accreditation agencies include standards for the Maintenance of Certification (MOC) that emphasize the measurement or promotion of continued competency throughout an individual's professional career. In 2013, NBCOT partnered with BreakAway Games to create the…
Descriptors: Computer Simulation, Game Based Learning, Certification, Mandatory Continuing Education
Peer reviewed Peer reviewed
Direct linkDirect link
Moncaleano, Sebastian; Russell, Michael – Journal of Applied Testing Technology, 2018
2017 marked a century since the development and administration of the first large-scale group administered standardized test. Since that time, both the importance of testing and the technology of testing have advanced significantly. This paper traces the technological advances that have led to the large-scale administration of educational tests in…
Descriptors: Technological Advancement, Standardized Tests, Computer Assisted Testing, Automation
Peer reviewed Peer reviewed
Direct linkDirect link
Diao, Hongyu; Sireci, Stephen G. – Journal of Applied Testing Technology, 2018
Whenever classification decisions are made on educational tests, such as pass/fail, or basic, proficient, or advanced, the consistency and accuracy of those decisions should be estimated and reported. Methods for estimating the reliability of classification decisions made on the basis of educational tests are well-established (e.g., Rudner, 2001;…
Descriptors: Classification, Item Response Theory, Accuracy, Reliability
Peer reviewed Peer reviewed
Direct linkDirect link
Weiner, John A.; Hurtz, Gregory M. – Journal of Applied Testing Technology, 2017
Advances in technology have spurred innovations in secure assessment delivery. One such innovation, remote online proctoring, has become increasingly sophisticated and is gaining wider consideration for high-stakes testing. However, there is an absence of published research examining remote online proctoring and its effects on test scores and the…
Descriptors: Comparative Analysis, Computer Assisted Testing, High Stakes Tests, Supervision
Previous Page | Next Page »
Pages: 1  |  2  |  3  |  4