Assessment and Evaluation Methods Flashcards
7 cards from real CHSE practice questions. Tap to flip, then mark Knew It or Still Learning — missed cards come back until you master them.
Read the first 7 Assessment and Evaluation Methods flashcards as text
Which assessment tool is MOST appropriate for evaluating a learner's real-time clinical decision-making during a high-fidelity simulation?
Answer: Direct observation checklist with behavioral anchors
A behaviorally anchored observation checklist captures real-time clinical decisions and actions with standardized, objective criteria during simulation.
In the context of simulation-based assessment, what does 'consequential validity' refer to?
Answer: The intended and unintended effects of assessment decisions on learners and programs
Consequential validity addresses both intended and unintended social and educational consequences arising from assessment use and score interpretation.
A simulation educator wants to ensure that an OSCE station accurately measures IV insertion technique. Which type of validity is the PRIMARY concern?
Answer: Content validity
Content validity ensures the assessment items adequately represent the full domain of the skill being measured, in this case IV insertion technique.
Which of the following BEST describes formative assessment in simulation education?
Answer: Ongoing feedback during learning designed to improve performance
Formative assessment provides ongoing, iterative feedback during the learning process to guide improvement rather than to make pass/fail decisions.
When evaluating inter-rater reliability in simulation assessments, a kappa coefficient of 0.75 is obtained. How should this value be interpreted?
Answer: Substantial agreement, generally acceptable for most assessments
A kappa of 0.61–0.80 is classified as substantial agreement and is generally considered acceptable for clinical skills assessments.
A simulation program uses the same test both before and after a training intervention to measure learning gains. This approach is BEST described as:
Answer: Pre-test/post-test design
A pre-test/post-test design measures the same construct before and after instruction to quantify learning gains attributable to the intervention.
Which evaluation model is MOST commonly referenced when assessing the overall effectiveness of a simulation training program across multiple levels, including reaction, learning, behavior, and results?
Answer: Kirkpatrick's Four-Level Model
Kirkpatrick's Four-Level Model evaluates training programs at the levels of reaction, learning, behavior change, and organizational results.