Description of Performance:
The provider analyzes changes in learner competence resulting from its educational activities. The provider uses audience response system (ARS) data collected during case-based educational activities to assess learners’ ability to apply knowledge to clinical decision-making.
The provider administers ARS questions before and after educational interventions using the same or comparable patient cases. The questions require learners to apply clinical knowledge to realistic scenarios, such as selecting the most appropriate diagnostic approach, choosing evidence-based treatment options, identifying risk factors, or determining next steps in patient management. By comparing pre- and post-activity responses, the provider measures changes in learners’ ability to analyze clinical information and apply evidence in practice-relevant situations.
On an annual basis, the provider aggregates and reviews ARS data across activities to identify patterns of improvement in learner competence. For example, analyses demonstrated increases in the percentage of learners selecting guideline-concordant management strategies and accurately applying clinical evidence to patient cases following participation in educational activities. The provider uses these findings to evaluate the effectiveness of its CME program and to identify areas requiring additional educational attention.
Rationale:
The evidence demonstrated that the provider systematically collects and analyzes data regarding changes in learner competence. The provider used pre- and post-activity ARS questions that assessed learners’ application of knowledge to clinical cases rather than simple recall of facts. By comparing learners’ responses before and after instruction, the provider was able to identify changes in participants’ ability to make appropriate clinical decisions and apply evidence-based practices. The provider reviewed and analyzed these data across all of its activities each year of its term, and used the findings to draw conclusions about the impact of its CME program on learner competence.
