In one sentence
An analysis of 1,179 flashcards from popular learner-made medical decks suggests students often test more than bare facts — but clinical depth and complexity stay limited, especially outside Step 2–style collections.
What the researchers did
Rajpurkar, Barrison, and colleagues ran a qualitative content analysis on a random sample of 1,179 electronic flashcards drawn from widely used learner-created decks for undergraduate medical education. They coded each card with a framework covering content area (basic vs clinical), clinical reasoning domain, knowledge type (procedural vs informational), and cognitive process (recall vs application). The goal was to see whether peer-built decks support competency and skills, not only fact memorization.
What they found
- Cards in the sample tested many kinds of knowledge and went beyond simple factual recall in a meaningful share of cases.
- Learner-created decks may support higher-order thinking and clinically relevant items that could tie into reasoning and procedural skills.
- Step 2–oriented decks included more clinically relevant and complex cards than Step 1 or preclinical decks.
- Overall, clinical relevance and complexity remained limited across the sample — many cards still looked like narrow fact checks without expert quality control.
What this means for learners and educators
- Shared Anki decks are convenient but uneven: they can mix recall with some application, yet you cannot assume clinical quality without checking cards yourself.
- If you rely on peer decks, audit a random slice — delete misleading cards, add application prompts, and pair facts with “why” and “when.”
- Schools might review popular student decks or publish vetted alternatives instead of treating crowd-sourced cards as curriculum.
Limitations and what we don't know yet
This was qualitative coding, not a trial linking deck design to exam scores or patient outcomes. The sample reflects popular decks, not every student’s private collection. The study does not measure long-term retention or compare learner-made vs faculty-reviewed decks directly. Findings apply to medical undergraduate flashcard culture — other fields may differ.