Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates

Steven A. Lieberman; Ann W. Frye; Stephanie D. Litwins; Karen A. Rasmusson; John R. Boulet

doi:10.1097/00001888-200310001-00016

Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates

Steven A. Lieberman, Ann W. Frye, Stephanie D. Litwins, Karen A. Rasmusson, John R. Boulet

Research output: Contribution to journal › Article › peer-review

12 Scopus citations

Abstract

Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

Original language	English (US)
Pages (from-to)	S48-S51
Journal	Academic Medicine
Volume	78
Issue number	10 SUPPL.
DOIs	https://doi.org/10.1097/00001888-200310001-00016
State	Published - Oct 1 2003
Externally published	Yes

ASJC Scopus subject areas

Education

Access to Document

10.1097/00001888-200310001-00016

Cite this

@article{e7847b2955bc4faa830dd9d17c3f0cd2,

title = "Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates",

abstract = "Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.",

author = "Lieberman, {Steven A.} and Frye, {Ann W.} and Litwins, {Stephanie D.} and Rasmusson, {Karen A.} and Boulet, {John R.}",

year = "2003",

month = oct,

day = "1",

doi = "10.1097/00001888-200310001-00016",

language = "English (US)",

volume = "78",

pages = "S48--S51",

journal = "Academic Medicine",

issn = "1040-2446",

publisher = "Lippincott Williams and Wilkins",

number = "10 SUPPL.",

}

TY - JOUR

T1 - Introduction of patient video clips into computer-based testing

T2 - Effects on item statistics and reliability estimates

AU - Lieberman, Steven A.

AU - Frye, Ann W.

AU - Litwins, Stephanie D.

AU - Rasmusson, Karen A.

AU - Boulet, John R.

PY - 2003/10/1

Y1 - 2003/10/1

N2 - Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

AB - Purpose. Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown. Method. We developed parallel test questions incorporating video clips or text descriptions of abnormal neurologic findings and administered them to 106 fourth-year medical students finishing their Neurology Clerkship. Results. Overall, video-based questions had comparable difficulty and discrimination compared to analogous text-based questions. Preliminary studies indicated similar reliability with text- and video-based questions. Conclusions. The inclusion of patient video clips in computer-based testing is feasible from technical, practical, and psychometric perspectives. Further study is needed to gather validity evidence for this novel question format.

UR - http://www.scopus.com/inward/record.url?scp=0141924562&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141924562&partnerID=8YFLogxK

U2 - 10.1097/00001888-200310001-00016

DO - 10.1097/00001888-200310001-00016

M3 - Article

C2 - 14557094

SN - 1040-2446

VL - 78

SP - S48-S51

JO - Academic Medicine

JF - Academic Medicine

IS - 10 SUPPL.

ER -

Introduction of patient video clips into computer-based testing: Effects on item statistics and reliability estimates

Abstract

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this