BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//NCME - ECPv6.18.4//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://ncme.org
X-WR-CALDESC:Events for NCME
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20260308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20261101T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20270314T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20271107T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261118T160000
DTEND;TZID=America/New_York:20261118T170000
DTSTAMP:20261104T221137Z
CREATED:20261104T221125Z
LAST-MODIFIED:20261104T221137Z
UID:10000059-1795017600-1795021200@ncme.org
SUMMARY:Generative Psychometrics for Automatic Item Development and In-Silico Structural Validity
DESCRIPTION:This is presented by the Artificial Intelligence in Measurement & Education SIGIMIE \n\n\n\nGenerative artificial intelligence offers possibilities for developing educational assessments\, but item generation is just the first step. How can we discover if LLM-generated items represent the intended constructs\, showing the desired dimensionality structure before collecting human data? This talk introduces generative psychometrics as a framework for integrating automatic item development with computational evaluation of structural validity using network-based psychometrics (exploratory graph analysis). The Generative Psychometrics workflow combines large language models\, LLM embeddings\, and network psychometrics (EGA\, UVA\, bootEGA) to generate\, evaluate\, and refine item pools. Construct definitions guide item generation\, while embedding representations are the input for Exploratory Graph Analysis. Unique variable analysis identifies redundant items\, and bootEGA identifies unstable items. In-silico structure provides preliminary evidence about item organization\, while structural validity based on human responses requires empirical investigation with real human data. The talk considers how model dependence\, prompt technique\, and construct definition can influence the results. For educational measurement\, this framework positions in-silico evaluation as a transparent screening and refinement stage that can strengthen construct representation\, prioritize empirical testing\, and support efficient\, theoretically grounded assessment development. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\n\nHudson Golino\, University of Virginia
URL:https://ncme.org/event/generative-psychometrics-for-automatic-item-development-and-in-silico-structural-validity/
CATEGORIES:Webinars
END:VEVENT
END:VCALENDAR