BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//NCME - ECPv6.18.4//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:NCME
X-ORIGINAL-URL:https://ncme.org
X-WR-CALDESC:Events for NCME
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20260308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20261101T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20270314T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20271107T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261209T123000
DTEND;TZID=America/New_York:20261209T133000
DTSTAMP:20261116T220013Z
CREATED:20261116T220001Z
LAST-MODIFIED:20261116T220013Z
UID:10000064-1796819400-1796823000@ncme.org
SUMMARY:Reclaiming Content Validity: Reflections on a 1998 Classic and Today’s Practice
DESCRIPTION:This is presented by the Large-Scale Assessments SIGIMIE \n\n\n\nJoin Steve Sireci and Alexander Hoffman for a relaxed\, candid fireside chat digging into the past\, present\, and future of content validity. Nearly 30 years after Steve published his classic 1998 article on the history of content validity (originally sparked by his dissertation lit review!)\, he’ll sit down with Alexander to look at how the concept has evolved from its 20th-century roots to contemporary assessment practice. Together\, they’ll bounce ideas back and forth across different educational landscapes—with Steve sharing how his team applies these ideas in adult education today\, and Alexander bringing a K–12 lens to examine what modern state learning standards mean for practical validity work. Expect an engaging\, unscripted conversation where Alexander presses Steve on how we gather validity evidence from both test content and response processes when dealing with very different types of domain models. Whether you’re deep in the weeds of psychometrics or just curious about how classic measurement theory holds up in today’s classrooms\, pull up a chair for a lively discussion. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\nStephen G. Sireci\, Ph.D.\, is a Distinguished University Professor and Director of the Center for Educational Assessment in the College of Education at the University of Massachusetts Amherst\, as well as President of Sireci Psychometric Services\, Inc. A recognized leader in the field of educational measurement\, Dr. Sireci is Past-President of the National Council on Measurement in Education (NCME)\, the International Test Commission (ITC)\, and the Northeastern Educational Research Association (NERA). He is an elected member of the National Academy of Education\, a Fellow of the American Educational Research Association (AERA)\, and a Fellow of Division 5 of the American Psychological Association (APA). His research focuses on test fairness\, content validity\, personalized assessment\, test bias\, cross-lingual testing\, standard setting\, and computerized-adaptive testing. Over the course of his career\, he has authored over 160 publications\, served as co-architect of the Massachusetts Adult Proficiency Tests\, and co-edited the International Journal of Testing.  \n\n\n\nDr. Alexander M. Hoffman is an educational research methodologist and President of AleDev Research & Consulting who specializes in research design\, policy analysis\, and large-scale assessment development. A former high school English teacher with a doctorate from Teachers College\, Columbia University\, and master’s degrees from Teachers College and the Harvard Graduate School of Education\, he designs tailored quantitative\, qualitative\, and mixed-methods studies\, including instrument development and program evaluation. Alongside Marjorie Wine\, he co-developed Rigorous Test Development (RTD)\, a principled framework for designing valid test items that elicit targeted cognition across diverse test-takers. He also conducts empirical research on frontier large language models (LLMs)\, exploring how assessment professionals can integrate AI into research and writing workflows without compromising professional judgment.
URL:https://ncme.org/event/reclaiming-content-validity-reflections-on-a-1998-classic-and-todays-practice/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261209T160000
DTEND;TZID=America/New_York:20261209T170000
DTSTAMP:20261112T184340Z
CREATED:20261112T184328Z
LAST-MODIFIED:20261112T184340Z
UID:10000061-1796832000-1796835600@ncme.org
SUMMARY:Distilling LLM Error Judgments into Small\, Calibrated Models for K–12 Writing Feedback
DESCRIPTION:This is presented by the Artificial Intelligence in Measurement & Education SIGIMIE. \n\n\n\nNavvy gives K–12 students feedback on their writing by highlighting spans with convention errors. This talk covers three span types: run-ons\, fragments\, and comma errors. Licensing\, cost\, and latency keep us from serving a frontier LLM directly\, and we had no human-labeled spans to train on. Instead we used an LLM to make them. \n\n\n\nThe first question is whether we can find the errors. A frontier LLM labeled error sentences and comma sites in 4\,880 essays\, grades 3–8\, under a fixed taxonomy. A human annotator reviewed a sample to check the LLM as a rater. We then finetuned a ModernBERT model on the LLM labels and checked its agreement with the LLM on a held-out set. \n\n\n\nThe second question is which of those errors a teacher would flag at a given grade. The span model never sees grade level\, so we fit a small calibration layer on top of it and test it on a hybrid set: a small hand-annotated sample from four grades\, plus additional essays labeled by an LLM judge anchored on the human spans. We report each part separately and combined. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\n\nJustin Barber (Pearson)\n\n\n\nMichael Hemenway (Pearson)
URL:https://ncme.org/event/distilling-llm-error-judgments-into-small-calibrated-models-for-k-12-writing-feedback/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261209T160000
DTEND;TZID=America/New_York:20261209T170000
DTSTAMP:20261113T165115Z
CREATED:20261113T165104Z
LAST-MODIFIED:20261113T165115Z
UID:10000062-1796832000-1796835600@ncme.org
SUMMARY:Coffee Chat: Automatic Item Generation
DESCRIPTION:This is presented by the Certification & Licensure SIGIMIE. \n\n\n\nMembers of the Certification and Licensure SIGIMIE will discuss automatic item generation\, including the use of generative AI to prepare items for our organizations’ exam programs. An optional reading is included to prime discussion\, but please feel welcome to join us whether or not you have time to look at the reading. \n\n\n\nHuang\, J.\, & Chang\, H. H. (2026). A Cognitive Design System Approach to Enhancing Cognitive Alignment and Difficulty Control in Gen-AI Item Generation. Applied Measurement in Education\, 1–21. https://doi.org/10.1080/08957347.2026.2740622 \n\n\n\nRegister Now
URL:https://ncme.org/event/coffee-chat-automatic-item-generation/
CATEGORIES:Webinars
END:VEVENT
END:VCALENDAR