BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//NCME - ECPv6.18.4//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://ncme.org
X-WR-CALDESC:Events for NCME
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20250309T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20251102T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20260308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20261101T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20270314T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20271107T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261005T000000
DTEND;TZID=America/New_York:20261007T235959
DTSTAMP:20260212T211856Z
CREATED:20260212T211850Z
LAST-MODIFIED:20260212T211856Z
UID:10000025-1791158400-1791417599@ncme.org
SUMMARY:2026 AIME-Con
DESCRIPTION:We are thrilled to announce the return of the NCME Artificial Intelligence in Measurement and Education Conference (AIME–Con)! Following last year’s sold-out success\, AIME-Con 2026 will be held in Pittsburgh at the Wyndham Grand Pittsburgh Downtown on October 5–7. \n\n\n\nLearn More
URL:https://ncme.org/event/2026-aime-con/
LOCATION:Wyndham Grand Pittsburgh Downtown\, 600 Commonwealth Pl\, Pittsburgh\, Pennsylvania\, 15222\, United States
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261009T103000
DTEND;TZID=America/New_York:20261009T113000
DTSTAMP:20260901T215022Z
CREATED:20260901T213624Z
LAST-MODIFIED:20260901T215022Z
UID:10000047-1791541800-1791545400@ncme.org
SUMMARY:Why Educational Measurement Matters in the Age of AI
DESCRIPTION:This is presented by the NCME Communications Committee \n\n\n\nThis public-facing NCME webinar brings together leaders in educational measurement\, assessment\, learning analytics\, and AI in education to discuss what our field can contribute in the age of modern AI. Panelists Andrew Ho from Harvard University\, Kristen DiCerbo from Khan Academy\, and Alyssa Wise from Vanderbilt University will explore why concepts such as validity\, fairness\, evidence\, interpretation\, and responsible use are essential for designing and evaluating AI-enabled educational systems. The session will be moderated by Seyedahmad (Ahmad) Rahimi\, chair of the NCME Communications Committee\, and aims to build bridges between NCME and adjacent communities\, including AI in education\, learning analytics\, EDM\, EdTech\, and the learning sciences. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\nAndrew Ho\, Charles William Eliot Professor of Education\, Harvard Graduate School of EducationAndrew Ho is the Charles William Eliot Professor of Education at the Harvard Graduate School of Education. His work focuses on educational measurement\, testing\, accountability\, and the interpretation and use of assessment results. He is a past president of NCME and delivered the 2025 NCME Presidential Address\, “Metaphors\, Mantras\, and Mnemonics: Communication Competencies in Educational Measurement.” \n\n\n\n\n\n\n\n\n\n\n\n\n\nKristen DiCerbo\, Chief Learning Officer\, Khan AcademyKristen DiCerbo\, Ph.D.\, is Chief Learning Officer at Khan Academy\, where she helps guide teaching and learning strategy and research-based approaches across Khan Academy’s offerings. Her work connects assessment\, learning science\, educational technology\, and AI-supported learning. Before joining Khan Academy\, she was Vice President of Learning Research and Design at Pearson. \n\n\n\n\n\n\n\n\n\n\n\n\n\nAlyssa Wise\, Professor of Technology and Education\, Department of Teaching and Learning\, Vanderbilt University; Director\, LIVE Learning Innovation IncubatorAlyssa Wise is Professor of Technology and Education in the Department of Teaching and Learning at Vanderbilt University and Director of the LIVE Learning Innovation Incubator. Her research combines data science\, learning sciences\, and human-centered design to build and study learning analytics and AI systems that promote equitable and effective learning.
URL:https://ncme.org/event/why-educational-measurement-matters-in-the-age-of-ai/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261013T120000
DTEND;TZID=America/New_York:20261013T130000
DTSTAMP:20260910T145124Z
CREATED:20260910T145114Z
LAST-MODIFIED:20260910T145124Z
UID:10000049-1791892800-1791896400@ncme.org
SUMMARY:A Computational Psychometrics Ecosystem for Large-Scale Language Assessment: Integrating Measurement\, Artificial Intelligence\, and Governance
DESCRIPTION:This is presented by the Large-Scale Assessments SIGIMIE. \n\n\n\nLarge-scale language assessments increasingly rely on digital platforms that generate extensive linguistic\, behavioural\, and operational data. These data create opportunities to improve assessment design\, scoring\, delivery\, security\, and reporting\, but they also introduce significant measurement challenges. Computational applications are often implemented as separate technical solutions\, making it difficult to determine whether improvements in efficiency or predictive accuracy strengthen the validity of score interpretations and uses—or introduce construct-irrelevant variance\, subgroup differences\, model drift\, and new threats to fairness and comparability. \n\n\n\nThis webinar presents the Computational Psychometrics Ecosystem (CPE)\, an integrative framework for embedding computational methods within established psychometric principles across the lifecycle of large-scale language assessment. The framework comprises six interconnected layers: (1) Measurement Foundations\, including construct definition\, validity\, reliability\, fairness\, and psychometric modelling; (2) Multimodal Data\, encompassing item responses\, response times\, speech\, writing\, and process data; (3) Computational Methods\, including artificial intelligence\, machine learning\, natural language processing\, Bayesian modelling\, and simulation; (4) Assessment Applications\, including automated item generation\, adaptive and multistage testing\, automated scoring\, cognitive diagnosis\, and test-security analysis; (5) Operational Intelligence\, including quality assurance\, anomaly detection\, model monitoring\, predictive analytics\, and decision support; and (6) Governance\, encompassing transparency\, explainability\, privacy\, accountability\, auditability\, and human oversight. \n\n\n\nWithin the CPE\, computational performance is not treated as sufficient evidence of measurement quality. Instead\, each application is evaluated in relation to its intended contribution to the assessment’s validity argument. Operational illustrations from large-scale language assessment are used to identify relevant evidence requirements\, including construct and content representation\, item calibration\, linking and equating\, subgroup performance\, measurement invariance\, human–machine agreement\, classification consistency\, model drift\, uncertainty\, and the consequences of automated decisions. \n\n\n\nThe framework demonstrates how computational psychometrics can extend—rather than replace—Classical Test Theory\, Item Response Theory\, Generalizability Theory\, and Many-Facet Rasch Measurement. It also provides a structure for investigating how innovations affect score comparability\, fairness\, security\, and the appropriate interpretation and use of assessment results. The CPE offers researchers and assessment organisations a common basis for designing\, evaluating\, monitoring\, and governing AI-enabled language assessments while preserving the scientific and ethical foundations of large-scale educational measurement. \n\n\n\nRegister Now\n\n\n\nAbout the Presenter\n\n\n\n\n\nDr Ardeshir Geranpayeh is an assessment and educational technology specialist with more than three decades of experience in psychometrics\, high-stakes testing\, and automated assessment. Before establishing his computational psychometrics consultancy in 2022\, he held several senior positions at Cambridge University Press & Assessment\, including Head of Psychometrics and Data Services and Head of Automated Assessment and Learning. His work integrates established psychometric principles with advances in artificial intelligence and machine learning to support the development of valid\, reliable\, fair\, and innovative assessment systems. \n\n\n\nDr Geranpayeh has delivered more than 80 academic papers and professional presentations internationally. He is also an experienced workshop leader in assessment and test security and has contributed to major conferences organised by the National Council on Measurement in Education\, the Association of Test Publishers\, the Association of Language Testers in Europe\, and the International Test Commission. He is particularly skilled at making complex assessment concepts accessible to audiences from diverse professional backgrounds.
URL:https://ncme.org/event/a-computational-psychometrics-ecosystem-for-large-scale-language-assessment-integrating-measurement-artificial-intelligence-and-governance/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261016T130000
DTEND;TZID=America/New_York:20261016T140000
DTSTAMP:20260929T162411Z
CREATED:20260929T162359Z
LAST-MODIFIED:20260929T162411Z
UID:10000053-1792155600-1792159200@ncme.org
SUMMARY:Using NCES Data for Your Research
DESCRIPTION:This is presented by the Large-Scale Assessments SIGIMIE. \n\n\n\nLooking for high-quality data to support your education research? Interested in using NCES data but not sure where to start? \n\n\n\nJoin us for an upcoming webinar highlighting resources and tools for accessing and analyzing data from the National Center for Education Statistics. An expert panel\, led by Brian Cramer from NCES\, will share updates and practical guidance on: \n\n\n\n\nThe NAEP Data Explorer and International Data Explorer\n\n\n\nThe IES Data Enclave for accessing restricted-use data\n\n\n\nThe process for obtaining an IES restricted-use data license\n\n\n\nThe EdSurvey R package for analyzing NCES restricted-use data files\n\n\n\n\nThe webinar is jointly sponsored by the AERA NAEP Studies SIG\, AERA Large-Scale Assessment SIG\, and NCME LSA SIGIMIE. \n\n\n\nWhether you are new to NCES data or looking to deepen your use of these resources\, this session will offer helpful guidance and practical tools. \n\n\n\nRegister Now
URL:https://ncme.org/event/using-nces-data-for-your-research/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261016T130000
DTEND;TZID=America/New_York:20261016T143000
DTSTAMP:20260429T162808Z
CREATED:20260429T162756Z
LAST-MODIFIED:20260429T162808Z
UID:10000034-1792155600-1792161000@ncme.org
SUMMARY:Classroom Assessment Committee Meeting – October
DESCRIPTION:Regular monthly committee meeting. \n\n\n\nRegister Now
URL:https://ncme.org/event/classroom-assessment-committee-meeting-october/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261021T130000
DTEND;TZID=America/New_York:20261021T140000
DTSTAMP:20261012T173805Z
CREATED:20261012T173753Z
LAST-MODIFIED:20261012T173805Z
UID:10000055-1792587600-1792591200@ncme.org
SUMMARY:Advancing AI Research in Educational Measurement: Perspectives from Researchers and NCME Journal Editors
DESCRIPTION:This is presented by the Training & Development Committee \n\n\n\nArtificial intelligence is opening new possibilities for educational measurement while raising important questions about how we design assessments\, interpret results\, and evaluate evidence. This panel brings together three NCME journal editors and a senior AI researcher who has published in NCME journals to explore what these developments mean for the field\, what their research has established\, what remains unsettled\, and where the next questions lie. The aim is to give NCME members a working view of the current research front\, and to hear directly from the researchers and journal editors shaping it. \n\n\n\nDrawing on editorial and research perspectives\, panelists will discuss emerging AI applications in the measurement field. Editors will also share their journals’ areas of focus\, perspectives on AI-related submissions\, and expectations for the methodological rigor and substantive contributions of such work\, and how researchers and journals can help shape responsible AI use in educational measurement. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\nWon-Chan Lee\, Ph.D.\, is Professor of Educational Measurement and Statistics in the Department of Psychological and Quantitative Foundations at the University of Iowa and Director of the Center for Advanced Studies in Measurement and Assessment (CASMA). He currently serves as Editor-in-Chief of the Journal of Educational Measurement. His research focuses on educational measurement\, including item response theory\, equating and scaling\, generalizability theory\, and the use of artificial intelligence in educational assessment. His recent work emphasizes the integration of emerging technologies with sound measurement principles. \n\n\n\n\n\n\n\n\n\n\n\n\n\nHeather M. Buzick is senior director of academic measurement research at ACT and editor-in-chief of Educational Measurement: Issues and Practice (EM:IP). At ACT\, she leads a team whose work supports validity arguments for college and career readiness assessments and informs the use of test scores and assessment data in education decision-making. With training in educational measurement\, statistics\, and evaluation\, her expertise includes large-scale assessment\, validity\, and the application of statistical methods to educational measurement problems. Dr. Buzick has conducted research using large-scale assessment databases in K–12 and postsecondary contexts\, including state accountability\, admissions\, NAEP\, licensure\, and international assessment programs. \n\n\n\n\n\n\n\n\n\n\n\n\n\nYi Zheng\, Ph.D.\, is an Associate Professor at Arizona State University and co-Editor-in-Chief of the Chinese/English Journal of Educational Measurement and Evaluation(CEJEME)\, a peer-reviewed bilingual journal of NCME. Dr. Zheng’s expertise spans traditional psychometrics\, the development and validation of measurement instruments\, computerized adaptive testing\, and the emerging space of incorporating machine learning and AI technologies into measurement. Dr. Zheng has co-edited (with Dr. Okan Bulut) three special issues of CEJEME on AI & machine learning in educational measurement. She has also published her MxML project papers in EM:IP and CEJEME\, characterizing the evolving landscape of AI/ML in measurement based on published literature and survey responses from measurement professionals. \n\n\n\n\n\n\n\n\n\n\n\n\n\nDr. Jiangang Hao is a Research Director at the ETS Research Institute. His research centers on leveraging AI\, data science\, and psychometrics to measure complex human skills\, with a focus on collaborative problem-solving\, communication\, LLM-based automated coding and scoring\, test security\, and game-based assessment. His work helps advance psychometric methodology by bringing emerging computational and AI methods to the analysis of complex process data in digital learning and assessment. He has authored more than 100 publications and leads multiple large-scale research projects advancing the measurement of 21st-century skills. His work has been recognized through the ETS Presidential Award and an NCME annual award.
URL:https://ncme.org/event/advancing-ai-research-in-educational-measurement-perspectives-from-researchers-and-ncme-journal-editors/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261021T130000
DTEND;TZID=America/New_York:20261021T140000
DTSTAMP:20261013T152007Z
CREATED:20261013T151956Z
LAST-MODIFIED:20261013T152007Z
UID:10000057-1792587600-1792591200@ncme.org
SUMMARY:Educators of Measurement Meet-Up
DESCRIPTION:This is presented by the Educators of Measurement SIGIMIE. \n\n\n\nJoin the Educators of Measurement SIGIMIE for an October Coffee Hour featuring the editors of the Instructional Topics in Educational Measurement Series and Teaching Educational Research Methods. The editors will share information about these publications\, discuss their current calls for authors\, and answer questions from attendees. \n\n\n\nRegister Now
URL:https://ncme.org/event/educators-of-measurement-meet-up/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261022T140000
DTEND;TZID=America/New_York:20261022T150000
DTSTAMP:20261013T151703Z
CREATED:20261013T151651Z
LAST-MODIFIED:20261013T151703Z
UID:10000056-1792677600-1792681200@ncme.org
SUMMARY:Hands-on Demo with triageQ & the GenAI Evidence Hub Research Repository
DESCRIPTION:This is presented by the Artificial Intelligence in Measurement & Education SIGIMIE. \n\n\n\nThe GenAI Evidence Hub\, which was developed through AIME in 2025 to synthesize research methods & results evaluating the validity\, reliability and fairness of GenAI in three assessment domains\, has released our coded repository of papers. In this session\, we will share the repository and discuss approaches to maintain this collection over time. We will also conduct an interactive demo of “triageQ”\, an app we built to validate whether papers hold up against screening criteria. Try it on our set\, or bring your own papers and criteria. Sample paper set and three criteria profiles provided. \n\n\n\nRegister Now\n\n\n\nAbout the Presenter\n\n\n\n\n\n\nJohn Whitmer
URL:https://ncme.org/event/hands-on-demo-with-triageq-the-genai-evidence-hub-research-repository/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261106T110000
DTEND;TZID=America/New_York:20261106T120000
DTSTAMP:20260929T184629Z
CREATED:20260929T184615Z
LAST-MODIFIED:20260929T184629Z
UID:10000054-1793962800-1793966400@ncme.org
SUMMARY:Share Your Perspective on Assessment Peer Review: NCME Member Feedback Session with CCSSO
DESCRIPTION:This is presented by the Committee on Informing Assessment Policy. \n\n\n\nNCME’ Committee on Informing Assessment Policy is pleased to co-host a virtual feedback session with the Council of Chief State School Officers (CCSSO)\, led by Ben Erwin\, CCSSO’s Director of Assessment and Accountability. CCSSO has been working with state assessment directors\, national experts\, and the U.S. Department of Education to explore key considerations for updating the current assessment peer review guidance. As part of this effort\, CCSSO is partnering with the Center for Assessment and NCME to facilitate a series of conversations across the field. \n\n\n\nThis session is designed specifically for NCME members. It is an opportunity to share your experiences with the peer review process and to offer input on the recommendations for change that CCSSO is currently drafting. Whether you have supported states through peer review\, served as a reviewer\, worked on the technical documentation behind a submission\, or studied the process from a research perspective\, your insights will help shape guidance that affects assessment systems nationwide. We encourage all NCME members to join and weigh in on this important and timely issue. \n\n\n\nRegister Now\n\n\n\n\n\nThis feedback session will be led by Ben Erwin\, CCSSO’s Director of Assessment and Accountability.
URL:https://ncme.org/event/share-your-perspective-on-assessment-peer-review-ncme-member-feedback-session-with-ccsso/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261110T130000
DTEND;TZID=America/New_York:20261110T140000
DTSTAMP:20261105T161718Z
CREATED:20261104T193607Z
LAST-MODIFIED:20261105T161718Z
UID:10000058-1794315600-1794319200@ncme.org
SUMMARY:AI in Measurement Industry Practice: Perspectives from Assessment Organizations
DESCRIPTION:This is presented by the Training & Development Committee \n\n\n\nThis panel asks practitioners who build and deploy measurement systems what has actually changed in their work because of AI\, and what skills the field will need as a result. The discussion is about what these systems require of the organizations running and researching them\, what they have made easier or harder\, how things will change\, and how NCME members can factor these things into their changing skill sets. The session is conversational rather than presentation-heavy. Each panelist offers brief opening remarks\, followed by a moderated discussion built around prepared questions and questions from the audience. The broader goal of the series is to give NCME members opportunities between annual meetings to engage with timely issues relevant to their research\, teaching\, and professional practice. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\nIkkyu Choi is Research Director at ETS Research Institute\, where he leads efforts to ensure AI is used responsibly in educational assessment. His work focuses on developing AI-driven solutions that are valid\, reliable\, and fair to help advance innovation without compromising integrity. Ikkyu received his Ph.D. in Applied Linguistics from the University of California\, Los Angeles\, and his research combines statistical modeling\, machine learning\, and natural language processing to develop new capabilities in educational measurement. He has published extensively across disciplines and was honored with the 2019 Best Article Award from the International Language Testing Association. \n\n\n\n\n\n\n\n\n\n\n\n\n\nMatthew (Matt) S. Johnson is Managing Director\, Innovations Research at the ETS Research Institute\, where he is the Director of the Center for Responsible AI for Learning and Assessment. His work centers on fairness and validity methodology for AI scoring and test security\, alongside human-in-the-loop approaches\, multimodal data\, and the integration of psychometric/statistical methods (e.g.\, IRT) with modern ML systems. \n\n\n\n\n\n\n\n\n\n\n\n\n\nSue Lottridge is Head of Scoring & Insights at Pearson. She has a Ph.D. in Assessment and Measurement from James Madison University and master’s degrees in Mathematics and Computer Science from the University of Wisconsin – Madison. In her current role\, she leads Pearson’s automated and hand-scoring teams. She is author and co-author on multiple papers\, articles\, and book chapters on automated scoring\, hybrid human-automated scoring\, automated feedback\, and AI explainability. Sue wrote the chapter on automated scoring of constructed responses for ITC and ATP Guidelines for Technology-Based Assessment. She also served on the National Academy of Sciences Panel for Opportunities for the NAEP in an Age of AI and Pervasive Computation: A Pragmatic Vision. Finally\, she serves on the board of directors of the National Council on Measurement in Education\, participated on the task force to define the Foundational Competencies in Educational Measurement\, and serves on multiple advisory groups. She is also Chair of the upcoming International Test Commission Guidelines on AI Use in Item Generation and Automated Scoring. \n\n\n\n\n\n\n\n\n\n\n\n\n\nSteven Nydick is a Principal Psychometrician for the Duolingo English Test (DET). He is the primary developer of SPICE\, the DET’s Bayesian item calibration engine\, and contributes to the automation design behind the DET’s psychometric operations. His recent work focuses on maintaining score meaning in a high-volume\, AI-driven assessment\, such as using NLP-based item features to accelerate item piloting and calibrating sparse adaptive testing data. He also co-authored MxML\, a research series on measurement and machine learning. Steven holds a PhD in Quantitative Psychology from the University of Minnesota with 10+ years of experience across certification\, personality\, and language testing.
URL:https://ncme.org/event/ai-in-measurement-industry-practice-perspectives-from-assessment-organizations/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261112T000000
DTEND;TZID=America/New_York:20261114T235959
DTSTAMP:20260212T213246Z
CREATED:20260212T213240Z
LAST-MODIFIED:20260212T213246Z
UID:10000027-1794441600-1794700799@ncme.org
SUMMARY:2026 Classroom Assessment Conference
DESCRIPTION:NCME is excited to announce that the 6th NCME Special Conference on Classroom Assessment will take place November 12–14\, 2026\, at the Radisson Blu\, located in the Mall of America in Bloomington\, Minnesota. This year’s conference promises to be a dynamic and engaging event focused on advancing effective classroom assessment practices across educational contexts. \n\n\n\nLearn More
URL:https://ncme.org/event/2026-classroom-assessment-conference/
LOCATION:Radisson Blu Mall of America\, 2100 Killebrew Dr\, Bloomington\, Minnesota\, 55425\, United States
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261118T160000
DTEND;TZID=America/New_York:20261118T170000
DTSTAMP:20261104T221137Z
CREATED:20261104T221125Z
LAST-MODIFIED:20261104T221137Z
UID:10000059-1795017600-1795021200@ncme.org
SUMMARY:Generative Psychometrics for Automatic Item Development and In-Silico Structural Validity
DESCRIPTION:This is presented by the Artificial Intelligence in Measurement & Education SIGIMIE \n\n\n\nGenerative artificial intelligence offers possibilities for developing educational assessments\, but item generation is just the first step. How can we discover if LLM-generated items represent the intended constructs\, showing the desired dimensionality structure before collecting human data? This talk introduces generative psychometrics as a framework for integrating automatic item development with computational evaluation of structural validity using network-based psychometrics (exploratory graph analysis). The Generative Psychometrics workflow combines large language models\, LLM embeddings\, and network psychometrics (EGA\, UVA\, bootEGA) to generate\, evaluate\, and refine item pools. Construct definitions guide item generation\, while embedding representations are the input for Exploratory Graph Analysis. Unique variable analysis identifies redundant items\, and bootEGA identifies unstable items. In-silico structure provides preliminary evidence about item organization\, while structural validity based on human responses requires empirical investigation with real human data. The talk considers how model dependence\, prompt technique\, and construct definition can influence the results. For educational measurement\, this framework positions in-silico evaluation as a transparent screening and refinement stage that can strengthen construct representation\, prioritize empirical testing\, and support efficient\, theoretically grounded assessment development. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\n\nHudson Golino\, University of Virginia
URL:https://ncme.org/event/generative-psychometrics-for-automatic-item-development-and-in-silico-structural-validity/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261120T130000
DTEND;TZID=America/New_York:20261120T143000
DTSTAMP:20260429T162851Z
CREATED:20260429T162840Z
LAST-MODIFIED:20260429T162851Z
UID:10000035-1795179600-1795185000@ncme.org
SUMMARY:Classroom Assessment Committee Meeting – November
DESCRIPTION:Regular monthly committee meeting. \n\n\n\nRegister Now
URL:https://ncme.org/event/classroom-assessment-committee-meeting-november/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261202T130000
DTEND;TZID=America/New_York:20261202T140000
DTSTAMP:20261104T221420Z
CREATED:20261104T221409Z
LAST-MODIFIED:20261104T221420Z
UID:10000060-1796216400-1796220000@ncme.org
SUMMARY:Closing the Loop: Using Course Feedback to Improve Teaching
DESCRIPTION:This is presented by the Educators of Measurement SIGIMIE \n\n\n\nJoin the Educators of Measurement SIGMIE for a virtual coffee hour to wrap up your fall teaching! Our event\, “Closing the Loop: Using Course Feedback to Improve Teaching\,” is a friendly space to connect with fellow educators\, share experiences\, and exchange practical strategies for collecting and using course feedback. Everyone is welcome! Bring your ideas\, experiences\, and a cup of coffee. We look forward to connecting with you! \n\n\n\nRegister Now
URL:https://ncme.org/event/closing-the-loop-using-course-feedback-to-improve-teaching/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261202T130000
DTEND;TZID=America/New_York:20261202T140000
DTSTAMP:20261117T154910Z
CREATED:20261116T162237Z
LAST-MODIFIED:20261117T154910Z
UID:10000063-1796216400-1796220000@ncme.org
SUMMARY:Should AI Be a Foundational Competency in Educational Measurement?
DESCRIPTION:This is presented by the Training & Professional Development Committee \n\n\n\nAs artificial intelligence (AI) becomes increasingly integrated into educational measurement\, an important question is emerging for the field: Should AI knowledge and skills be considered foundational competencies for measurement professionals? In 2023\, the NCME Task Force on Foundational Competencies in Educational Measurement established a framework outlining the knowledge and skills that define professional preparation and practice. With rapid advances in AI\, this panel will examine whether\, and to what extent\, AI-related competencies should become part of the foundational preparation of future measurement professionals. \n\n\n\nBringing together leading measurement researchers from industry and academia\, this panel will explore what AI-related knowledge and skills are essential for measurement professionals\, how they relate to established foundations in psychometrics\, and whether AI should be treated as a distinct competency or integrated into existing domains. The discussion will also explore implications for graduate education\, professional training\, and the evolving expectations of measurement professionals\, with the goal of fostering dialogue about how foundational competencies should evolve in an AI-driven landscape. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\nAlina A. von Davier is a researcher\, innovator\, and an executive leader with over 20 years of experience in EdTech and in the assessment industry. She is currently the Chief of Measurement Science at Duolingo\, where she guides the Duolingo English Test research and development area. She is also the Founder and CEO of EdAstra Tech\, an EdTech consulting company. In 2022\, she joined the University of Oxford as an Honorary Research Fellow\, and Carnegie Mellon University as a Senior Research Fellow. She is a Venture Partner for LearnLaunch Fund and Accelerator. Her research is  in the field of AI in education\, computational psychometrics\, machine learning\, and assessment. \n\n\n\n\n\n\n\n\n\n\n\n\n\nDerek Briggs is a psychometrician whose work asks what test scores can tell us about what students have learned. A professor at the University of Colorado Boulder since 2002\, he directs the Center for Assessment Design Research and Evaluation (CADRE) and serves as Associate Dean for Faculty. He advises state agencies on the design\, scaling\, and validation of large-scale assessments through service on multiple state technical advisory committees. His research addresses validity arguments\, item response theory\, vertical scaling\, and the measurement of growth. He is a past president of the National Council on Measurement in Education\, a member of the National Academy of Education\, and writes a blog on AI in Education.  \n\n\n\n\n\n\n\n\n\n\n\n\n\nJoshua Wilson\, Ph.D.\, is Associate Professor of Education at the University of Delaware. He researches ways that AI and automation can support the teaching\, learning\, and assessment of writing in K-12 schools. He is the co-editor of the Routledge International Handbook of Automated Essay Evaluation (2024)\, and is the Associate Editor of Journal of Educational Measurement\, Assessing Writing\, Journal of Writing Research\, and AI in Education. He is also the conference co-chair of NCME’s annual AI in Measurement and Education Conference (AIME-Con). \n\n\n\n\n\n\n\n\n\n\n\n\n\nMohammed Abulela\, Ph.D.\, is a Research Scientist at MetaMetrics\, Inc.\, with over a decade of experience in educational measurement\, learning sciences\, and psychometrics. He supports the Lexile® and Quantile® Frameworks through applied research\, linking studies\, and advanced statistical analysis. His current research focuses on test-taking effort and ethical and responsible AI applications in educational measurement. Previously\, he served as a consultant at the University of Minnesota and an Associate Professor at South Valley University. He holds two Ph.D. degrees in Learning Sciences and Educational Measurement. He has authored 33 peer-reviewed articles and is a two-time AERA Best Paper Award recipient.
URL:https://ncme.org/event/should-ai-be-a-foundational-competency-in-educational-measurement/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261209T123000
DTEND;TZID=America/New_York:20261209T133000
DTSTAMP:20261116T220013Z
CREATED:20261116T220001Z
LAST-MODIFIED:20261116T220013Z
UID:10000064-1796819400-1796823000@ncme.org
SUMMARY:Reclaiming Content Validity: Reflections on a 1998 Classic and Today’s Practice
DESCRIPTION:This is presented by the Large-Scale Assessments SIGIMIE \n\n\n\nJoin Steve Sireci and Alexander Hoffman for a relaxed\, candid fireside chat digging into the past\, present\, and future of content validity. Nearly 30 years after Steve published his classic 1998 article on the history of content validity (originally sparked by his dissertation lit review!)\, he’ll sit down with Alexander to look at how the concept has evolved from its 20th-century roots to contemporary assessment practice. Together\, they’ll bounce ideas back and forth across different educational landscapes—with Steve sharing how his team applies these ideas in adult education today\, and Alexander bringing a K–12 lens to examine what modern state learning standards mean for practical validity work. Expect an engaging\, unscripted conversation where Alexander presses Steve on how we gather validity evidence from both test content and response processes when dealing with very different types of domain models. Whether you’re deep in the weeds of psychometrics or just curious about how classic measurement theory holds up in today’s classrooms\, pull up a chair for a lively discussion. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\nStephen G. Sireci\, Ph.D.\, is a Distinguished University Professor and Director of the Center for Educational Assessment in the College of Education at the University of Massachusetts Amherst\, as well as President of Sireci Psychometric Services\, Inc. A recognized leader in the field of educational measurement\, Dr. Sireci is Past-President of the National Council on Measurement in Education (NCME)\, the International Test Commission (ITC)\, and the Northeastern Educational Research Association (NERA). He is an elected member of the National Academy of Education\, a Fellow of the American Educational Research Association (AERA)\, and a Fellow of Division 5 of the American Psychological Association (APA). His research focuses on test fairness\, content validity\, personalized assessment\, test bias\, cross-lingual testing\, standard setting\, and computerized-adaptive testing. Over the course of his career\, he has authored over 160 publications\, served as co-architect of the Massachusetts Adult Proficiency Tests\, and co-edited the International Journal of Testing.  \n\n\n\nDr. Alexander M. Hoffman is an educational research methodologist and President of AleDev Research & Consulting who specializes in research design\, policy analysis\, and large-scale assessment development. A former high school English teacher with a doctorate from Teachers College\, Columbia University\, and master’s degrees from Teachers College and the Harvard Graduate School of Education\, he designs tailored quantitative\, qualitative\, and mixed-methods studies\, including instrument development and program evaluation. Alongside Marjorie Wine\, he co-developed Rigorous Test Development (RTD)\, a principled framework for designing valid test items that elicit targeted cognition across diverse test-takers. He also conducts empirical research on frontier large language models (LLMs)\, exploring how assessment professionals can integrate AI into research and writing workflows without compromising professional judgment.
URL:https://ncme.org/event/reclaiming-content-validity-reflections-on-a-1998-classic-and-todays-practice/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261209T160000
DTEND;TZID=America/New_York:20261209T170000
DTSTAMP:20261112T184340Z
CREATED:20261112T184328Z
LAST-MODIFIED:20261112T184340Z
UID:10000061-1796832000-1796835600@ncme.org
SUMMARY:Distilling LLM Error Judgments into Small\, Calibrated Models for K–12 Writing Feedback
DESCRIPTION:This is presented by the Artificial Intelligence in Measurement & Education SIGIMIE. \n\n\n\nNavvy gives K–12 students feedback on their writing by highlighting spans with convention errors. This talk covers three span types: run-ons\, fragments\, and comma errors. Licensing\, cost\, and latency keep us from serving a frontier LLM directly\, and we had no human-labeled spans to train on. Instead we used an LLM to make them. \n\n\n\nThe first question is whether we can find the errors. A frontier LLM labeled error sentences and comma sites in 4\,880 essays\, grades 3–8\, under a fixed taxonomy. A human annotator reviewed a sample to check the LLM as a rater. We then finetuned a ModernBERT model on the LLM labels and checked its agreement with the LLM on a held-out set. \n\n\n\nThe second question is which of those errors a teacher would flag at a given grade. The span model never sees grade level\, so we fit a small calibration layer on top of it and test it on a hybrid set: a small hand-annotated sample from four grades\, plus additional essays labeled by an LLM judge anchored on the human spans. We report each part separately and combined. \n\n\n\nRegister Now\n\n\n\nAbout the Presenters\n\n\n\n\n\n\nJustin Barber (Pearson)\n\n\n\nMichael Hemenway (Pearson)
URL:https://ncme.org/event/distilling-llm-error-judgments-into-small-calibrated-models-for-k-12-writing-feedback/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261209T160000
DTEND;TZID=America/New_York:20261209T170000
DTSTAMP:20261113T165115Z
CREATED:20261113T165104Z
LAST-MODIFIED:20261113T165115Z
UID:10000062-1796832000-1796835600@ncme.org
SUMMARY:Coffee Chat: Automatic Item Generation
DESCRIPTION:This is presented by the Certification & Licensure SIGIMIE. \n\n\n\nMembers of the Certification and Licensure SIGIMIE will discuss automatic item generation\, including the use of generative AI to prepare items for our organizations’ exam programs. An optional reading is included to prime discussion\, but please feel welcome to join us whether or not you have time to look at the reading. \n\n\n\nHuang\, J.\, & Chang\, H. H. (2026). A Cognitive Design System Approach to Enhancing Cognitive Alignment and Difficulty Control in Gen-AI Item Generation. Applied Measurement in Education\, 1–21. https://doi.org/10.1080/08957347.2026.2740622 \n\n\n\nRegister Now
URL:https://ncme.org/event/coffee-chat-automatic-item-generation/
CATEGORIES:Webinars
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20261218T130000
DTEND;TZID=America/New_York:20261218T143000
DTSTAMP:20260429T162905Z
CREATED:20260429T162851Z
LAST-MODIFIED:20260429T162905Z
UID:10000036-1797598800-1797604200@ncme.org
SUMMARY:Classroom Assessment Committee Meeting – December
DESCRIPTION:Regular monthly committee meeting. \n\n\n\nRegister Now
URL:https://ncme.org/event/classroom-assessment-committee-meeting-december/
CATEGORIES:Webinars
END:VEVENT
END:VCALENDAR