Cognitive Diagnostic Models Methods For Practical Applications

Cognitive Diagnostic Models: Methods for Practical Applications

Handbook of Diagnostic Classification Models

This handbook provides an overview of major developments around diagnostic classification models (DCMs) with regard to modeling, estimation, model checking, scoring, and applications. It brings together not only the current state of the art, but also the theoretical background and models developed for diagnostic classification. The handbook also offers applications and special topics and practical guidelines how to plan and conduct research studies with the help of DCMs. Commonly used models in educational measurement and psychometrics typically assume a single latent trait or at best a small number of latent variables that are aimed at describing individual differences in observed behavior. While this allows simple rankings of test takers along one or a few dimensions, it does not provide a detailed picture of strengths and weaknesses when assessing complex cognitive skills. DCMs, on the other hand, allow the evaluation of test taker performance relative to a potentially large number of skill domains. Most diagnostic models provide a binary mastery/non-mastery classification for each of the assumed test taker attributes representing these skill domains. Attribute profiles can be used for formative decisions as well as for summative purposes, for example in a multiple cut-off procedure that requires mastery on at least a certain subset of skills. The number of DCMs discussed in the literature and applied to a variety of assessment data has been increasing over the past decades, and their appeal to researchers and practitioners alike continues to grow. These models have been used in English language assessment, international large scale assessments, and for feedback for practice exams in preparation of college admission testing, just to name a few. Nowadays, technology-based assessments provide increasingly rich data on a multitude of skills and allow collection of data with respect to multiple types of behaviors. Diagnostic models can be understood as an ideal match for these types of data collections to provide more in-depth information about test taker skills and behavioral tendencies.

Diagnostic Measurement

This book provides a comprehensive introduction to the theory and practice of diagnostic classification models (DCMs), which are useful for statistically driven diagnostic decision making. DCMs can be employed in a wide range of disciplines, including educational assessment and clinical psychology. For the first time in a single volume, the authors present the key conceptual underpinnings and methodological foundations for applying these models in practice. Specifically, they discuss a unified approach to DCMs, the mathematical structure of DCMs and their relationship to other latent variable models, and the implementation and estimation of DCMs using Mplus. The book's highly accessible language, real-world applications, numerous examples, and clearly annotated equations will encourage professionals and students to explore the utility and statistical properties of DCMs in their own projects. The companion website (www.guilford.com/rupp-materials) features chapter exercises with answers, data sets, Mplus syntax code, and output. Winner--Award for Significant Contribution to Educational Measurement and Research Methodology, AERA Division D