Use of the Attribute Hierarchy Method for Development of Student Cognitive Models and Diagnostic Assessments in Geoscience Education

There is a recognized need to better understand student learning in the geosciences (Stofflet, 1994; Zalles, Quallmalz, Gobert and Pallant, 2007). Educators, cognitive psychologists and practicing scientists have also called for instructional approaches that support deep conceptual development (Manduca, Mogk and Stillings, 2004, Libarkin and Kurdziel, 2006). In both cases there is an important role for educational measures that can generate descriptions of how student understanding develops over time and inform instruction. The presenters will suggest one way of responding to these needs by describing the Attribute Hierarchy Method (AHM) of assessment (Leighton, Gierl and Hunka, 2004; Gierl, Cui, Wang and Zhou, 2008) as enacted in a large-scale earth science curriculum development project funded by the Bill and Melinda Gates Foundation. The AHM is one approach to criterion referenced, diagnostic assessment that ties measure design to cognitive models of student learning in order to support justified inferences about students’ understanding and the knowledge required for continued development. The Attribute Hierarchy Method bears potential for researchers and practitioners interested in learning progressions and solves many problems associated with making meaningful, justified inferences about students’ understanding based on their assessment performances. The process followed to design and develop the project’s cognitive models as well as a description of how they are used in subsequent assessment task design will be emphasized in order to demonstrate how the AHM may be applied in the context of geoscience education. Results from over twenty student cognitive interviews, and two hypothesized cognitive models -- one describing a student pathway for understanding rock formation and a second describing a student pathway for increasingly sophisticated use of maps and models in the geosciences - are also described. Sample assessment items will be provided as indications of the final assessment measures. The project’s efforts to create an on-line geoscience curriculum for use in the middle school grades that adapts to student performances by customizing whole lessons, grouping assignments or student feedback will provide a broader context for the discussion.