Developing a Geoscience Literacy Exam: Pushing Geoscience Literacy Assessment to New Levels
Abstract
InTeGrate is a community effort aimed at improving geoscience literacy and building a workforce that can use geoscience to solve societal issues. As part of this work we have developed a geoscience literacy assessment instrument to measure students' higher order thinking. This assessment is an important part of the development of curricula designed to increase geoscience literacy for all undergraduate students. To this end, we developed the Geoscience Literacy Exam (GLE) as one of the tools to quantify the effectiveness of these materials on students' understandings of geoscience literacy. The InTeGrate project is a 5-year, NSF-funded STEP Center grant in its first year of funding. Details concerning the project are found at http://serc.carleton.edu/integrate/index.html. The GLE instrument addresses content and concepts in the Earth, Climate, and Ocean Science literacy documents. The testing schema is organized into three levels of increasing complexity. Level 1 questions are single answer, understanding- or application-level multiple choice questions. For example, selecting which type of energy transfer is most responsible for the movement of tectonic plates. They are designed such that most introductory level students should be able to correctly answer after taking an introductory geoscience course. Level 2 questions are more advanced multiple answer/matching questions, at the understanding- through analysis-level. Students might be asked to determine the types of earth-atmosphere interactions that could result in changes to global temperatures in the event of a major volcanic eruption. Because the answers are more complicated, some introductory students and most advanced students should be able to respond correctly. Level 3 questions are analyzing- to evaluating-level short essays, such as describe the ways in which the atmosphere sustains life on Earth. These questions are designed such that introductory students could probably formulate a rudimentary response. We anticipate the detail and sophistication of the response will increase as students progress through the InTeGrate curriculum. A team of 14 community members and assessment experts were assembled to develop the questions and complete validity and reliability testing. An initial set of questions was vetted, revised by the assessment team, and sent for external review. Students can score one point for correct Level 1 answers. For Level 2 questions, students can score from zero to two points, depending on the number of correct answers selected. Rubrics are under development for Level 3 essay questions using a 3 point scale that assigns points based both on the accuracy of the response and the quality of the written response. The final instrument will be used to measure geoscience literacy from introductory, non-science students to upper-level geoscience majors. In addition to covering geoscience content knowledge and understanding, GLE+ is also intended to probe InTeGrate students' ability and motivation to use their geoscience expertise to address problems of environmental sustainability. This final instrument will be made available to the geoscience education community as an assessment to be used in conjunction with InTeGrate teaching materials or as a stand-alone tool for departments to measure student learning gains across the major.
- Publication:
-
AGU Fall Meeting Abstracts
- Pub Date:
- December 2012
- Bibcode:
- 2012AGUFMED51E..03I
- Keywords:
-
- 0840 EDUCATION / Evaluation and assessment;
- 0845 EDUCATION / Instructional tools;
- 0850 EDUCATION / Geoscience education research