Evaluating Student Success and Progress in the Maryland Sea Grant REU Program

The Maryland Sea Grant's Research Experiences for Undergraduate (REU) 12-week summer program is in its 24th year. This estuarine science-focused program has evolved, based in part on our use of assessment tools to measure the program's effectiveness. Our goal is to understand the REU program's effectiveness in such areas as improving student understanding of scientific research, scientific ethics and marine science careers. Initially, our assessment approach was limited to short surveys that used qualitative answers from students about their experience. However, in the last decade we have developed a more comprehensive approach to measure program effectiveness. Currently, we use paired pre- and post-survey questions to estimate student growth during the program. These matching questions evaluate the student's change in knowledge and perception of science research over the course of the summer program. Additionally, we administer several surveys during the 12 weeks of the program to measure immediate responses of students to program activities and to gauge the students' evolving attitudes to customize each year's program. Our 2011 cohort showed consistent improvement in numerous areas, including understanding the nature of science (pre: 4.35, post: 4.64 on a 5 point scale), what graduate school is like (3.71, 4.42), the job of a researcher (4.07, 4.50), and career options in science (3.86, 4.42). Student confidence also increased in numerous skills required for good scientists. To analyze the long-term impact of our program, we survey our alumni to assess graduate degrees earned and career choices. A large percentage (72%) of our tracked alumni have continued on to graduate school, with subsequent careers spanning the academic (51%), public (24%) and private (25%) sectors. These assessments demonstrate that our program is successful in meeting our key objectives of strengthening the training of undergraduates in the sciences and retaining them in marine science careers.