The importance of formative assessment in science and engineering ethics education: some evidence and practical advice.

Recent research in ethics education shows a potentially problematic variation in content, curricular materials, and instruction. While ethics instruction is now widespread, studies have identified significant variation in both the goals and methods of ethics education, leaving researchers to conclude that many approaches may be inappropriately paired with goals that are unachievable. This paper speaks to these concerns by demonstrating the importance of aligning classroom-based assessments to clear ethical learning objectives in order to help students and instructors track their progress toward meeting those objectives. Two studies at two different universities demonstrate the usefulness of classroom-based, formative assessments for improving the quality of students' case responses in computational modeling and research ethics.

Observations on the responsible development and use of computational models and simulations.

Most previous works on responsible conduct of research have focused on good practices in laboratory experiments. Because computation now rivals experimentation as a mode of scientific research, we sought to identify the responsibilities of researchers who develop or use computational modeling and simulation. We interviewed nineteen experts to collect examples of ethical issues from their experiences in conducting research with computational models. We gathered their recommendations for guidelines for computational research. Informed by these interviews, we describe the respective professional responsibilities of developers and users of computational models in research. In particular, we examine whether developers should disclose the full computational codes, and we explain how developers and users should minimize harms from improper uses of models.

Outcomes assessment of role-play scenarios for teaching responsible conduct of research.

We describe the summative assessment of role-play scenarios that we previously developed to teach central topics in the responsible conduct of research (RCR) to graduate students in science and engineering. Interviews with role-play participants, with participants in a case discussion training session, and with untrained students suggested that role-playing might promote a deeper appreciation of RCR by shifting the focus away from wanting to simply "know the rules." We also present the results of a think-aloud case analysis study and describe the development of a behaviorally-anchored rating scale (BARS) to assess participants' case analysis performance.

Development of role-play scenarios for teaching responsible conduct of research.

We describe the development, testing, and formative evaluation of nine role-play scenarios for teaching central topics in the responsible conduct of research to graduate students in science and engineering. In response to formative evaluation surveys, students reported that the role-plays were more engaging and promoted deeper understanding than a lecture or case study covering the same topic. In the future, summative evaluations will test whether students display this deeper understanding and retain the lessons of the role-play experience.

Can instruction in engineering ethics change students' feelings about professional responsibility?

How can a course on engineering ethics affect an undergraduate student's feelings of responsibility about moral problems? In this study, three groups of students were interviewed: six students who had completed a specific course on engineering ethics, six who had registered for the course but had not yet started it, and six who had not taken or registered for the course. Students were asked what they would do as the central character, an engineer, in each of two short cases that posed moral problems. For each case, the role of the engineer was successively changed and the student was asked how each change altered his or her decisions about the case. Students who had completed the ethics course considered more options before making a decision, and they responded consistently despite changes in the cases. For both cases, even when they were not directly involved, they were more likely to feel responsible and take corrective action. Students who were less successful in the ethics course gave answers similar to students who had not taken the course. This latter group of students seemed to have weaker feelings of responsibility: they would say that a problem was "not my business." It appears that instruction in ethics can increase awareness of responsibility, knowledge about how to handle a difficult situation, and confidence in taking action.

Educational technologies and the teaching of ethics in science and engineering.

To support the teaching of ethics in science and engineering, educational technologies offer a variety of functions: communication between students and instructors, production of documents, distribution of documents, archiving of class sessions, and access to remote resources. Instructors may choose to use these functions of the technologies at different levels of intensity, to support a variety of pedagogies, consistent with accepted good practices. Good pedagogical practices are illustrated in this paper with four examples of uses of educational technologies in the teaching of ethics in science and engineering. Educational technologies impose costs for the purchase of hardware, licensing of software, hiring of support personnel, and training of instructors. Whether the benefits justify these costs is an unsettled question. While many researchers are studying the possible benefits of educational technologies, all instructors should assess the effectiveness of their practices.

Seven ways to plagiarize: handling real allegations of research misconduct.

As the research integrity officer at my university for two years, I handled eight allegations of plagiarism. These eight cases show that initial appearances can be mistaken, that policies for handling allegations of research misconduct cannot cover every contingency, and that many cases can be resolved collegially without resort to formal procedures.