Prioritisation of Informed Health Choices (IHC) key concepts to be included in lower secondary school resources: A consensus study.

BACKGROUND: The Informed Health Choices Key Concepts are principles for thinking critically about healthcare claims and deciding what to do. The Key Concepts provide a framework for designing curricula, learning resources, and evaluation tools. OBJECTIVES: To prioritise which of the 49 Key Concepts to include in resources for lower secondary schools in East Africa. METHODS: Twelve judges used an iterative process to reach a consensus. The judges were curriculum specialists, teachers, and researchers from Kenya, Uganda, and Rwanda. After familiarising themselves with the concepts, they pilot-tested draft criteria for selecting and ordering the concepts. After agreeing on the criteria, nine judges independently assessed all 49 concepts and reached an initial consensus. We sought feedback on the draft consensus from other stakeholders, including teachers. After considering the feedback, nine judges independently reassessed the prioritised concepts and reached a consensus. The final set of concepts was determined after user-testing prototypes and pilot-testing the resources. RESULTS: The first panel of judges prioritised 29 concepts. Based on feedback from teachers, students, curriculum specialists, and members of the research team, two concepts were dropped. A second panel of nine judges prioritised 17 of the 27 concepts that emerged from the initial prioritisation and feedback. Based on feedback on prototypes of lessons and pilot-testing a set of 10 lessons, we determined that it was possible to introduce nine concepts in 10 single-period (40-minute) lessons. We included eight of the 17 prioritised concepts and one additional concept. CONCLUSION: Using an iterative process with explicit criteria, we prioritised nine concepts as a starting point for students to learn to think critically about healthcare claims and choices.

What should the standard be for passing and mastery on the Critical Thinking about Health Test? A consensus study.

OBJECTIVE: Most health literacy measures rely on subjective self-assessment. The Critical Thinking about Health Test is an objective measure that includes two multiple-choice questions (MCQs) for each of the nine Informed Health Choices Key Concepts included in the educational resources for secondary schools. The objective of this study was to determine cut-off scores for passing (the border between having and not having a basic understanding and the ability to apply the nine concepts) and mastery (the border between having mastered and not having mastered them). DESIGN: Using a combination of two widely used methods: Angoff's and Nedelsky's, a panel judged the likelihood that an individual on the border of passing and another on the border of having mastered the concepts would answer each MCQ correctly. The cut-off scores were determined by summing up the probability of answering each MCQ correctly. Their independent assessments were summarised and discussed. A nominal group technique was used to reach a consensus. SETTING: The study was conducted in secondary schools in East Africa. PARTICIPANTS: The panel included eight individuals with 5 or more years' experience in the following areas: evaluation of critical thinking interventions, curriculum development, teaching of lower secondary school and evidence-informed decision-making. RESULTS: The panel agreed that for a passing score, students had to answer 9 of the 18 questions and for a mastery score, 14 out of 18 questions correctly. CONCLUSION: There was wide variation in the judgements made by individual panel members for many of the questions, but they quickly reached a consensus on the cut-off scores after discussions.