ABSTRACT
The biology education literature includes compelling assertions that unfamiliar problems are especially useful for revealing students' true understanding of biology. However, there is only limited evidence that such novel problems have different cognitive requirements than more familiar problems. Here, we sought additional evidence by using chatbots based on large language models as models of biology students. For human physiology and cell biology, we developed sets of realistic and hypothetical problems matched to the same lesson learning objectives (LLOs). Problems were considered hypothetical if (i) known biological entities (molecules and organs) were given atypical or counterfactual properties (redefinition) or (ii) fictitious biological entities were introduced (invention). Several chatbots scored significantly worse on hypothetical problems than on realistic problems, with scores declining by an average of 13%. Among hypothetical questions, redefinition questions appeared especially difficult, with many chatbots scoring as if guessing randomly. These results suggest that, for a given LLO, hypothetical problems may have different cognitive demands than realistic problems and may more accurately reveal students' ability to apply biology core concepts to diverse contexts. The Test Question Templates (TQT) framework, which explicitly connects LLOs with examples of assessment questions, can help educators generate problems that are challenging (due to their novelty), yet fair (due to their alignment with pre-specified LLOs). Finally, ChatGPT's rapid improvement toward expert-level answers suggests that future educators cannot reasonably expect to ignore or outwit chatbots but must do what we can to make assessments fair and equitable.
ABSTRACT
O objetivo deste estudo foi explorar o desenvolvimento de um grupo de professores de Educação Física (EF), que enfrentaram dificuldades com o ensino remoto, em uma comunidade de prática (CdP) durante a pandemia da COVID-19. O estudo teve como enfoque os fatores que apoiaram o processo de cultivo da CdP em formato on-line. Empregando a metodologia de pesquisa-ação, o estudo envolveu 15 professores de EF (uma professora atuou como professora-facilitadora) e uma amiga crítica. Os dados foram gerados por meio de encontros da CdP, entrevistas, conversas com amiga crítica e diário reflexivo. A análise temática resultou em quatro temas abrangentes: a) a pandemia como catalisadora da colaboração; b) auto-organização dos professores para viabilizar a comunidade; c) desenvolvimento de pesquisa colaborativa; e d) diálogo para um novo ciclo de colaboração. Notavelmente, a auto-organização dos professores foi fundamental para guiar a CdP ao longo de estágios de desenvolvimento. São discutidos outros aspectos que contribuíram para o desenvolvimento da CdP em um cenário de pandemia.(AU)
El objetivo de este estudio ha sido explorar el desarrollo de un grupo de profesores de Educación Física (EF) que enfrentaron dificultades con la enseñanza remota, en una comunidad de práctica (CdP) durante la pandemia de COVID-19. El estudio se centró en los factores que apoyaron el proceso de cultivo de la CdP en un formato online. Utilizando la metodología de investigación-acción, el estudio involucró a 15 profesores brasileños de EF, una profesora que actuó como profesora-facilitadora y una amiga crítica. Los datos se generaron a través de encuentros de la CdP, entrevistas, conversaciones con la amiga crítica y diario reflexivo. El análisis temático resultó en cuatro temas generales: a) la pandemia como catalizadora de la colaboración; b) autoorganización de los profesores para hacer posible la comunidad; c) desarrollo de investigación colaborativa; y d) diálogo para un nuevo ciclo de colaboración. De manera notable, la autoorganización de los profesores fue fundamental para guiar a la CdP a lo largo de las etapas de desarrollo. Se discuten otros aspectos que contribuyeron al desarrollo de la CdP en un escenario de pandemia.(AU)
The purpose of this study was to explore the development of a group of Brazilian Physical Education (PE) teachers, who struggled with remote teaching, into a community of practice (CoP) during the COVID-19 pandemic. The study focused on factors that supported the CoP cultivation process in an online format. Employing action research methodology, the study involved 15 PE teachers, with one of them acting as a teacher-facilitator, and one critical friend. Data were generated through CoP's meetings, interviews, critical friend conversations, and reflexive journaling. Thematic analysis resulted in four overarching themes: a) the pandemic as a catalyst for collaboration; b) teachers' self-organization to enact the community; c) development of collaborative research; and d) dialogue towards a new cycle of collaboration. Noteworthy was that teachers' self-organization was critical for guiding the CoP throughout stages of development. Further aspects that contributed to CoP's development in a pandemic scenario are discussed.(AU)
Subject(s)
Humans , Male , Female , Education, Continuing , Digital TechnologyABSTRACT
Reform efforts to improve physical education often rely on facilitators to promote positive change. Although it is becoming more common, little is currently understood about the facilitation role. Our purpose was to examine facilitators' collective knowledge and experience with ongoing physical education professional development (PD), specifically regarding conceptions of their role in the process. Participants included 12 experienced PD facilitators. Data sources included formal semistructured and informal conversational interviews and participants' curriculum vitae. Results indicated that facilitators held common beliefs about teacher learning and self-identified actions aligned with those beliefs. Adhering to constructivist views of learning, facilitators underscored the role of prior knowledge and the active and social nature of learning. Their remarkably similar views emphasized multiple aspects of teacher capacity building.
