Improving assessment of procedural skills in health sciences education: a validation study of a rubrics system in neurophysiotherapy.

BACKGROUND: The development of procedural skills is essential in health sciences education. Rubrics can be useful for learning and assessing these skills. To this end, a set of rubrics were developed in case of neurophysiotherapy maneuvers for undergraduates. Although students found the rubrics to be valid and useful in previous courses, the analysis of the practical exam results showed the need to change them in order to improve their validity and reliability, especially when used for summative purposes. After reviewing the rubrics, this paper analyzes their validity and reliability for promoting the learning of neurophysiotherapy maneuvers and assessing the acquisition of the procedural skills they involve. METHODS: In this cross-sectional and psychometric study, six experts and 142 undergraduate students of a neurophysiotherapy subject from a Spanish university participated. The rubrics' validity (content and structural) and reliability (inter-rater and internal consistency) were analyzed. The students' scores in the subject practical exam derived from the application of the rubrics, as well as the rubrics' criteria difficulty and discrimination indices were also determined. RESULTS: The rubrics´ content validity was found to be adequate (Content Validity Index > 0.90). These showed a unidimensional structure, and an acceptable internal consistency (α = 0.71) and inter-rater reliability (Fleiss' ƙ=0.44, ICC = 0.94). The scores of the subject practical exam practically covered the entire range of possible theoretical scores, showing all the criterion medium-low to medium difficulty indices - except for the one related to the physical therapist position-. All the criterion exhibited adequate discrimination indices (rpbis > 0.39), as did the rubric as a whole (Ferguson's δ = 0.86). Students highlighted the rubrics´ usefulness for learning the maneuvers, as well as their validity and reliability for formative and summative assessment. CONCLUSIONS: The changed rubrics constitute a valid and reliable instrument for evaluating the execution quality of neurophysiotherapy maneuvers from a summative evaluation viewpoint. This study facilitates the development of rubrics aimed at promoting different practical skills in health-science education.

Psychological Health Among Older Adults During and After Quarantine: A Multi-Method Study.

OBJECTIVE: Depression among older adults is a growing problem. With aging being a risk factor for COVID-19 infection, depression in this population may have been exacerbated. This study aimed to describe experiences and changes in depressive symptoms and well-being of older adults during and after the COVID-19 first wave in Spain. METHODS: The study used a multi-method design. Participants self-reported depressive symptoms (Geriatric Depression Scale) and well-being (Cantril Ladder of Life). Participants were asked about changes in depressive symptoms or well-being during quarantine. If a change was perceived, they were asked to describe the change. In addition, the Patient Global Impression of Change scale was used. Both quantitative and qualitative analyses were performed on the data. RESULTS: 111 participants (mean age: 71±5 years; 76% women) completed the study. Sixty-three percent reported mild and 2% reported major depressive symptoms. Nearly half (47.7%) reported changes in depressive symptoms during the lockdown. While 37% reported feeling better during the lockdown, about 11% reported depressive symptoms were worse now compared with during the lockdown. 60% reported worsening well-being during the quarantining period. The qualitative analysis revealed 2 main themes: (1) psychological discomfort (mood deflection, fear/worries, and boredom/inactivity) and (2) social issues (inability to go out, missing family members and others). CONCLUSIONS: Worsening depressive symptoms and lowering of well-being were noticed in this sample of older adults during and post-COVID lockdowns. Evaluation of mental health in the primary care setting and providing referrals for mental health services is essential for older adults who experienced COVID-19-related lockdowns.

Effectiveness of a heart disease blended learning program in physiotherapy students: a prospective study.

Background: In recent years, novel teaching methodologies have been emerging with the aim of improving student learning. One of them is known as Blended Learning. BL allows educators to integrate elements of traditional face-to-face teaching with tailored online learning modalities, integrating the distinct strengths of both methodologies. Purpose: To determine the effectiveness of a heart disease blended learning program in undergraduate physiotherapy students. Methods: 124 participants (average age 21.20 ± 4.67 years, 58.87% female) performed an 8-week heart disease blended learning program that included face-to-face classes and online resources. Knowledge was assessed at baseline, at 4, 8, 12 and 20 weeks. Motivation and engagement were assessed at 4 and 8 weeks. Design of the instructions and learning behaviors were measured at 8 weeks. Finally, 108 subjects completed the study. Results: Knowledge significantly increased mid-program (p = 0.02), at the end of the program (p < 0.001), at 12 weeks (p < 0.001) and 20 weeks (p = 0.001). After the intervention, a high intrinsic motivation was shown (5.60 ± 0.80)) over 7), whilst extrinsic motivation scored 4.24 ± 0.97 over 7.Finally, engagement (3.98 ± 0.52) over 5), design of the instructions (4.15 ± 0.62) over 5) and learning behaviors (70.51 ± 36.08) downloads, 28.97 ± 16.09) topics visited, and online questionnaires scored 7.67 ± 1.60) over 10) reported adequate scores. Conclusion: This program seems to be an appropriate methodology in future physiotherapists, since it improved knowledge and participants exhibited a high motivation and an adequate engagement, design of the program instructions and learning behaviors.

Functional and emotional impact of COVID-19 lockdown on older adults with sarcopenia living in a nursing home: A 15-month follow-up.

This study aimed to detect the functional and emotional impact of COVID-19 lockdown on institutionalized older adults with sarcopenia during a 15-month follow-up. A prospective longitudinal cohort study was conducted in a nursing home. Participants were screened for sarcopenia, and those with a score of ≥4 points according to SARC-F questionnaire were included. Assessments were performed pre-lockdown (T1), 12 months (T2) after, and at a 15-month follow-up (T3). Functional measurements included chair stand test, handgrip, biceps brachii and quadriceps femoris strengths, appendicular skeletal mass, gait speed, Short Physical Performance Battery, and Timed Up-and-Go test. Emotional assessments included Short-Form Health Survey, Geriatric Depression Scale-Short Form, and the Mini-Mental State Examination. The analyzed sample showed a reduction in bicep strength, and other upper and lower limb strength variables showed a decreasing trend with no changes regarding muscle mass. Physical performance showed a change, specifically a deterioration in the subtest related to balance. Cognitive and emotional components were affected and quality of life was decreased. It is of paramount importance to focus on sarcopenic older adults since their characteristics can deteriorate when isolation measures are conducted.

Effectiveness of a blended learning intervention in cardiac physiotherapy. A randomized controlled trial.

Background: Blended learning (BL) combines both face-to-face learning (FL) and online learning. This study aims to compare the effectiveness of a BL intervention vs. a FL intervention in relation to the knowledge, competencies, satisfaction, perceptions, usability, and BL acceptance of physiotherapy students. Methods: An assessor-blinded randomized trial was performed. A total of 100 students were randomly allocated to either the BL group (BLG, n = 48) or FL group (FLG, n = 52). The BLG received face-to-face classes plus access to online resources (online syllabus, Moodle, scientific-based videos and websites, activities, glossary, and apps). The FLG received face-to-face classes and hardcopy resources (hardcopy syllabus, scientific-based information, activities, and a glossary). Knowledge, ethical and gender competencies, satisfaction, perceptions, usability, and BL acceptance were assessed. Results: The BLG showed higher scores than the FLG for knowledge (p = 0.011), three ethical/gender competencies (p < 0.05), increased motivation to prepare themselves before class (p = 0.005), increased motivation and ability of thinking (p = 0.005), improved understanding of important topics (p = 0.015), course organization (p = 0.017), educational material (p = 0.001), easiness of understanding (p = 0.007), comprehensive coverage of the subject (p = 0.001), and clarity of instructions (p = 0.004), while usability was acceptable. Conclusion: The BL intervention can be used for improving the knowledge, competencies, perceptions, and satisfaction of the students. In addition, BL acceptance was positive, and usability was found to be acceptable. This study supports the use of BL as a pedagogical approach to foster innovative learning.

Deepening the understanding of the structural validity of the Tilburg Frailty Indicator.

BACKGROUND: Psychometric properties of the Tilburg Frailty Indicator (TFI) have shown low internal consistency for psychological and social domains, and evidence for its structure validity is controversial. Moreover, research on TFI is frequently limited to community dwellings. AIMS: To evaluate structural validity, reliability, and convergent and divergent validity of the Spanish version of the Tilburg Frailty Indicator (TFI) in both community-dwelling and institutionalized older people. MATERIALS AND METHODS: A cross-sectional study was conducted on Spanish older adults (n = 457) recruited from both community settings (n = 322) and nursing homes (n = 135). Participants completed the TFI and other frailty instruments: Fried's Frailty Phenotype, Edmonton Frailty Scale, FRAIL Scale, and Kihon Checklist (KCL). Confirmatory Factor Analysis (CFA), and reliability and validity coefficients were estimated. RESULTS AND DISCUSSION: Some items from physical and social domains showed low factor loadings (< 0.40). The three-factor CFA model showed better fit indices after depurating these items. Reliability estimates were good (CRI ≥ 0.70) for physical and psychological domains in the institutionalized sample, while in the community dwellings, only physical domain reliability was adequate. Convergent and divergent validity of physical and psychological domains was good, except for some alternative psychological measures highly correlating with the TFI physical component (KCL-depressive mood and Edmonton mood). However, the social domain showed low correlations with some social indicators. CONCLUSION: The findings of this study clarify some of the controversial validation results of the TFI structure and provide evidence to improve its use in psychometric terms. CLINICAL TRIAL REGISTRATION NUMBER: NCT03832608.

Frailty and Sarcopenia in Acute-on-Chronic Liver Failure.

In patients with cirrhosis, sarcopenia is a critical reduction in skeletal muscle mass and frailty represents a status of global physical dysfunction caused by under nutrition, muscle wasting, and functional impairment. Both are prevalent conditions in liver transplant candidates and have shown to be independent predictors of adverse outcome. Evidence supports their incorporation into clinical practice both as a prognostic factor guiding clinical decision making and as a tool to identify candidates for physical and nutritional interventions. The wide heterogeneity of instruments used for sarcopenia and frailty measurement, the absence of a single suitable instrument for sarcopenia and frailty assessment in the outpatient versus inpatient acute-on-chronic clinical scenario, and the lack of strong evidence showing a beneficial effect of sarcopenia and frailty improvement on outcomes before and after transplantation are some of the questions that remain unanswered.

Students' Perceptions of Instructional Rubrics in Neurological Physical Therapy and Their Effects on Students' Engagement and Course Satisfaction.

One of the main challenges faced by physical therapy (PT) students is to learn the practical skills involved in neurological physical therapy (PT). To help them to acquire these skills, a set of rubrics were designed for formative purposes. This paper presents the process followed in the creation of these rubrics and their application in the classroom, noting that students perceived them as valid, reliable, and highly useful for learning. The perception of the validity and usefulness of the rubrics has different closely related dimensions, showing homogeneous values across the students´ sociodemographic and educational variables, with the exception of dedication to studying, which showed a significant relationship with schoolwork engagement and course satisfaction. The adequacy of the hypothesized structural model of the relationships among the variables was confirmed. Direct effects of the perception of the rubrics' validity and engagement on course satisfaction were found, as well as direct effects of the assessment of the usefulness of the rubrics on schoolwork engagement and indirect effects on course satisfaction through this latter variable. The results are discussed taking into account the conclusions of previous research and different instructional implications.

Using the Updated EWGSOP2 Definition in Diagnosing Sarcopenia in Spanish Older Adults: Clinical Approach.

Recently the European Working Group on Sarcopenia in Older People (EWGSOP2) has updated diagnostic criteria for sarcopenia, which consist of one or more measures of muscle strength, muscle mass, and physical performance, plus an initial screening test called SARC-F. The main objective was to compare the number of cases of sarcopenia, using the different measurements and screening options. A cross-sectional study was conducted on Spanish older adults (n = 272, 72% women). Combining the different measures proposed by the steps described in the EWGSOP2 algorithm, 12 options were obtained (A-L). These options were studied in each of the three models: (1) using SARC-F as initial screening; (2) not using SARC-F; and (3) using SARC-CalF instead of SARC-F. A χ2 independence test was statistically significant (χ2(6) = 88.41, p < 0.001), and the association between the algorithm used and the classification of sarcopenia was moderate (Cramer's V = 0.226). We conclude that the different EWGSOP2 measurement options imply case-finding differences in the studied population. Moreover, when applying the SARC-F, the number of people classified as sarcopenic decreases. Finally, when SARC-CalF is used as screening, case finding of sarcopenic people decreases. Thus, clinical settings should consider these outcomes, since these steps can make preventive and therapeutic interventions on sarcopenia vary widely.

Kihon Checklist to assess frailty in older adults: Some evidence on the internal consistency and validity of the Spanish version.

AIM: The aim of this study was to assess the internal consistency, hypothesis testing and criterion-related validity of the Spanish versions of the Kihon Checklist (KCL) - the original 25-item and reduced 15-item versions - for screening frailty in community-dwelling older adults. METHODS: A cross-sectional study was carried out between March and September 2018 in Valencia province (Spain). A sample of 251 participants was recruited. Construct validity was assessed using four different frailty instruments, and alternative measures corresponding to the KCL domains (handgrip strength, gait speed, the Short Physical Performance Battery, skeletal muscle mass index, physical activity level, functional status, cognitive function, depressive mood, health-related quality of life and nutritional status). Fried's Frailty Phenotype was used to evaluate criterion validity. RESULTS: Internal consistency assessed with Kuder-Richardson Formula had a value of 0.69 for the 25-item version, slightly lower than the usual 0.7 for considering good reliability, and 0.71 for the 15-item version. There were significant correlations between KCL versions and Fried's Frailty Phenotype, Edmonton Scale, Tilburg Indicator and FRAIL Scale. Consistent significant correlations were also obtained with all frailty measurements and instrumental activities of daily living, physical strength, eating, socialization, and mood domains of the KCL. The KCL closely correlated with other standardized measurements of physical function, cognitive function, depressive mood, and health-related quality of life. The KCL also showed satisfactory diagnostic accuracy for frailty (area under the curve 0.891 for KCL-25; area under the curve 0.857 for KCL-15). The optimal cut-off points were 5/6 and 3/4, respectively. CONCLUSIONS: The findings suggest that both versions of the KCL, especially KCL-15, showed adequate evidence of validity and internal consistency as a preliminary screening of frailty among community-dwelling older adults in Spain. Geriatr Gerontol Int 2021; 21: 262-267.

Physical frailty in liver transplantation.

In patients with cirrhosis, frailty represents a status of global physical dysfunction associated with a multiplicity of factors, including muscle wasting, undernutrition and malnutrition, and functional impairment. This condition is particularly prevalent among those with advanced cirrhosis, such as liver transplant (LT) candidates. Studies in this vulnerable population have demonstrated that its presence is independently predictive of adverse outcomes both pre- and post-transplantation, and thus that its incorporation into clinical practice could result in improved clinical decision-making, particularly regarding the identification of candidates for physical and nutritional interventions. There are, however, some limitations to its immediate incorporation into organ allocation prioritization models, including the wide heterogeneity of instruments used for measuring frailty, and particularly the lack of a single one suitable in all LT clinical scenarios (inpatient vs outpatient; pre- vs post-transplant). Finally, the data on the potential effects of frailty improvement on the diverse range of outcome measures are still preliminary.

Functional and Clinical Characteristics for Predicting Sarcopenia in Institutionalised Older Adults: Identifying Tools for Clinical Screening.

BACKGROUND: Recently, the European Working Group on Sarcopenia in Older People (EWGSOP2) has updated the sarcopenia definition based on objective evaluation of muscle strength, mass and physical performance. The aim of this study was to analyse the relationship between sarcopenia and clinical aspects such as functionality, comorbidity, polypharmacy, hospitalisations and falls in order to support sarcopenia screening in institutionalised older adults, as well as to estimate the prevalence of sarcopenia in this population using the EWGSOP2 new algorithm. METHODS: A multicentre cross-sectional study was conducted on institutionalised older adults (n = 132, 77.7% female, mean age 82 years). Application of the EWGSOP2 algorithm consisted of the SARC-F questionnaire, handgrip strength (HG), appendicular skeletal muscle mass index (ASMI) and Short Physical Performance Battery (SPPB). Clinical study variables were: Barthel Index (BI), Abbreviated Charlson's Comorbidity Index (ACCI), number of medications, hospital stays and falls. RESULTS: Age, BI and ACCI were shown to be predictors of the EWGSOP2 sarcopenia definition (Nagelkerke's R-square = 0.34), highlighting the ACCI. Sarcopenia was more prevalent in older adults aged over 85 (p = 0.005), but no differences were found according to gender (p = 0.512). CONCLUSION: BI and the ACCI can be considered predictors that guide healthcare professionals in early sarcopenia identification and therapeutic approach.