Inter-Rater and Intra-Rater Reliability of the INSPECT (Interactive Nutrition Specific Physical Exam Competency Tool) Measured in Multi-Site Acute Care Settings.

Even as new medical modalities, diagnostics, and technologies are rapidly changing healthcare, providing patients with safe, high-quality care remains the central focus. To provide safe patient care, healthcare providers are obligated to demonstrate and maintain the necessary competence. As more healthcare disciplines move toward a competency-based education model, it is essential to extend the competence verification from the academic educational level to the patient's bedside. The nutrition-focused physical exam (NFPE) is a competency recently adopted by registered dietitian nutritionists (RDNs) for assessing patients' nutritional status. Being a newly acquired skill, validated tools are required to measure NFPE competence during routine clinical practice. The Interactive Nutrition Specific Physical Exam Competency Tool (INSPECT) is a new tool developed specifically to observe and measure RDNs' NFPE competence in clinical settings. The INSPECT was designed and validated for content using expert RDNs' input in the first and second phases of the study. This current study aimed to assess the reliability of the INSPECT through multi-site observations by clinical supervisors evaluating RDNs' NFPE competency during patient assessment. The INSPECT exhibited good inter-rater reliability (ICC = 0.78 for the first assessment and ICC = 0.68 for the second assessment), moderate to strong intra-rater reliability for 37 of 41 items (Spearman rho = 0.54 to 1.0), and excellent internal consistency (Cronbach's α = 0.86 for the first assessment and α = 0.92 for the second assessment). In total, 10 out of the 11 INSPECT subsets showed good to excellent internal consistency (α ranging from 0.70 to 0.98). The results demonstrate that the INSPECT is a reliable tool, is stable over time, and has good agreement and excellent consistency between raters. The INSPECT can be a valuable tool to measure, promote and maintain RDNs' NFPE competence in authentic acute care settings.

Item-Level Analysis of a Newly Developed Interactive Nutrition Specific Physical Exam Competency Tool (INSPECT) Using the Rasch Measurement Model.

The Interactive Nutrition Specific Physical Exam Competency Tool (INSPECT) is a tool designed specifically to observe and measure registered dietitian nutritionists' (RDNs) nutrition-focused physical exam (NFPE) competence in authentic acute care settings. The initial INSPECT items were generated and tested for content and face validity using expert RDNs' input. The INSPECT was further examined for inter-rater, intra-rater, and internal consistency using clinical supervisor observations of RDNs performing NFPE on patients in real-life acute care settings. These previous studies showed the INSPECT to have excellent content validity, acceptable face validity, good inter-rater reliability, moderate to strong intra-rater reliability, and excellent internal consistency. In the current study, the Rasch measurement model was applied to examine the item-level properties of the INSPECT. Results confirm that the INSPECT measured a single construct. All items fit the established criteria for clinical observations of >0.5 and <1.7, had positive point measure correlations, met the Wright Unidimensionality Index criteria of ≥0.9, exhibited one latent construct with >40% variance explained by the Rasch dimension as well as a sub-dimension based on item difficulty from the principal component analysis of the first contrast Rasch residuals. Rasch rating scale analysis revealed that the rating scale and majority of the items (39/41) fit the Rasch model. Rasch item hierarchy analysis matched the a priori hypothesized hierarchy for the top-most and bottom-most items. Ceiling effects were seen for three items (hand hygiene, personal protective equipment, and patient position) and one item (handgrip using hand dynamometer) reached the floor effect. Rasch reliability assessment demonstrated high person reliability (0.86), high item reliability (0.96), and person separation of 3.56 ability levels. The principal component analysis of residuals revealed two factors based on item difficulty, one for micronutrient exam and another for macronutrient exam, initial steps, and bedside manner. The resulting two factors may likely be due to a sub-dimension of the latent NFPE trait. Overall, the INSPECT items were found to have good item-level psychometrics. Continued testing of the INSPECT with RDNs at different ability levels will help to determine cut-off scores ranging from novice to expert. Establishing cut-off scores for the INSPECT will further enhance the utility of the tool.

Content and Face Validation of a Novel, Interactive Nutrition Specific Physical Exam Competency Tool (INSPECT) to Evaluate Registered Dietitians' Competence: A Delphi Consensus from the United States.

The nutrition-focused physical examination (NFPE) is an integral component of nutrition assessment performed by registered dietitian nutritionists (RDNs) to determine signs of malnutrition and other nutrition-related complications. Increased use of this essential skill among RDNs and the transformation of dietetics education to a competency-based model in the near future calls for appropriately validated tools to measure RDNs' NFPE competence. To fill the need for a validated competency tool, this study developed an Interactive Nutrition-Specific Physical Exam Competency Tool (INSPECT) utilizing the initial 70 items identified in the first phase of the study. The second phase of this study aimed to test the preliminary version of the INSPECT for content and face validity. An expert panel of 17 members provided consensus recommendations through the Delphi process. Internal consistency of the consensus was measured with Cronbach's alpha (α) and α of ≥0.70 was defined as acceptable a priori. Inter-rater agreement among the expert panel was determined using the intraclass correlation coefficient (ICC) and an a priori ICC of 0.75 to 0.9 was established as good and >0.9 as excellent agreement. The results showed acceptable face validity (α = 0.71) and excellent content validity for the INSPECT, with an internal consistency of α = 0.97 in the first round and α = 0.96 in the second round. The inter-rater agreement was also excellent with ICC = 0.95 for each of the Delphi rounds. A total of 52 items were retained from the preliminary version of the INSPECT. Open feedback from the experts allowed for the consolidation of 11 similar items for better scoring and evaluation and thus, a total of 41 items were included in the final version of the INSPECT. The final version of the INSPECT is currently being studied in real-life, multi-site clinical settings among practicing RDNs to examine construct validity, reliability, and item-level psychometric properties. Ultimately, the validated INSPECT will be available for the competency evaluation of RDNs practicing in clinical settings.

Item Generation in the Development of an Interactive Nutrition Specific Physical Exam Competency Tool (INSPECT): A Qualitative Study Utilizing Technology-Based Focus Groups in the United States.

An alarming 30% to 50% prevalence rate of disease-related malnutrition among hospitalized patients compels the need for early diagnosis and treatment of malnutrition. Registered Dietitian Nutritionists (RDNs) can utilize the nutrition-focused physical examination (NFPE) as one of the nutrition assessment criteria to accurately diagnose malnutrition. Although RDNs are striving to employ NFPE in practice, a lack of experience and adequate training impedes full utilization of this technique. This results in wide skill variations requiring continuous evaluation of RDNs' NFPE competency. However, a standardized, validated competency tool is not widely available and hence this study aims to develop a standardized, interactive nutrition-specific physical exam competency tool (INSPECT). As a first step in the development of INSPECT, a qualitative, technology-based focus group approach with 7 content and practice experts was utilized to generate appropriate tool items. A total of 70 NFPE items under 9 areas including 12 items for muscle loss, 4 items for subcutaneous fat loss, 31 items for micronutrient deficiencies, 1 item for fluid status, 2 items for handgrip strength, 5 items for initial preparation, 4 items for bedside manner, 8 items for swallowing, and 3 items for abdominal evaluation were generated. This study successfully utilized technology-based focus groups to generate appropriate NFPE items for the competency tool development. Using the items, an initial version of INSPECT has been developed, which is presently being investigated for content and face validity. The final version will undergo field tests and will be examined for reliability, validity, and item-level psychometric properties.

Soluble TNF and IL-6 receptors: indicators of vascular health in women without cardiovascular disease.

Cytokine receptor subunits are released from cells in a regulated manner and circulate in soluble forms at concentrations that are orders of magnitude greater than the concentrations of the cytokines themselves. The purpose of this study was to determine if the circulating concentrations of soluble receptor subunits for interleukin-1 beta (IL-1ß), tumor necrosis factor alpha (TNFα) and interleukin-6 (IL-6) might serve as early indicators of vascular dysfunction independent of the traditional cardiovascular disease (CVD) risk factors in women. Healthy women, aged 20-50 years (n = 36), were assessed for circulating concentrations of the cytokines IL-1ß, IL-6 and TNFα and the soluble cytokine receptor subunits interleukin-1 receptor type I (sIL-1RI), sIL-1RII, sIL-6Rα, glycoprotein 130 (s-gp130), soluble TNF receptor type 1 (sTNFR1), and sTNFR2, along with traditional CVD risk factors. Cytokine receptor subunit expression on mononuclear cells and the release of these subunits in vitro were also determined. Brachial artery flow-mediated dilation (FMD), carotid intima-media thickness (cIMT) and carotid-femoral pulse wave velocity (cfPWV) were assessed by ultrasonography and Doppler probes. Circulating sIL-6Rα correlated negatively with FMD (r = -0.56, p = 0.007) independent of age and other CVD risk factors. Circulating sTNFR1 correlated positively with cfPWV (r = 0.60, p = 0.002). TNFR1 receptor expression on monocytes correlated positively with cIMT (r = 0.51, p = 0.004). Plasma concentrations of IL-1ß, IL-6 and TNFα were not significantly associated with FMD, cIMT or cfPWV. These data suggest that the receptors for IL-6 and TNFα, rather than the cytokines themselves, may be better indicators of early vascular changes that are associated with CVD.

Follicle-stimulating hormone, interleukin-1, and bone density in adult women.

Recent studies have indicated that follicle-stimulating hormone (FSH) promotes bone loss. The present study tested the hypothesis that FSH enhances the activity of bone-resorbing cytokines [interleukin (IL)-1beta, tumor necrosis factor (TNF)-alpha, and IL-6], either by inducing their secretion or by altering their receptor expression. Thirty-six women between the ages of 20 and 50 were assessed for bone mineral density (BMD), reproductive hormone, cytokine ligand and soluble receptor concentrations, and surface expression of cytokine receptors on monocytes. In addition, isolated mononuclear cells were incubated in vitro with exogenous FSH. Univariate regression analyses indicated that BMD was inversely related to serum FSH (r = -0.29 to -0.51, P = 0.03-0.001, depending upon the skeletal site). Physical activity and body composition were also identified as significant factors by multiple regressions. Exogenous FSH induced isolated cells to secrete IL-1beta, TNF-alpha, and IL-6 in proportion to the surface expression of FSH receptors on the monocytes. Endogenous (serum) FSH concentrations correlated with the circulating concentrations of these cytokines. None of these individual cytokines was related to BMD, but the IL-1beta to IL-1 receptor antagonist (IL-1Ra) ratio was inversely related to BMD (r = -0.53, P = 0.002) in all but the most physically active women, who had significantly lower expression of IL-1 type I receptors relative to type II (decoy receptors, P = 0.01). Physical activity also correlated positively with secretion of inhibitory soluble IL-1 receptors (r = 0.53, P = 0.003). Moreover, IL-1Ra correlated strongly with percent body fat (r = 0.66, P < 0.0001). These results indicate that BMD is related to FSH concentration, physical activity, and body composition. Although each of these factors likely has direct effects on bone, the present study suggests that each may also influence BMD by modulating the activity of the osteoresorptive cytokine IL-1beta.