Remote monitoring of clubfoot treatment with digital photographs in low resource settings: Is it accurate?

BACKGROUND: Clinical examination and functional assessment are often the first steps to assess outcome of clubfoot treatment. Clinical photographs may be an adjunct used to assess treatment outcomes in lower resourced settings where physical review by a specialist is limited. We aimed to evaluate the diagnostic performance of photographic images of patients with clubfoot in assessing outcome following treatment. METHODS: In this single-centre diagnostic accuracy study, we included all children with clubfoot from a cohort treated between 2011 and 2013, in 2017. Two physiotherapists trained in clubfoot management calculated the Assessing Clubfoot Treatment (ACT) score for each child to decide if treatment was successful or if further treatment was required. Photographic images were then taken of 79 feet. Two blinded orthopaedic surgeons assessed three sets of images of each foot (n = 237 in total) at two time points (two months apart). Treatment for each foot was rated as 'success', 'borderline' or 'failure'. Intra- and inter-observer variation for the photographic image was assessed. Sensitivity, specificity, positive and negative predictive values were calculated for the photographic image compared to the ACT score. RESULTS: There was perfect correlation between clinical assessment and photographic evaluation of both raters at both time-points in 38 (48%) feet. The raters demonstrated acceptable reliability with re-scoring photographs (rater 1, k = 0.55; rater 2, k = 0.88). Thirty percent (n = 71) of photographs were assessed as poor quality image or sub-optimal patient position. Sensitivity of outcome with photograph compared to ACT score was 83.3%-88.3% and specificity ranged from 57.9%-73.3%. CONCLUSION: Digital photography may help to confirm, but not exclude, success of clubfoot treatment. Future work to establish photographic parameters as an adjunct to assessing treatment outcomes, and guidance on a standardised protocol for photographs, may be beneficial in the follow up of children who have treated clubfoot in isolated communities or lower resourced settings.

Evaluation of a simple tool to assess the results of Ponseti treatment for use by clubfoot therapists: a diagnostic accuracy study.

BACKGROUND: We aimed to develop and evaluate a tool for clubfoot therapists in low resource settings to assess the results of Ponseti treatment of congenital talipes equinovarus, or clubfoot, in children of walking age. METHOD: A literature review and a Delphi process based on the opinions of 35 Ponseti trainers in Africa were used to develop the Assessing Clubfoot Treatment (ACT) tool and score. We followed up children with clubfoot from a cohort treated between 2011 and 2013, in 2017. A full clinical assessment was conducted to decide if treatment was successful or if further treatment was required. The ACT score was then calculated for each child. Inter-observer variation for the ACT tool was assessed. Sensitivity, specificity, positive and negative predictive values were calculated for the ACT score compared to full clinical assessment (gold standard). Predictors of a successful outcome were explored. RESULTS: The follow up rate was 31.2% (68 children). The ACT tool consisted of 4 questions; each scored from 0 to 3, giving a total from 0 to 12 where 12 is the ideal result. The 4 questions included one physical assessment and three parent reported outcome measures. It took 5 min to administer and had excellent inter-observer agreement.An ACT score of 8 or less demonstrated 79% sensitivity and 100% specificity in identifying children that required further intervention, with a positive predictive value of 100% and negative predictive value of 90%. Children who completed two or more years of bracing were four times more likely to achieve an ACT score of 9 or more compared to those who did not (OR: 4.08, 95% CI: 1.31-12.65, p = 0.02). CONCLUSIONS: The ACT tool is simple to administer, had excellent observer agreement, and good sensitivity and specificity in identifying children who need further intervention. The score can be used to identify those children who definitely need referral and further treatment (score 8 or less) and those with a definite successful outcome (score 11 or more), however further discrimination is needed to decide how to manage children with a borderline ACT score of 9 or 10. LEVEL OF EVIDENCE: Level II, Diagnostic Study.

Indicators to assess the functionality of clubfoot clinics in low-resource settings: a Delphi consensus approach and pilot study.

Background: This study aims to determine the indicators for assessing the functionality of clubfoot clinics in a low-resource setting. Methods: The Delphi method was employed with experienced clubfoot practitioners in Africa to rate the importance of indicators of a good clubfoot clinic. The consistency among the participants was determined with the intraclass correlation coefficient. Indicators that achieved strong agreement (mean≥9 [SD <1.5]) were included in the final consensus definition. Based on the final consensus definition, a set of questions was developed to form the Functionality Assessment Clubfoot Clinic Tool (FACT). The FACT was used between February and July 2017 to assess the functionality of clinics in the Zimbabwe clubfoot programme. Results: A set of 10 indicators that includes components of five of the six building blocks of a health system-leadership, human resources, essential medical equipment, health information systems and service delivery-was produced. The most common needs identified in Zimbabwe clubfoot clinics were a standard treatment protocol, a process for surgical referrals and a process to monitor dropout of patients. Conclusions: Practitioners had good consistency in rating indicators. The consensus definition includes components of the World Health Organization building blocks of health systems. Useful information was obtained on how to improve the services in the Zimbabwe clubfoot programme.

Assessment of success of the Ponseti method of clubfoot management in sub-Saharan Africa: a systematic review.

BACKGROUND: Clubfoot is one of the most common congenital deformities affecting mobility. It leads to pain and disability if untreated. The Ponseti method is widely used for the correction of clubfoot. There is variation in how the result of clubfoot management is measured and reported. This review aims to determine and evaluate how success with the Ponseti method is reported in sub-Saharan Africa. METHODS: Five databases were examined in August 2017 for studies that met the inclusion criteria of: (1) evaluation of the effect of clubfoot management; (2) use of the Ponseti method; (3) original study undertaken in sub-Saharan Africa; (4) published between 2000 and 2017. We used the PRISMA statement to report the scope of studies. The included studies were categorised according to a hierarchy of study methodologies and a 27-item quality measure identified methodological strengths and weaknesses. The definition of success was based on the primary outcome reported. RESULTS: Seventy-seven articles were identified by the search. Twenty-two articles met the inclusion criteria, of which 14 (64%) reported a primary outcome. Outcomes were predominantly reported though case series and the quality of evidence was low. Clinical assessment was the most commonly reported outcome measure and few studies reported long-term outcome. The literature available to assess success of clubfoot management is characterised by a lack of standardisation of outcomes, with different measures reporting success in 68% to 98% of cases. CONCLUSION: We found variation in the criteria used to define success resulting in a wide range of results. There is need for an agreed definition of good outcome (successful management) following both the correction and the bracing phases of the Ponseti method to establish standards to monitor and evaluate service delivery.