Reflecting on the quality of a methodologically pluralist evaluation of a large-scale Indigenous health research collaboration in Australia.

BACKGROUND: Indigenous communities worldwide lead calls for all evaluations of research, programmes and policies affecting their communities to reflect the values, priorities and perspectives of the Indigenous peoples and communities involved. Tools, such as the Quality Appraisal Tool (QAT), are available to assess research quality through an Indigenous cultural lens. Good evaluation requires that evaluation efforts be evaluated. We found that critical reflection on the quality of evaluations from an Indigenous perspective is largely absent from the published literature. To ensure that we strive for quality in evaluation as determined by Indigenous people with whom we work, we examined the quality of our own evaluation of an Indigenous health research collaboration by conducting a reflexive dialogue. METHODS: The QAT was used to assess our evaluation according to Indigenous health research principles. Our qualitative study used analytical coautoethnography to generate data through a series of reflexive dialogue sessions with Indigenous and non-Indigenous members of the research collaboration, using the QAT criteria as discussion prompts. Our ideas and reflections were compared and contrasted through a collaborative and iterative writing process, multiple review cycles and discussions. RESULTS: We documented our findings against the QAT framework. We found examples that each QAT principle had, to some extent, been adhered to, but constantly needed to assess whether the principles were fully achieved to our satisfaction. Strengths of the evaluation included being adaptable and responsive to emerging issues for the research collaboration, while areas for improvement included more Indigenous leadership of, and involvement in, evaluation. CONCLUSIONS: Although reflexive evaluation practice is not always comfortable, it does provide an opportunity to generate insights for improvement. Reflecting as we did-in a partnership between Indigenous and non-Indigenous colleagues-enabled deeper insights and meaning. We anticipate that our process models how other research in Indigenous contexts might better advance ethical, quality Indigenous research through working in collaboration with Indigenous researchers and communities.

Self-reported hearing loss in urban Aboriginal and Torres Strait Islander adults: unmeasured, unknown and unmanaged.

Background Effective management of hearing loss in adults is fundamental for communication, relationships, employment, and learning. This study examined the rates and management of self-reported hearing loss in urban Aboriginal and Torres Strait Islander adults. Methods A retrospective, observational study of Aboriginal and Torres Strait Islander people aged ≥15years who had annual health checks at an urban Aboriginal and Torres Strait Islander primary healthcare clinic in Inala, Queensland, was conducted to determine self-reported hearing loss rates by age and ethnic groups stratified by sex. A medical record audit of patients who self-reported hearing loss from January to June 2021 was performed to identify current management approaches, and the proportion of patients that were appropriately managed. Results Of the 1735 patients (average age 40.7years, range 15.0-88.5years, 900 [52.0%] women) who completed 3090 health checks between July 2018 and September 2021, 18.8% self-reported hearing loss. Rates did not differ between men and women. However, significant effects were noted for age, with rates increasing from 10.7% for patients aged 15-24years to 38.7% for those aged ≥65years. An audit of 73 patient medical records revealed that 39.7% of patients with self-reported hearing loss were referred to Ear, Nose and Throat/audiology or received other management. A total of 17.8% of patients owned hearing aids. Conclusions Only 40% of Aboriginal and Torres Strait Islander adults who self-reported hearing loss were referred for management. Significant changes to clinical management and government-funded referral options for hearing services are required to improve the management of self-reported hearing loss in this population.

What Matters to Aboriginal and Torres Strait Islander Youth (WM2Y): a study protocol to develop a national youth well-being measure.

INTRODUCTION: Adolescents face challenges associated with unprecedented environmental, social and technological changes. The impacts of colonisation, intergenerational trauma, racism and socioeconomic disadvantage intensify these challenges for many Aboriginal and Torres Strait Islander adolescents. However, Aboriginal and Torres Strait Islander adolescents also have cultural, spiritual, family and community capital that fosters their well-being.To date, little research has focused on understanding and appropriately measuring the well-being of Aboriginal and Torres Strait Islander adolescents, a pivotal factor in informing and guiding programmes and interventions that support them. This study will identify the domains of well-being and develop a new preference-based well-being measure based on the values and preferences of Aboriginal and Torres Strait Islander youth (aged 12-17 years). METHODS AND ANALYSIS: This project will be conducted across three research phases: (1) qualitative exploration of well-being using PhotoYarning and yarns with adult mentors to develop candidate items; (2) Think Aloud study, quantitative survey, psychometric analysis, validity testing of candidate items and finalisation of the descriptive system; and (3) scoring development using a quantitative preference-based approach. A multinomial (conditional) logit framework will be used to analyse responses and generate a scoring algorithm for the new preference-based well-being measure. ETHICS AND DISSEMINATION: Ethics approvals have been obtained from: the Human Research Ethics Committees for each state and territory where data are being collected, the institutions where the research is being conducted and from the relevant Departments of Education. The new well-being measure will have wide applicability and can be used in assessing the effectiveness of programmes and services. This new national measure will ensure benefit and positive impact through the ability to identify and measure the aspects of well-being important to and valued by Aboriginal and Torres Strait Islander youth. Results will be published in international peer-reviewed journals and presented at conferences, and summaries will be provided to the study partner organisations and other relevant organisations.

Incidence of Discharge Against Medical Advice in Queensland Hospital Emergency Departments Among Indigenous Patients from 2016 to 2021.

BACKGROUND: The incidence of discharge against medical advice (DAMA) in emergency departments (EDs) among Indigenous people is a growing concern in Australia. This study aimed to determine the incidence of ED DAMA in public hospitals in Queensland (QLD) from 2016 to 2021 and investigate the disparities in ED DAMA between Indigenous and non-Indigenous patients. The study also assessed the impact of the COVID-19 pandemic on the incidence of ED DAMA. METHODS: A descriptive epidemiological study was conducted using aggregated data from QLD public hospital EDs. The data was retrieved from Clinical Excellence QLD, Healthcare Improvement Unit, in the QLD Health Open Data Portal for the period 1 January 2016 to 31 December 2021. Incidence rates and unadjusted odds ratios were calculated and compared using the chi-square test to identify differences between Indigenous and non-Indigenous patients. RESULTS: The annual incidence of DAMA in EDs was 7.7% among Indigenous patients, compared to 4.8% among non-Indigenous patients, with the highest rate (8.9%) reported in 2021 among Indigenous patients. The incidence of ED DAMA was higher for Indigenous patients in major cities (20.0%) than in very remote areas (7.4%). Patients in triage categories 4 (10.0%) and 3 (7.3%) accounted for the vast majority of ED DAMA events among Indigenous patients. The acute group A hospitals had the highest incidence of ED DAMA (10.9% for Indigenous patients and 6.5% for non-Indigenous patients). The COVID-19 pandemic had no impact on the incidence of ED DAMA. CONCLUSION: Indigenous patients experience a disparity in ED DAMA incidence. Addressing this issue requires collaborative efforts from healthcare providers, policymakers, and community organizations.

Indigenous Australians' Experiences of Cancer Care: A Narrative Literature Review.

To provide the latest evidence for future research and practice, this study critically reviewed Indigenous peoples' cancer care experiences in the Australian healthcare system from the patient's point of view. After searching PubMed, CINAHL and Scopus databases, twenty-three qualitative studies were included in this review. The inductive approach was used for analysing qualitative data on cancer care experience in primary, tertiary and transitional care between systems. Three main themes were found in healthcare services from Indigenous cancer care experiences: communication, cultural safety, and access to services. Communication was an important theme for all healthcare systems, including language and literacy, understanding of cancer care pathways and hospital environment, and lack of information. Cultural safety was related to trust in the system, privacy, and racism. Access to health services was the main concern in transitional care between healthcare systems. While some challenges will need long-term and collective efforts, such as institutional racism as a downstream effect of colonisation, cultural training for healthcare providers and increasing the volume of the Indigenous workforce, such as Indigenous Liaison Officers or Indigenous Care Coordinators, could effectively address this inequity issue for Indigenous people with cancer in Australia in a timely manner.

Family-centred interventions for Indigenous early childhood well-being by primary healthcare services.

BACKGROUND: Primary healthcare, particularly Indigenous-led services, are well placed to deliver services that reflect the needs of Indigenous children and their families. Important characteristics identified by families for primary health care include services that support families, accommodate sociocultural needs, recognise extended family child-rearing practices, and Indigenous ways of knowing and doing business. Indigenous family-centred care interventions have been developed and implemented within primary healthcare services to plan, implement, and support the care of children, immediate and extended family and the home environment. The delivery of family-centred interventions can be through environmental, communication, educational, counselling, and family support approaches. OBJECTIVES: To evaluate the benefits and harms of family-centred interventions delivered by primary healthcare services in Canada, Australia, New Zealand, and the USA on a range of physical, psychosocial, and behavioural outcomes of Indigenous children (aged from conception to less than five years), parents, and families. SEARCH METHODS: We used standard, extensive Cochrane search methods. The latest search date was 22 September 2021. SELECTION CRITERIA: We included randomised controlled trials (RCTs), cluster RCTs, quasi-RCTs, controlled before-after studies, and interrupted time series of family-centred care interventions that included Indigenous children aged less than five years from Canada, Australia, New Zealand, and the USA. Interventions were included if they met the assessment criteria for family-centred interventions and were delivered in primary health care. Comparison interventions could include usual maternal and child health care or one form of family-centred intervention versus another. DATA COLLECTION AND ANALYSIS: We used standard Cochrane methods. Our primary outcomes were 1. overall health and well-being, 2. psychological health and emotional behaviour of children, 3. physical health and developmental health outcomes of children, 4. family health-enhancing lifestyle or behaviour outcomes, 5. psychological health of parent/carer. 6. adverse events or harms. Our secondary outcomes were 7. parenting knowledge and awareness, 8. family evaluation of care, 9. service access and utilisation, 10. family-centredness of consultation processes, and 11. economic costs and outcomes associated with the interventions. We used GRADE to assess the certainty of the evidence for our primary outcomes. MAIN RESULTS: We included nine RCTs and two cluster-RCTs that investigated the effect of family-centred care interventions delivered by primary healthcare services for Indigenous early child well-being. There were 1270 mother-child dyads and 1924 children aged less than five years recruited. Seven studies were from the USA, two from New Zealand, one from Canada, and one delivered in both Australia and New Zealand. The focus of interventions varied and included three studies focused on early childhood caries; three on childhood obesity; two on child behavioural problems; and one each on negative parenting patterns, child acute respiratory illness, and sudden unexpected death in infancy. Family-centred education was the most common type of intervention delivered. Three studies compared family-centred care to usual care and seven studies provided some 'minimal' intervention to families such as education in the form of pamphlets or newsletters. One study provided a minimal intervention during the child's first 24 months and then the family-centred care intervention for one year. No studies had low or unclear risk of bias across all domains. All studies had a high risk of bias for the blinding of participants and personnel domain. Family-centred care may improve overall health and well-being of Indigenous children and their families, but the evidence was very uncertain. The pooled effect estimate from 11 studies suggests that family-centred care improved the overall health and well-being of Indigenous children and their families compared no family-centred care (standardised mean difference (SMD) 0.14, 95% confidence interval (CI) 0.03 to 0.24; 2386 participants). We are very uncertain whether family-centred care compared to no family-centred care improves the psychological health and emotional behaviour of children as measured by the Infant Toddler Social Emotional Assessment (ITSEA) (Competence domain) (mean difference (MD) 0.04, 95% CI -0.03 to 0.11; 2 studies, 384 participants). We assessed the evidence as being very uncertain about the effect of family-centred care on physical health and developmental health outcomes of children. Pooled data from eight trials on physical health and developmental outcomes found there was little to no difference between the intervention and the control groups (SMD 0.13, 95% CI -0.00 to 0.26; 1961 participants). The evidence is also very unclear whether family-centred care improved family-enhancing lifestyle and behaviours outcomes. Nine studies measured family health-enhancing lifestyle and behaviours and pooled analysis found there was little to no difference between groups (SMD 0.16, 95% CI -0.06 to 0.39; 1969 participants; very low-certainty evidence). There was very low-certainty evidence of little to no difference for the psychological health of parents and carers when they participated in family-centred care compared to any control group (SMD 0.10, 95% CI -0.03 to 0.22; 5 studies, 975 parents/carers). Two studies stated that there were no adverse events as a result of the intervention. No additional data were provided. No studies reported from the health service providers perspective or on outcomes for family's evaluation of care or family-centredness of consultation processes. AUTHORS' CONCLUSIONS: There is some evidence to suggest that family-centred care delivered by primary healthcare services improves the overall health and well-being of Indigenous children, parents, and families. However, due to lack of data, there was not enough evidence to determine whether specific outcomes such as child health and development improved as a result of family-centred interventions. Seven of the 11 studies delivered family-centred education interventions. Seven studies were from the USA and centred on two particular trials, the 'Healthy Children, Strong Families' and 'Family Spirit' trials. As the evidence is very low certainty for all outcomes, further high-quality trials are needed to provide robust evidence for the use of family-centred care interventions for Indigenous children aged less than five years.

Network evaluation of an innovation platform in continuous quality improvement in Australian Indigenous primary healthcare.

BACKGROUND: From 2014 to 2019, the Centre for Research Excellence in Integrated Quality Improvement (CRE-IQI) was evaluated as an innovation platform focusing on continuous quality improvement in Indigenous Australian primary healthcare. Although social network analysis (SNA) is a recognized method for evaluating the functioning, collaboration and effectiveness of innovation platforms, applied research is limited. This study applies SNA to evaluate the CRE-IQI's functioning as an innovation platform. METHODS: Two surveys (2017, 2019) were conducted using social survey and network methods. Survey items covered respondent characteristics, their perceptions of the CRE-IQI's performance, and its impact and sociometric relationships. Members' relationship information was captured for the CRE-IQI at three time points, namely start (retrospectively), midpoint and final year, on three network types (knew, shared information, collaborated). SNA software was used to compute standard network metrics including diameter, density and centrality, and to develop visualizations. Survey and network results were addressed in a workshop held by members to develop improvement strategies. RESULTS: The response rate was 80% in 2017 and 65% in 2019 (n = 49 and 47, respectively). Between 2017 and 2019, respondents' mean ratings of the CRE-IQI's functioning and achievements in meeting its goals were sustained. They perceived the CRE-IQI as multidisciplinary, having effective management and governance, and incorporating Indigenous research leadership, representation and ways of working. Respondents recognized high levels of trust amongst members, rated "good communication and coordination with participants" highly, and "facilitating collaboration" as the CRE's most strongly recognized achievement. In collaboration and information-sharing networks, average path length remained low in 2017 and 2019, indicating good small-world network properties for relaying information. On average, respondents shared information and collaborated with more CRE members in 2017 than 2019. However, in both 2017 and 2019 there were new collaborations and information-sharing outside of direct collaborations. CRE-IQI outcomes included: evidence generation; knowledge transfer and skills development in quality improvement; research capacity-building, career development; mentoring; grant support; development of new projects; health service support; and policy impact. CONCLUSIONS: This study shows the utility of network analysis in evaluating the functioning, and collaboration, at the individual, organizational and health system levels, of an innovation platform, and adds to our understanding of factors enabling successful innovation platforms.

Scope and quality of economic evaluations of Aboriginal and Torres Strait Islander health programs: a systematic review.

OBJECTIVES: Identify the number, type, scope and quality of economic evaluations of Aboriginal and Torres Strait Islander health programs. METHODS: A systematic review of peer-reviewed and grey literature was conducted for articles published from 2010 to 2020 that reported a full economic evaluation of Aboriginal and Torres Strait Islander health programs. Data extraction included: type of economic evaluation, comparators, data sources and concerns, and outcome measures. Methodological quality was assessed using the Drummond checklist. RESULTS: Thirteen publications met inclusion criteria: two cost-consequence analyses, two cost-effectiveness analyses, five cost-utility analyses, and four cost-benefit/return on investment analyses. Most studies (n=10) adopted a health system perspective and used a range of key data sources for economic analyses. Ten studies identified data access limitations that restricted analyses and two studies identified data quality concerns. Twelve studies were of good methodological quality and one was of average quality. CONCLUSIONS: Despite significant investment in strategies to close the gap in health outcomes for Aboriginal and Torres Strait Islander people, there is limited evidence about what constitutes a cost-effective investment in Aboriginal and Torres Strait Islander healthcare. IMPLICATIONS FOR PUBLIC HEALTH: More economic evaluation is required to justify the significant investment in health programs for Aboriginal and Torres Strait Islander people.

VOICE-Validating Outcomes by Including Consumer Experience: A Study Protocol to Develop a Patient Reported Experience Measure for Aboriginal and Torres Strait Islander Peoples Accessing Primary Health Care.

Aboriginal and Torres Strait Islander peoples' (hereafter respectfully referred to as Indigenous Australians) experiences of health care are shaped by historical, social and cultural factors, with cultural security critical to effective care provision and engagement between services and community. Positive patient experiences are associated with better health outcomes. Consequently, it is an accreditation requirement that primary health care (PHC) services must formally gather and respond to patient feedback. However, currently available patient feedback tools were not developed with Indigenous Australians, and do not reflect their values and world views. Existing tools do not capture important experiences of care of Indigenous Australians in PHC settings, nor return information that assists services to improve care. Consistent with the principles of Indigenous Data Sovereignty, we will co-design and validate an Indigenous-specific Patient Reported Experience Measure (PREM) that produces data by and for community, suitable for use in quality improvement in comprehensive PHC services. This paper presents the protocol of the study, outlining the rationale, methodologies and associated activities that are being applied in developing the PREM. Briefly, guided by an Aboriginal and Torres Strait Islander Advisory Group, our team of Indigenous and non-Indigenous researchers, service providers and policy makers will use a combination of Indigenous methodologies, participatory, and traditional western techniques for scale development. We will engage PHC service staff and communities in eight selected sites across remote, regional, and metropolitan communities in Australia for iterative cycles of data collection and feedback throughout the research process. Yarning Circles with community members will identify core concepts to develop an "Experience of Care Framework", which will be used to develop items for the PREM. Staff members will be interviewed regarding desirable characteristics and feasibility considerations for the PREM. The PREM will undergo cognitive and psychometric testing.

Utility of the AHRQ Learning Collaboratives Taxonomy for Analyzing Innovations from an Australian Collaborative.

BACKGROUND: Despite the proliferation of learning collaborations such as innovation platforms, the factors contributing to their success or failure are rarely documented. The Agency for Healthcare Research and Quality learning collaboratives taxonomy provides a framework for understanding how such collaborations work in different settings according to four primary elements: innovation, communication, time, and social systems. This study applied the taxonomy to assess an innovation platform and the utility of applying the taxonomy. METHODS: The study focus was a five-year national research collaboration operating as an innovation platform to strengthen primary health care quality improvement efforts for Indigenous Australians. The study team analyzed project records, reports and publications, and interviews that were conducted with 35 stakeholders. Data were mapped retrospectively against the taxonomy domains and thematically analyzed. RESULTS: The taxonomy proved useful in understanding how and why the innovation platform generated innovations. It revealed that time was particularly important, both to see innovations through and to establish a social system that enabled interconnectivity between members. However, the taxonomy did not provide useful guidance on identifying the types of innovations from the collaboration or the importance of a culture of continuous adaptation and learning. The study also found that the primary and secondary elements of the taxonomy were not discrete, which meant that it was difficult to align themes with only one element. CONCLUSION: To improve the utility of the taxonomy, several elaborations are proposed, including reconfiguring it to a more dynamic form that recognizes the interconnections and links between the elements.

Collaboration and knowledge generation in an 18-year quality improvement research programme in Australian Indigenous primary healthcare: a coauthorship network analysis.

OBJECTIVES: Though multidisciplinary research networks support the practice and effectiveness of continuous quality improvement (CQI) programmes, their characteristics and development are poorly understood. In this study, we examine publication outputs from a research network in Australian Indigenous primary healthcare (PHC) to assess to what extent the research network changed over time. SETTING: Australian CQI research network in Indigenous PHC from 2002 to 2019. PARTICIPANTS: Authors from peer-reviewed journal articles and books published by the network. DESIGN: Coauthor networks across four phases of the network (2002-2004; 2005-2009; 2010-2014; 2015-2019) were constructed based on author affiliations and examined using social network analysis methods. Descriptive characteristics included organisation types, Indigenous representation, gender, student authorship and thematic research trends. RESULTS: We identified 128 publications written by 308 individual authors from 79 different organisations. Publications increased in number and diversity over each funding phase. During the final phase, publication outputs accelerated for organisations, students, project officers, Indigenous and female authors. Over time there was also a shift in research themes to encompass new clinical areas and social, environmental or behavioural determinants of health. Average degree (8.1), clustering (0.81) and diameter (3) indicated a well-connected network, with a core-periphery structure in each phase (p≤0.03) rather than a single central organisation (degree centralisation=0.55-0.65). Academic organisations dominated the core structure in all funding phases. CONCLUSION: Collaboration in publications increased with network consolidation and expansion. Increased productivity was associated with increased authorship diversity and a decentralised network, suggesting these may be important factors in enhancing research impact and advancing the knowledge and practice of CQI in PHC. Publication diversity and growth occurred mainly in the fourth phase, suggesting long-term relationship building among diverse partners is required to facilitate participatory research in CQI. Despite improvements, further work is needed to address inequities in female authorship and Indigenous authorship.

What was the impact of a participatory research project in Australian Indigenous primary healthcare services? Applying a comprehensive framework for assessing translational health research to Lessons for the Best.

OBJECTIVES: To (1) apply the Framework to Assess the Impact from Translational health research (FAIT) to Lessons from the Best to Better the Rest (LFTB), (2) report on impacts from LFTB and (3) assess the feasibility and outcomes from a retrospective application of FAIT. SETTING: Three Indigenous primary healthcare (PHC) centres in the Northern Territory, Australia; project coordinating centre distributed between Townsville, Darwin and Cairns and the broader LFTB learning community across Australia. PARTICIPANTS: LFTB research team and one representative from each PHC centre. PRIMARY AND SECONDARY OUTCOME MEASURES: Impact reported as (1) quantitative metrics within domains of benefit using a modified Payback Framework, (2) a cost-consequence analysis given a return on investment was not appropriate and (3) a narrative incorporating qualitative evidence of impact. Data were gathered through in-depth stakeholder interviews and a review of project documentation, outputs and relevant websites. RESULTS: LFTB contributed to knowledge advancement in Indigenous PHC service delivery; enhanced existing capacity of health centre staff, researchers and health service users; enhanced supportive networks for quality improvement; and used a strengths-based approach highly valued by health centres. LFTB also leveraged between $A1.4 and $A1.6 million for the subsequent Leveraging Effective Ambulatory Practice (LEAP) Project to apply LFTB learnings to resource development and creation of a learning community to empower striving PHC centres. CONCLUSION: Retrospective application of FAIT to LFTB, although not ideal, was feasible. Prospective application would have allowed Indigenous community perspectives to be included. Greater appreciation of the full benefit of LFTB including a measure of return on investment will be possible when LEAP is complete. Future assessments of impact need to account for the limitations of fully capturing impact when intermediate/final impacts have not yet been realised and captured.

Principles guiding ethical research in a collaboration to strengthen Indigenous primary healthcare in Australia: learning from experience.

INTRODUCTION: Indigenous communities worldwide are leading calls for all research involving Indigenous people to be underpinned by values and principles articulated by them. Many researchers are explicitly adopting these principles to guide what, where, how and when research is undertaken with Indigenous people. With critical reflection to support the implementation of such principles largely absent from published literature, this paper explores both the implementation of, and the outcomes from a set of guiding principles used in a large-scale Australian research collaboration to improve Indigenous health. METHODS: In this inductive qualitative study, we adopted a principles-focused evaluation approach. Based on interviews with 35 actors in the collaboration and a review of project documents, we generated themes that were then iteratively discussed, refined and categorised into (1) 'strategies'-activities by which implementation of our guiding principles were recognised; (2) 'outcomes'-results seen from implementing the principles and (3) 'conditions'-aspects of the context that facilitated and constrained implementation of the principles. RESULTS: Respondents found it difficult to articulate how the guiding principles were actually implemented, and frequently referred to them as part of the fabric of the collaboration. They viewed the set of principles as mutually reinforcing, and as providing a rudder for navigating complexity and conflict. Implementation of the principles occurred through five strategies-honouring the principles; being dynamic and adaptable; sharing and dispersing leadership; collaborating purposefully and adopting a culture of mutual learning. Outcomes included increased Indigenous leadership and participation; the ability to attract principled and values-driven researchers and stakeholders, and the development of trusting and respectful relationships. The conditions that facilitated the implementation of the principles were collaborating over time; an increasing number of Indigenous researchers and taking an 'innovation platform' approach. CONCLUSION: Our findings show that principles guiding collaborations are valuable in providing a focus, direction and a way of working together when they are collaboratively developed, hold genuine meaning for all members and are implemented within a culture of continuous critical reflection, learning and adaptation, with ongoing reinterpretation of the principles over time.

Systems integration to promote the mental health of Aboriginal and Torres Strait Islander children: protocol for a community-driven continuous quality improvement approach.

BACKGROUND: Systems integration to promote the mental health of Aboriginal and Torres Strait Islander children works towards developing a spectrum of effective, community-based services and supports. These services and supports are organised into a coordinated network, build meaningful partnerships with families and address their cultural and linguistic needs, to help children to function better at home, in school, in the community, and throughout life. This study is conducted in partnership with primary healthcare (PHC) and other services in three diverse Indigenous Australian communities. It entails conceptualising, co-designing, implementing, and evaluating the effectiveness of systems integration to promote the mental health and wellbeing of Indigenous school-aged children (4-17 years). This paper outlines a protocol for implementing such complex community-driven research. METHODS/DESIGN: Using continuous quality improvement processes, community co-designed strategies for improved systems integration will be informed by narratives from yarning circles with Indigenous children and service providers, and quantitative data from surveys of service providers and audits of PHC client records and intersectoral systems. Agreed strategies to improve the integration of community-based services and supports will be modelled using microsimulation software, with a preferred model implemented in each community. The evaluation will investigate changes in the: 1) availability of services that are community-driven, youth-informed and culturally competent; 2) extent of collaborative service networks; 3) identification by PHC services of children's social and emotional wellbeing concerns; and 4) ratio of children receiving services to identified need. Costs and benefits of improvements to systems integration will also be calculated. DISCUSSION: The study will provide evidence-informed, community-driven, and tested models that can be used for implementing systems integration to promote the mental health and wellbeing of Indigenous children. It will identify the situational enablers and barriers that impact systems integration and determine the extent to which systems integration improves service availability, systems and child outcomes. Evidence for the cost effectiveness of systems-level integration will contribute to national mental health policy reform.

Using developmental evaluation to enhance continuous reflection, learning and adaptation of an innovation platform in Australian Indigenous primary healthcare.

Effective efforts to strengthen health systems need diverse, multi-stakeholder networks working together on complex or 'wicked' problems such as prevention and control of chronic diseases, solutions to which go beyond the role and capability of one organisation. The contextual complexities inherent in 'wicked' problems mean that solutions warrant a systems approach that encompasses innovation and new ways of thinking about, facilitating and implementing collective decision-making processes and change practices.Innovation platforms are a mechanism for facilitating communication and collaboration among diverse stakeholders, promoting joint action and stimulating innovation. Developmental evaluation is an approach that is increasingly being used to evaluate innovative and emergent programmes and projects, as it enables evaluators to provide real-time feedback so that evaluation findings can be used to guide development and adaptations. Developmental evaluation emphasises learning and adaptation, and aligns well with the implementation of innovation platforms that have continuous reflection, learning and adaptation as a specific design principle.Here, we outline our rationale for applying a developmental evaluation to enhance the formation, functioning and outcomes of an innovation platform aimed at accelerating and strengthening large-scale quality improvement efforts in Australian Aboriginal and Torres Strait Islander primary healthcare. We provide examples to explain how the developmental evaluation findings were used for adaptation of the innovation platform and assess to what extent our application of developmental evaluation was consistent with, and reflective of, its essential principles.Our evaluation aligned strongly with the principles of developmental evaluation, and the approach we took was well suited to situations with a developmental purpose, innovation niche and complexity such as innovation platforms. As a result, along with the increasing interest in multi-stakeholder platforms (e.g. innovation platforms) and the inherent challenges with evaluating these complex networks, we anticipate our use of this approach being of interest globally.