Improving understanding of disease control implementation research through a mooc with participants from low- and middle-income countries: Evaluating participant reactions and learning.

The Special Programme for Research and Training in Tropical Diseases developed a massive open online course (MOOC) on implementation research with a focus on infectious diseases of poverty (IDPs) to reinforce the explanation of implementation research concepts through real case studies. The target MOOC participant group included public health officers, researchers and students. By reshaping institutions and building resilience in communities and systems, implementation research will allow progress towards universal health coverage and sustainable development goals. This study evaluates learners' knowledge in implementation research after completing the MOOC using anonymous exit survey responses. Of the almost 4000 enrolled in the two sessions of the MOOC in 2018, about 30% completed all five modules and the assessments, and were awarded certificates. The majority of the participants were early to mid-career professionals, under the age of 40, and from low- and middle-income countries. They were slightly more likely to be men (56%) with a Bachelor or a Master's degree. Participants were public health researchers (45%), public health officers (11%) or students (11%). On completion of the course, an exit survey revealed that 80.9% of respondents indicated significant improvement to strong and very strong implementation research knowledge. This evaluation clearly shows the usefulness of the MOOC on implementation research for reaching out to field researchers and public health practitioners who are facing problems in the implementation of control programmes in low- and middle-income countries.

Evaluating results of the implementation research MOOC using Kirkpatrick's four-level model: a cross-sectional mixed-methods study.

INTRODUCTION: An implementation research (IR) massive open online course (MOOC) was developed by the Special Programme for Research and Training in Tropical Diseases, to address the scarcity of training in low-income and middle-income countries in the field of IR. The Kirkpatrick model was used to evaluate the IR MOOC as it is widely applied for evaluation of training and educational programmes. The Kirkpatrick model evaluates training programmes on four levels: reaction, learning, behaviour and results. This paper addresses the impact of the IR MOOC on participants' professional practice. METHODS: Findings are based on analysis of survey and interview data collected 1.5-2 years after the conclusion of the two 2018 IR MOOC offerings. Of the 3858 MOC participants, 748 responded to the anonymous online survey and seven of these respondents were interviewed. All data are self-reported. RESULTS: The IR MOOC was successful in enhancing the professional practice of participants and for their organisations. Over 40% reported modifying or implementing changes in their professional work. Respondents reported that participation in the MOOC had improved their ability to conduct IR, enhanced their professional profiles and increased their opportunities for collaboration, research and job promotion. Respondents stated that the MOOC had improved their work quality and productivity, and allowed them to contribute to research, initiate and develop professional collaborations and train others in IR. Respondents reported an increase in applying for grants and scholarships and presenting and publishing work on IR after participating in the MOOC. Barriers applying the knowledge gained from the IR MOOC were experienced, for example, due to a lack of funding and lack of support from colleagues, managers and organisations. CONCLUSION: Participants perceived that the IR MOOC was successful in its aims of delivering medium-term and long-term results in relation to their own and their organisations' professional outcomes.

Implementation research training for learners in low- and middle-income countries: evaluating behaviour change after participating in a massive open online course.

BACKGROUND: Implementation research (IR) can play a critical role in the delivery of disease control interventions, particularly in low- and middle-income countries (LMICs). The growing demand for IR training has led to the development of a range of training programmes and university courses, the majority of which can not be accessed by learners in LMICs. This article reports on the evaluation of the massive open online course (MOOC) developed by the Special Programme for Research and Training in Tropical Diseases hosted by WHO on the topic of IR with a focus on infectious diseases of poverty. This study followed the Kirkpatrick Model to evaluate training programmes with a specific focus on post-training changes in behaviour. METHODS: MOOC participants were invited to take part in an anonymous online survey examining their knowledge of IR and how they applied it in their professional practice approximately 1-1.5 years after completing their course. The survey contained 43 open-ended, multiple choice and Likert-type questions. Descriptive statistics were calculated for the quantitative data and responses to the open-ended questions were thematically coded. RESULTS: A total of 748 MOOC participants responded to the survey. The demographic profile of the survey respondents aligned with that of the MOOC participants, with nearly 70% of respondents originating from Africa. Responses to the quantitative and open-ended survey questions revealed that respondents' knowledge of IR had improved to a large extent as a result of the MOOC, and that they used the knowledge and skills gained in their professional lives frequently and had consequently changed their professional behaviour. Respondents most often cited the problem-solving aspect of IR as a substantial area of behavioral change influenced by participating in the MOOC. CONCLUSIONS: These findings indicate that the MOOC was successful in targeting learners from LMICs, in strengthening their IR knowledge and contributing to their ability to apply it in their professional practice. The utility of MOOCs for providing IR training to learners in LMICs, where implementation challenges are encountered often, makes this platform an ideal standalone learning tool or one that could be combined with other training formats.

Tracking the career development of scientists in low- and middle-income countries trained through TDR's research capacity strengthening programmes: Learning from monitoring and impact evaluation.

The Special Programme for Research and Training in Tropical Diseases (TDR) co-sponsored by UNICEF, UNDP, World Bank and WHO has been supporting research capacity strengthening in low- and middle-income countries for over 40 years. In order to assess and continuously optimize its capacity strengthening approaches, an evaluation of the influence of TDR training grants on research career development was undertaken. The assessment was part of a larger evaluation conducted by the European Science Foundation. A comprehensive survey questionnaire was developed and sent to a group of 117 trainees supported by TDR who had completed their degree (masters or PhD) between 2000 and 2012; of these, seventy seven (77) responded. Most of the respondents (80%) rated TDR support as a very important factor that influenced their professional career achievements. The "brain drain" phenomenon towards high-income countries was particularly low amongst TDR grantees: the rate of return to their region of origin upon completion of their degree was 96%. A vast majority of respondents are still working in research (89%), with 81% of respondents having participated in multidisciplinary research activities; women engaged in multidisciplinary collaboration to a higher extent than men. However, only a minority of all have engaged in intersectoral collaboration, an aspect that would require further study. The post-degree career choices made by the respondents were strongly influenced by academic considerations. At the time of the survey, 92% of all respondents hold full-time positions, mainly in the public sector. Almost 25% of the respondents reported that they had influenced policy and practice changes. Some of the challenges and opportunities faced by trainees at various stages of their research career have been identified. Modalities to overcome these will require further investigation. The survey evidenced how TDR's research capacity grant programmes made a difference on researchers' career development and on south-south collaborations, by strengthening and localizing research capacity in lower income regions, and also showed there is more that needs to be done. The factors involved, challenges and lessons learnt may help donors and policy makers improve their future interventions with regard to designing capacity strengthening programmes and setting funding priorities.

Scope and geographical distribution of African medical journals active in 2005.

OBJECTIVES: To identify all African medical journals actively publishing in 2005, and to create a geodatabase of these to evaluate and monitor future journal activity. DESIGN: A search was done for relevant African medical journals on electronic databases, library catalogues and internet sites, and a list was compiled of active journals. A survey was conducted via questionnaire of editors of all listed African medical journals defined as having an editorial base on the continent. RESULTS: One hundred and fifty-eight African medical journals were identified, published in 33 countries. One hundred and fifty-three editors were surveyed via email, post and/or fax. There was a 39% response rate from editors based in 17 countries. Fifty-one journals were published in English, 7 in French and 1 in Portuguese. Most journals were owned by an association or a society and were funded from a combination of sources. Journals covered general medical and specialist medical interest equally. Most (41 of 59 journals) had a circulation below 1 000, and most (52/59) published 4 or fewer issues a year. Almost all the journals included original research, and articles were peer reviewed. Few were indexed on Medline (N = 18) and EMBASE (N = 10). Plotting journal location using Geographic Information Systems (GIS) software provided a snapshot view of current journal activity. CONCLUSIONS: This study is likely to represent the most comprehensive list of current African medical journals. It confirms growth in African health care research and journal activity on the continent. Limited inclusion in international databases and accessibility to African researchers remain challenges in achieving publication of high-quality African research in high-quality African journals.