Remote analysis of sputum smears for mycobacterium tuberculosis quantification using digital crowdsourcing.

Worldwide, TB is one of the top 10 causes of death and the leading cause from a single infectious agent. Although the development and roll out of Xpert MTB/RIF has recently become a major breakthrough in the field of TB diagnosis, smear microscopy remains the most widely used method for TB diagnosis, especially in low- and middle-income countries. This research tests the feasibility of a crowdsourced approach to tuberculosis image analysis. In particular, we investigated whether anonymous volunteers with no prior experience would be able to count acid-fast bacilli in digitized images of sputum smears by playing an online game. Following this approach 1790 people identified the acid-fast bacilli present in 60 digitized images, the best overall performance was obtained with a specific number of combined analysis from different players and the performance was evaluated with the F1 score, sensitivity and positive predictive value, reaching values of 0.933, 0.968 and 0.91, respectively.

Collaborative intelligence and gamification for on-line malaria species differentiation.

BACKGROUND: Current World Health Organization recommendations for the management of malaria include the need for a parasitological confirmation prior to triggering appropriate treatment. The use of rapid diagnostic tests (RDTs) for malaria has contributed to a better infection recognition and a more targeted treatment. Nevertheless, low-density infections and parasites that fail to produce HRP2 can cause false-negative RDT results. Microscopy has traditionally been the methodology most commonly used to quantify malaria and characterize the infecting species, but the wider use of this technique remains challenging, as it requires trained personnel and processing capacity. OBJECTIVE: In this study, the feasibility of an on-line system for remote malaria species identification and differentiation has been investigated by crowdsourcing the analysis of digitalized infected thin blood smears by non-expert observers using a mobile app. METHODS: An on-line videogame in which players learned how to differentiate the young trophozoite stage of the five Plasmodium species has been designed. Images were digitalized with a smartphone camera adapted to the ocular of a conventional light microscope. Images from infected red blood cells were cropped and puzzled into an on-line game. During the game, players had to decide the malaria species (Plasmodium falciparum, Plasmodium malariae, Plasmodium vivax, Plasmodium ovale, Plasmodium knowlesi) of the infected cells that were shown in the screen. After 2 months, each player's decisions were analysed individually and collectively. RESULTS: On-line volunteers playing the game made more than 500,000 assessments for species differentiation. Statistically, when the choice of several players was combined (n > 25), they were able to significantly discriminate Plasmodium species, reaching a level of accuracy of 99% for all species combinations, except for P. knowlesi (80%). Non-expert decisions on which Plasmodium species was shown in the screen were made in less than 3 s. CONCLUSION: These findings show that it is possible to train malaria-naïve non-experts to identify and differentiate malaria species in digitalized thin blood samples. Although the accuracy of a single player is not perfect, the combination of the responses of multiple casual gamers can achieve an accuracy that is within the range of the diagnostic accuracy made by a trained microscopist.

Plasmodium species differentiation by non-expert on-line volunteers for remote malaria field diagnosis.

BACKGROUND: Routine field diagnosis of malaria is a considerable challenge in rural and low resources endemic areas mainly due to lack of personnel, training and sample processing capacity. In addition, differential diagnosis of Plasmodium species has a high level of misdiagnosis. Real time remote microscopical diagnosis through on-line crowdsourcing platforms could be converted into an agile network to support diagnosis-based treatment and malaria control in low resources areas. This study explores whether accurate Plasmodium species identification-a critical step during the diagnosis protocol in order to choose the appropriate medication-is possible through the information provided by non-trained on-line volunteers. METHODS: 88 volunteers have performed a series of questionnaires over 110 images to differentiate species (Plasmodium falciparum, Plasmodium ovale, Plasmodium vivax, Plasmodium malariae, Plasmodium knowlesi) and parasite staging from thin blood smear images digitalized with a smartphone camera adapted to the ocular of a conventional light microscope. Visual cues evaluated in the surveys include texture and colour, parasite shape and red blood size. RESULTS: On-line volunteers are able to discriminate Plasmodium species (P. falciparum, P. malariae, P. vivax, P. ovale, P. knowlesi) and stages in thin-blood smears according to visual cues observed on digitalized images of parasitized red blood cells. Friendly textual descriptions of the visual cues and specialized malaria terminology is key for volunteers learning and efficiency. CONCLUSIONS: On-line volunteers with short-training are able to differentiate malaria parasite species and parasite stages from digitalized thin smears based on simple visual cues (shape, size, texture and colour). While the accuracy of a single on-line expert is far from perfect, a single parasite classification obtained by combining the opinions of multiple on-line volunteers over the same smear, could improve accuracy and reliability of Plasmodium species identification in remote malaria diagnosis.