A user-centred evaluation framework for the Sealife semantic web browsers.

BACKGROUND: Semantically-enriched browsing has enhanced the browsing experience by providing contextualized dynamically generated Web content, and quicker access to searched-for information. However, adoption of Semantic Web technologies is limited and user perception from the non-IT domain sceptical. Furthermore, little attention has been given to evaluating semantic browsers with real users to demonstrate the enhancements and obtain valuable feedback. The Sealife project investigates semantic browsing and its application to the life science domain. Sealife's main objective is to develop the notion of context-based information integration by extending three existing Semantic Web browsers (SWBs) to link the existing Web to the eScience infrastructure. METHODS: This paper describes a user-centred evaluation framework that was developed to evaluate the Sealife SWBs that elicited feedback on users' perceptions on ease of use and information findability. Three sources of data: i) web server logs; ii) user questionnaires; and iii) semi-structured interviews were analysed and comparisons made between each browser and a control system. RESULTS: It was found that the evaluation framework used successfully elicited users' perceptions of the three distinct SWBs. The results indicate that the browser with the most mature and polished interface was rated higher for usability, and semantic links were used by the users of all three browsers. CONCLUSION: Confirmation or contradiction of our original hypotheses with relation to SWBs is detailed along with observations of implementation issues.

User information seeking behaviour: perceptions and reality. An evaluation of the WHO Labresources Internet portal.

Evaluation on Internet portals is a key component of any online resource development. Understanding user information seeking behaviour and user perceived behaviour is essential to obtain the full picture of user needs, online activities and draw lessons to improve the design of Internet portals to better meet user expectations. This article discusses the evaluation of a WHO Internet portal: the Labresources website. The evaluation investigates user satisfaction with the resource, usability, demographic information about users and how well they could complete specific tasks using the website and compared this with the actual online behaviour revealing a number of discrepancies. An online questionnaire was advertised on the Labresources website during the period 25 November 2005 to 20 February 2006. As the site caters to English and French speakers, the questionnaire was made available in both languages. It consisted of two sections - the first section required the participant to complete three tasks using the website whereas the second section tested user satisfaction, information needs and appropriateness of the content. Weblogs data were compared with the questionnaire results to compare user perceived and actual online behaviour. Twenty one respondents completed the online questionnaire from a total of 18 countries. This was out of a potential 60 website users among whom the questionnaire was promoted. In general, respondents were satisfied with the website layout and navigation. 61.9% of respondents listed WHO among their top 5 and a third listed the Labresources website. The number of sessions where users browse (146) the information resources is almost three times more than the number of users who search (52) the resources. Weblogs revealed most interesting results with differences between what users reported doing when completing tasks and how easy they perceived the tasks and what they actually did. Twelve respondents completed at least one task. Of the remaining nine respondents, three did visit the Labresources website from the link in the questionnaire but did not go on to complete the tasks. Only one of the twelve who completed a task reported it being difficult. Three of the respondents who didn't complete a task reported the tasks to be difficult but only one of these actually followed the link to begin the tasks in the questionnaire. This article described an evaluation study investigating user perceived and actual behaviour at the WHO Labresources Internet portal. Although the questionnaire results demonstrated general satisfaction with the resource, a combination of a weblog evaluation with the questionnaire revealed a clearer picture of the user perception of and satisfaction with the website compared to their actual activity when completing the set tasks.

The epidemiology of Guillain-Barré syndrome worldwide. A systematic literature review.

BACKGROUND: This systematic literature review of the epidemiology of Guillain-Barré syndrome (GBS) identifies trends in incidence rates by age, study method and cause of disease. It is important to have a reliable estimate of incidence to determine and investigate any changes: no previous systematic reviews of GBS have been found. METHODS: After critical assessment of the reliability of the reported data, incidence rates were extracted from all relevant papers published between 1980 and 2008, identified through searches of Medline, Embase and Science Direct. RESULTS: Sixty-three papers were included in this review; these studies were prospective, retrospective reviews of medical records or retrospective database studies. Ten studies reported on the incidence in children (0-15 years old), and found the annual incidence to be between 0.34 and 1.34/100,000. Most studies investigated populations in Europe and North America and reported similar annual incidence rates, i.e. between 0.84 and 1.91/100,000. A decrease in incidence over the time between the 1980s and 1990s was found. Up to 70% of cases of GBS were caused by antecedent infections. CONCLUSIONS: Our best estimate of the overall incidence of GBS was between 1.1/100,000/year and 1.8/100,000/year. The incidence of GBS increased with age after 50 years from 1.7/100,000/year to 3.3/100,000/year.

Lessons learned from evaluation of the use of the National electronic Library of Infection.

The National electronic Library of Infection (NeLI: http://www.neli.org.uk) in the UK is a freely available portal to key evidence and guidelines in the infectious disease field. This paper discusses 5 years of evaluation of the pilot library and how this evaluation informed design of the new library website. The importance of combining qualitative and quantitative evaluation is highlighted and the results of web access logs analysis, free text search query analysis and an online user survey are compared. The paper concludes with a discussion of lessons learned for future development and evaluation of this Internet digital library.

Changing public attitudes to antibiotic prescribing: can the internet help?

INTRODUCTION: Antimicrobial resistance is a global problem with serious implications for modern medicine. Education of the public is essential for reducing patient pressure on GPs and subsequent inappropriate prescribing. Evaluation of educational interventions is necessary to assess their impact on public knowledge and attitudes. The aim of this study was to evaluate the effect of a health information website, part of the National electronic Library of Infection, on user knowledge and attitudes. METHOD: Questionnaires testing user knowledge and attitudes before and after using the website. RESULTS: There were significant improvements in knowledge about the use of antibiotics and antibiotic resistance. Expectations that antibiotics should be prescribed were significantly reduced after using the website. Health professionals showed a significantly greater knowledge about antibiotics and were less likely to expect antibiotics to be prescribed for acute otitis media than non-health professionals before using the website. There was no significant difference between the knowledge of these groups after using the website, but non-health professionals continued to have higher expectations of antibiotics being prescribed than health professionals. CONCLUSIONS: Health information websites can play a significant role in influencing public knowledge and attitudes. Further research is needed to investigate how people learn from these interventions and to determine their long-term impact on public attitudes and subsequent behaviour.