Effects of Porting Essie Tokenization and Normalization to Solr.

Search for information is now an integral part of healthcare. Searches are enabled by search engines whose objective is to efficiently retrieve the relevant information for the user query. When it comes to retrieving biomedical text and literature, Essie search engine developed at the National Library of Medicine (NLM) performs exceptionally well. However, Essie is a software system developed for NLM that has ceased development and support. On the other hand, Solr is a popular opensource enterprise search engine used by many of the world's largest internet sites, offering continuous developments and improvements along with the state-of-the-art features. In this paper, we present our approach to porting the key features of Essie and developing custom components to be used in Solr. We demonstrate the effectiveness of the added components on three benchmark biomedical datasets. The custom components may aid the community in improving search methods for biomedical text retrieval.

The ClinicalTrials.gov results database--update and key issues.

BACKGROUND: The ClinicalTrials.gov trial registry was expanded in 2008 to include a database for reporting summary results. We summarize the structure and contents of the results database, provide an update of relevant policies, and show how the data can be used to gain insight into the state of clinical research. METHODS: We analyzed ClinicalTrials.gov data that were publicly available between September 2009 and September 2010. RESULTS: As of September 27, 2010, ClinicalTrials.gov received approximately 330 new and 2000 revised registrations each week, along with 30 new and 80 revised results submissions. We characterized the 79,413 registry and 2178 results of trial records available as of September 2010. From a sample cohort of results records, 78 of 150 (52%) had associated publications within 2 years after posting. Of results records available publicly, 20% reported more than two primary outcome measures and 5% reported more than five. Of a sample of 100 registry record outcome measures, 61% lacked specificity in describing the metric used in the planned analysis. In a sample of 700 results records, the mean number of different analysis populations per study group was 2.5 (median, 1; range, 1 to 25). Of these trials, 24% reported results for 90% or less of their participants. CONCLUSIONS: ClinicalTrials.gov provides access to study results not otherwise available to the public. Although the database allows examination of various aspects of ongoing and completed clinical trials, its ultimate usefulness depends on the research community to submit accurate, informative data.

Knowledge-based methods to help clinicians find answers in MEDLINE.

OBJECTIVES: Large databases of published medical research can support clinical decision making by providing physicians with the best available evidence. The time required to obtain optimal results from these databases using traditional systems often makes accessing the databases impractical for clinicians. This article explores whether a hybrid approach of augmenting traditional information retrieval with knowledge-based methods facilitates finding practical clinical advice in the research literature. DESIGN: Three experimental systems were evaluated for their ability to find MEDLINE citations providing answers to clinical questions of different complexity. The systems (SemRep, Essie, and CQA-1.0), which rely on domain knowledge and semantic processing to varying extents, were evaluated separately and in combination. Fifteen therapy and prevention questions in three categories (general, intermediate, and specific questions) were searched. The first 10 citations retrieved by each system were randomized, anonymized, and evaluated on a three-point scale. The reasons for ratings were documented. MEASUREMENTS: Metrics evaluating the overall performance of a system (mean average precision, binary preference) and metrics evaluating the number of relevant documents in the first several presented to a physician were used. RESULTS: Scores (mean average precision = 0.57, binary preference = 0.71) for fusion of the retrieval results of the three systems are significantly (p < 0.01) better than those for any individual system. All three systems present three to four relevant citations in the first five for any question type. CONCLUSION: The improvements in finding relevant MEDLINE citations due to knowledge-based processing show promise in assisting physicians to answer questions in clinical practice.

Issues in the registration of clinical trials.

Public concerns about the perils associated with incomplete or delayed reporting of results from clinical trials has heightened interest in trial registries and results databases. Here we review the current status of trial registration efforts and the challenges in developing a comprehensive system of trial registration and reporting of results. ClinicalTrials.gov, the largest trial registry with 36 249 trials from approximately 140 countries, has procedures in place to help ensure that records are valid and informative. Key challenges include the need to minimize inadvertent duplicate registrations, to ensure that interventions have unambiguous names, and to have a search engine that identifies all trials that meet a user's specifications. Recent policy initiatives have called for the development of a database of trial results. Several issues confound the implementation of such a database, including the lack of an accepted format or process for providing summaries of trial results to the public and concerns about disseminating data in the absence of independent scientific review.

Essie: a concept-based search engine for structured biomedical text.

This article describes the algorithms implemented in the Essie search engine that is currently serving several Web sites at the National Library of Medicine. Essie is a phrase-based search engine with term and concept query expansion and probabilistic relevancy ranking. Essie's design is motivated by an observation that query terms are often conceptually related to terms in a document, without actually occurring in the document text. Essie's performance was evaluated using data and standard evaluation methods from the 2003 and 2006 Text REtrieval Conference (TREC) Genomics track. Essie was the best-performing search engine in the 2003 TREC Genomics track and achieved results comparable to those of the highest-ranking systems on the 2006 TREC Genomics track task. Essie shows that a judicious combination of exploiting document structure, phrase searching, and concept based query expansion is a useful approach for information retrieval in the biomedical domain.

Trial Registration at ClinicalTrials.gov between May and October 2005.

BACKGROUND: Clinical trial registration allows interested parties to obtain information about ongoing and completed trials, but there are few data indicating the quality of the information provided during the registration process. We used information in the publicly available ClinicalTrials.gov database to describe patterns of trial registration before and after the implementation by journal editors of a new policy requiring registration as a prerequisite for publication. METHODS: We reviewed ClinicalTrials.gov records to determine patterns of completion of the "Intervention Name" and "Primary Outcome Measure" data fields for trials registered on May 20 and October 11, 2005, and for trials registered during the interval between these two dates, inclusively. RESULTS: During the interval studied, the number of registrations in ClinicalTrials.gov increased by 73 percent from 13,153 to 22,714. The percentage of interventional trials registered by industry with nonspecific Intervention Name entries (attributable to four drug companies) decreased from 10 percent to 2 percent; all other industry and nonindustry records contained specific entries in this field. Of the 2670 studies registered by industry between the two dates, 76 percent provided information in the Primary Outcome Measure field, although these entries varied markedly in their degree of specificity. In the remaining 24 percent of the records, this field was blank. CONCLUSIONS: During the summer of 2005, there were large increases in the number of clinical trial registrations. Overall, the data contained in records were more complete in October than they were in May, but there still is room for substantial improvement.

Strategies for supporting consumer health information seeking.

Despite a growing number of available Web-based health information resources, consumers continue to face a variety of barriers as they attempt to access these resources. Developing a system that appropriately responds to user queries poses several challenges. Guided by an earlier study that analyzed a large number of queries submitted to ClinicalTrials.gov, we developed a variety of techniques to assist user information seeking. We tested the efficacy of these techniques by submitting the original user queries to our new search engine to determine if these techniques would result in better system performance. Overall, the number of query failures was reduced, but the largest improvement was found in the system's query suggestion capability. For a subset of query failures, the current system was able to cut the earlier failure rate almost in half, in most cases providing a suggestion rather than directly finding records. The techniques described here provide a new approach for responding to user queries. The techniques are tolerant of certain types of errors and provide feedback to assist users in reformulating their queries.

Design, implementation and management of a web-based data entry system for ClinicalTrials.gov.

We describe the development and deployment of a web-based authoring capability, the first implementation of which is used for data entry and management in support of the ClinicalTrials.gov web site. The system facilitates efficient collection of summary protocol information from multiple geographically-dispersed organizations. We explain the motivation for developing this capability, and cite critical design goals. We then describe system design, implementation and operation, focusing on essential aspects of each. We conclude with a summary of the extent to which we met our stated objectives.