TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19.
J Am Med Inform Assoc
; 27(9): 1431-1436, 2020 07 01.
Article
in English
| MEDLINE | ID: covidwho-165244
ABSTRACT
TREC-COVID is an information retrieval (IR) shared task initiated to support clinicians and clinical research during the COVID-19 pandemic. IR for pandemics breaks many normal assumptions, which can be seen by examining 9 important basic IR research questions related to pandemic situations. TREC-COVID differs from traditional IR shared task evaluations with special considerations for the expected users, IR modality considerations, topic development, participant requirements, assessment process, relevance criteria, evaluation metrics, iteration process, projected timeline, and the implications of data use as a post-task test collection. This article describes how all these were addressed for the particular requirements of developing IR systems under a pandemic situation. Finally, initial participation numbers are also provided, which demonstrate the tremendous interest the IR community has in this effort.
Keywords
Full text:
Available
Collection:
International databases
Database:
MEDLINE
Main subject:
Pneumonia, Viral
/
Information Storage and Retrieval
/
Coronavirus Infections
/
Pandemics
/
Betacoronavirus
Type of study:
Experimental Studies
/
Prognostic study
Limits:
Humans
Language:
English
Journal:
J Am Med Inform Assoc
Journal subject:
Medical Informatics
Year:
2020
Document Type:
Article
Affiliation country:
Jamia
Similar
MEDLINE
...
LILACS
LIS