Resource requirements to accelerate clinical applications of next generation sequencing and radiomics: Workshop commentary and review.

The National Institutes of Health (NIH)/U.S. Food and Drug Administration (FDA) Joint Leadership Council Next-Generation Sequencing (NGS) and Radiomics Working Group (NGS&R WG) was formed by the NIH/FDA Joint Leadership Council to promote the development and validation of innovative NGS tests, radiomic tools, and associated data analysis and interpretation enhanced by artificial intelligence (AI) and machine-learning (ML) technologies. A two-day workshop was held on September 29-30, 2021 to convene members of the scientific community to discuss how to overcome the "ground truth" gap that has frequently been acknowledged as one of the limiting factors impeding high-quality research, development, validation, and regulatory science in these fields. This report provides a summary of the resource gaps identified by the WG and attendees, highlights existing resources and the ways they can potentially be leveraged to accelerate growth in these fields, and presents opportunities to support NGS and radiomic tool development and validation using technologies such as AI and ML.

Paraganglioma of the Right Recurrent Laryngeal Nerve Presenting as a Thyroid Nodule.

Paragangliomas are abnormal growth cells of neuroectodermal origin that arise from the autonomic nervous system. Head and neck paragangliomas are rare, commonly benign and often have a hereditary origin. Head and neck paragangliomas most commonly arise in the carotid bodies, vagus and glossopharyngeal nerves, and the sympathetic chain. However, we present a case of a paraganglioma arising from the recurrent laryngeal nerve, a phenomenon that has been reported only three times before in the literature. The patient is a 49-year-old female with a past medical history of bilateral carotid body paragangliomas and Hashimoto's disease. She has a family history of paragangliomas in her father and distant relatives and carries a pathogenic variation in the succinate-dehydrogenate subunit D (SDHD) gene, which was first identified through the original linkage studies involving her family. She presented with a mild swelling sensation in her neck. A thyroid ultrasound revealed a right lobe nodule measuring 3.3 x 2.2 x 2.1 cm. Fine needle aspiration of the nodule revealed an atypia of undetermined significance with a risk of malignancy judged as 50%. A total thyroidectomy was performed due to concern for malignancy. During the operation, the thyroid was nodular and hypervascular. At the right thyroid lobe, there was a pearlescent tubular structure approximately 4-5 mm in size. This was stimulated via intraoperative nerve monitoring and was consistent with being a part of the right recurrent laryngeal nerve. Pathology of the tubular structure revealed a 2.8 cm paraganglioma of the right recurrent laryngeal nerve. An incidental 0.1 cm papillary thyroid microcarcinoma within the left thyroid lobe was also noted. Our patient presented with a history of paragangliomas at a very young age and bilaterality, features that are highly characteristic of hereditary disease. Through the original linkage studies involving her family, her father was recognized as being an obligate carrier at risk of bearing occult paragangliomas. Imaging showed that he carried three paragangliomas. Identification of the familial SDHD syndrome as well as SDHD testing has now become widely available. Recognizing hereditary paraganglioma and other cancer susceptibility syndromes can help foster more knowledge on the subject and improve clinical outcomes. More attention should be put on the presentation of paragangliomas in an atypical location, such as in our case.

Cancer screening with multicancer detection tests: A translational science review.

Multicancer detection (MCD) tests use a single, easily obtainable biospecimen, such as blood, to screen for more than one cancer concurrently. MCD tests can potentially be used to improve early cancer detection, including cancers that currently lack effective screening methods. However, these tests have unknown and unquantified benefits and harms. MCD tests differ from conventional cancer screening tests in that the organ responsible for a positive test is unknown, and a broad diagnostic workup may be necessary to confirm the location and type of underlying cancer. Among two prospective studies involving greater than 16,000 individuals, MCD tests identified those who had some cancers without currently recommended screening tests, including pancreas, ovary, liver, uterus, small intestine, oropharyngeal, bone, thyroid, and hematologic malignancies, at early stages. Reported MCD test sensitivities range from 27% to 95% but differ by organ and are lower for early stage cancers, for which treatment toxicity would be lowest and the potential for cure might be highest. False reassurance from a negative MCD result may reduce screening adherence, risking a loss in proven public health benefits from standard-of-care screening. Prospective clinical trials are needed to address uncertainties about MCD accuracy to detect different cancers in asymptomatic individuals, whether these tests can detect cancer sufficiently early for effective treatment and mortality reduction, the degree to which these tests may contribute to cancer overdiagnosis and overtreatment, whether MCD tests work equally well across all populations, and the appropriate diagnostic evaluation and follow-up for patients with a positive test.

Challenges to Using Big Data in Cancer.

Big data in healthcare can enable unprecedented understanding of diseases and their treatment, particularly in oncology. These data may include electronic health records, medical imaging, genomic sequencing, payor records, and data from pharmaceutical research, wearables, and medical devices. The ability to combine datasets and use data across many analyses is critical to the successful use of big data and is a concern for those who generate and use the data. Interoperability and data quality continue to be major challenges when working with different healthcare datasets. Mapping terminology across datasets, missing and incorrect data, and varying data structures make combining data an onerous and largely manual undertaking. Data privacy is another concern addressed by the Health Insurance Portability and Accountability Act, the Common Rule, and the General Data Protection Regulation. The use of big data is now included in the planning and activities of the FDA and the European Medicines Agency. The willingness of organizations to share data in a precompetitive fashion, agreements on data quality standards, and institution of universal and practical tenets on data privacy will be crucial to fully realizing the potential for big data in medicine.

Case Studies for Overcoming Challenges in Using Big Data in Cancer.

The analysis of big healthcare data has enormous potential as a tool for advancing oncology drug development and patient treatment, particularly in the context of precision medicine. However, there are challenges in organizing, sharing, integrating, and making these data readily accessible to the research community. This review presents five case studies illustrating various successful approaches to addressing such challenges. These efforts are CancerLinQ, the American Association for Cancer Research Project GENIE, Project Data Sphere, the National Cancer Institute Genomic Data Commons, and the Veterans Health Administration Clinical Data Initiative. Critical factors in the development of these systems include attention to the use of robust pipelines for data aggregation, common data models, data deidentification to enable multiple uses, integration of data collection into physician workflows, terminology standardization and attention to interoperability, extensive quality assurance and quality control activity, incorporation of multiple data types, and understanding how data resources can be best applied. By describing some of the emerging resources, we hope to inspire consideration of the secondary use of such data at the earliest possible step to ensure the proper sharing of data in order to generate insights that advance the understanding and the treatment of cancer.

Encoding laboratory testing data: case studies of the national implementation of HHS requirements and related standards in five laboratories.

OBJECTIVE: Assess the effectiveness of providing Logical Observation Identifiers Names and Codes (LOINC®)-to-In Vitro Diagnostic (LIVD) coding specification, required by the United States Department of Health and Human Services for SARS-CoV-2 reporting, in medical center laboratories and utilize findings to inform future United States Food and Drug Administration policy on the use of real-world evidence in regulatory decisions. MATERIALS AND METHODS: We compared gaps and similarities between diagnostic test manufacturers' recommended LOINC® codes and the LOINC® codes used in medical center laboratories for the same tests. RESULTS: Five medical centers and three test manufacturers extracted data from laboratory information systems (LIS) for prioritized tests of interest. The data submission ranged from 74 to 532 LOINC® codes per site. Three test manufacturers submitted 15 LIVD catalogs representing 26 distinct devices, 6956 tests, and 686 LOINC® codes. We identified mismatches in how medical centers use LOINC® to encode laboratory tests compared to how test manufacturers encode the same laboratory tests. Of 331 tests available in the LIVD files, 136 (41%) were represented by a mismatched LOINC® code by the medical centers (chi-square 45.0, 4 df, P < .0001). DISCUSSION: The five medical centers and three test manufacturers vary in how they organize, categorize, and store LIS catalog information. This variation impacts data quality and interoperability. CONCLUSION: The results of the study indicate that providing the LIVD mappings was not sufficient to support laboratory data interoperability. National implementation of LIVD and further efforts to promote laboratory interoperability will require a more comprehensive effort and continuing evaluation and quality control.

Quantitating and assessing interoperability between electronic health records.

OBJECTIVES: Electronic health records (EHRs) contain a large quantity of machine-readable data. However, institutions choose different EHR vendors, and the same product may be implemented differently at different sites. Our goal was to quantify the interoperability of real-world EHR implementations with respect to clinically relevant structured data. MATERIALS AND METHODS: We analyzed de-identified and aggregated data from 68 oncology sites that implemented 1 of 5 EHR vendor products. Using 6 medications and 6 laboratory tests for which well-accepted standards exist, we calculated inter- and intra-EHR vendor interoperability scores. RESULTS: The mean intra-EHR vendor interoperability score was 0.68 as compared to a mean of 0.22 for inter-system interoperability, when weighted by number of systems of each type, and 0.57 and 0.20 when not weighting by number of systems of each type. DISCUSSION: In contrast to data elements required for successful billing, clinically relevant data elements are rarely standardized, even though applicable standards exist. We chose a representative sample of laboratory tests and medications for oncology practices, but our set of data elements should be seen as an example, rather than a definitive list. CONCLUSIONS: We defined and demonstrated a quantitative measure of interoperability between site EHR systems and within/between implemented vendor systems. Two sites that share the same vendor are, on average, more interoperable. However, even for implementation of the same EHR product, interoperability is not guaranteed. Our results can inform institutional EHR selection, analysis, and optimization for interoperability.

The FDA Oncology Center of Excellence Scientific Collaborative: Charting a Course for Applied Regulatory Science Research in Oncology.

The FDA Oncology Center of Excellence (OCE) is a leader within the agency in scientific outreach activities and regulatory science research. On the basis of analysis of scientific workshops, internal meetings, and publications, the OCE identified nine scientific priority areas and one cross-cutting area of high interest for collaboration with external researchers. This article describes the process for identifying these scientific interest areas and highlights funded and unfunded opportunities for external researchers to work with FDA staff on critical regulatory science challenges.

Impact of Broadening Trial Eligibility Criteria for Patients with Advanced Non-Small Cell Lung Cancer: Real-World Analysis of Select ASCO-Friends Recommendations.

PURPOSE: Cancer clinical trials often accrue slowly or miss enrollment targets. Strict eligibility criteria are a major reason. Restrictive criteria also limit opportunities for patient participation while compromising external validity of trial results. We examined the impact of broadening select eligibility criteria on characteristics and number of patients eligible for trials, using recommendations of the American Society of Clinical Oncology (ASCO) and Friends of Cancer Research. EXPERIMENTAL DESIGN: A retrospective, observational analysis used electronic health record data from ASCO's CancerLinQ Discovery database. Study cohort included patients with advanced non-small cell lung cancer treated from 2011 to 2018. Patients were grouped by traditional criteria [no brain metastases, no other malignancies, and creatinine clearance (CrCl) ≥ 60 mL/minute] and broadened criteria (including brain metastases, other malignancies, and CrCl ≥ 30 mL/minute). RESULTS: The analysis cohort included 10,500 patients. Median age was 68 years, and 73% of patients were White. Most patients had stage IV disease (65%). A total of 5,005 patients (48%) would be excluded from trial participation using the traditional criteria. The broadened criteria, however, would allow 98% of patients (10,346) to be potential participants. Examination of patients included by traditional criteria (5,495) versus those added (4,851) by broadened criteria showed that the number of women, patients aged 75+ years, and those with stage IV cancer was significantly greater using broadened criteria. CONCLUSIONS: This analysis of real-world data demonstrated that broadening three common eligibility criteria has the potential to double the eligible patient population and include trial participants who are more representative of those encountered in practice.See related commentary by Giantonio, p. 2369.

Development of CancerLinQ, a Health Information Learning Platform From Multiple Electronic Health Record Systems to Support Improved Quality of Care.

PURPOSE: ASCO, through its wholly owned subsidiary, CancerLinQ LLC, developed CancerLinQ, a learning health system for oncology. A learning health system is important for oncology patients because less than 5% of patients with cancer enroll in clinical trials, leaving evidence gaps for patient populations not enrolled in trials. In addition, clinical trial populations often differ from the overall cancer population with respect to age, race, performance status, and other clinical parameters. MATERIALS AND METHODS: Working with subscribing practices, CancerLinQ accepts data from electronic health records and transforms the local representation of a patient's care into a standardized representation on the basis of the Quality Data Model from the National Quality Forum. CancerLinQ provides this information back to the subscribing practice through a series of tools that support quality improvement. CancerLinQ also creates de-identified data sets for secondary research use. RESULTS: As of March 2020, CancerLinQ includes data from 63 organizations across the United States that use nine different electronic health records. The database includes 1,426,015 patients with a primary cancer diagnosis, of which 238,680 have had additional information abstracted from unstructured content. CONCLUSION: As CancerLinQ continues to onboard subscribing practices, the breadth of potential applications for a learning health care system widen. Future practice-facing tools could include real-world data visualization, recommendations for treatment of patients with actionable genetic variations, and identification of patients who may be eligible for clinical trials. Feeding these insights back into oncology practice ensures that we learn how to treat patients with cancer not just on the basis of the selective experience of the 5% that enroll in clinical trials, but from the real-world experience of the entire spectrum of patients with cancer in the United States.

Next-Generation Sequencing and the Clinical Oncology Workflow: Data Challenges, Proposed Solutions, and a Call to Action.

PURPOSE: Next-generation sequencing (NGS) of tumor and germline DNA is foundational for precision oncology, with rapidly expanding diagnostic, prognostic, and therapeutic implications. Although few question the importance of NGS in modern oncology care, the process of gathering primary molecular data, integrating it into electronic health records, and optimally using it as part of a clinical workflow remains far from seamless. Numerous challenges persist around data standards and interoperability, and clinicians frequently face difficulties in managing the growing amount of genomic knowledge required to care for patients and keep up to date. METHODS: This review provides a descriptive analysis of genomic data workflows for NGS data in clinical oncology and issues that arise from the inconsistent use of standards for sharing data across systems. Potential solutions are described. RESULTS: NGS technology, especially for somatic genomics, is well established and widely used in routine patient care, quality measurement, and research. Available genomic knowledge bases play an evolving role in patient management but lack harmonization with one another. Questions about their provenance and timeliness of updating remain. Potentially useful standards for sharing genomic data, such as HL7 FHIR and mCODE, remain primarily in the research and/or development stage. Nonetheless, their impact will likely be seen as uptake increases across care settings and laboratories. The specific use case of ASCO CancerLinQ, as a clinicogenomic database, is discussed. CONCLUSION: Because the electronic health records of today seem ill suited for managing genomic data, other solutions are required, including universal data standards and applications that use application programming interfaces, along with a commitment on the part of sequencing laboratories to consistently provide structured genomic data for clinical use.

BRCA Challenge: BRCA Exchange as a global resource for variants in BRCA1 and BRCA2.

The BRCA Challenge is a long-term data-sharing project initiated within the Global Alliance for Genomics and Health (GA4GH) to aggregate BRCA1 and BRCA2 data to support highly collaborative research activities. Its goal is to generate an informed and current understanding of the impact of genetic variation on cancer risk across the iconic cancer predisposition genes, BRCA1 and BRCA2. Initially, reported variants in BRCA1 and BRCA2 available from public databases were integrated into a single, newly created site, www.brcaexchange.org. The purpose of the BRCA Exchange is to provide the community with a reliable and easily accessible record of variants interpreted for a high-penetrance phenotype. More than 20,000 variants have been aggregated, three times the number found in the next-largest public database at the project's outset, of which approximately 7,250 have expert classifications. The data set is based on shared information from existing clinical databases-Breast Cancer Information Core (BIC), ClinVar, and the Leiden Open Variation Database (LOVD)-as well as population databases, all linked to a single point of access. The BRCA Challenge has brought together the existing international Evidence-based Network for the Interpretation of Germline Mutant Alleles (ENIGMA) consortium expert panel, along with expert clinicians, diagnosticians, researchers, and database providers, all with a common goal of advancing our understanding of BRCA1 and BRCA2 variation. Ongoing work includes direct contact with national centers with access to BRCA1 and BRCA2 diagnostic data to encourage data sharing, development of methods suitable for extraction of genetic variation at the level of individual laboratory reports, and engagement with participant communities to enable a more comprehensive understanding of the clinical significance of genetic variation in BRCA1 and BRCA2.

Bedside Back to Bench: Building Bridges between Basic and Clinical Genomic Research.

Genome sequencing has revolutionized the diagnosis of genetic diseases. Close collaborations between basic scientists and clinical genomicists are now needed to link genetic variants with disease causation. To facilitate such collaborations, we recommend prioritizing clinically relevant genes for functional studies, developing reference variant-phenotype databases, adopting phenotype description standards, and promoting data sharing.

Integrating Genomic Resources with Electronic Health Records using the HL7 Infobutton Standard.

BACKGROUND: The Clinical Genome Resource (ClinGen) Electronic Health Record (EHR) Workgroup aims to integrate ClinGen resources with EHRs. A promising option to enable this integration is through the Health Level Seven (HL7) Infobutton Standard. EHR systems that are certified according to the US Meaningful Use program provide HL7-compliant infobutton capabilities, which can be leveraged to support clinical decision-making in genomics. OBJECTIVES: To integrate genomic knowledge resources using the HL7 infobutton standard. Two tactics to achieve this objective were: (1) creating an HL7-compliant search interface for ClinGen, and (2) proposing guidance for genomic resources on achieving HL7 Infobutton standard accessibility and compliance. METHODS: We built a search interface utilizing OpenInfobutton, an open source reference implementation of the HL7 Infobutton standard. ClinGen resources were assessed for readiness towards HL7 compliance. Finally, based upon our experiences we provide recommendations for publishers seeking to achieve HL7 compliance. RESULTS: Eight genomic resources and two sub-resources were integrated with the ClinGen search engine via OpenInfobutton and the HL7 infobutton standard. Resources we assessed have varying levels of readiness towards HL7-compliance. Furthermore, we found that adoption of standard terminologies used by EHR systems is the main gap to achieve compliance. CONCLUSION: Genomic resources can be integrated with EHR systems via the HL7 Infobutton standard using OpenInfobutton. Full compliance of genomic resources with the Infobutton standard would further enhance interoperability with EHR systems.

Combined genetic and splicing analysis of BRCA1 c.[594-2A>C; 641A>G] highlights the relevance of naturally occurring in-frame transcripts for developing disease gene variant classification algorithms.

A recent analysis using family history weighting and co-observation classification modeling indicated that BRCA1 c.594-2A > C (IVS9-2A > C), previously described to cause exon 10 skipping (a truncating alteration), displays characteristics inconsistent with those of a high risk pathogenic BRCA1 variant. We used large-scale genetic and clinical resources from the ENIGMA, CIMBA and BCAC consortia to assess pathogenicity of c.594-2A > C. The combined odds for causality considering case-control, segregation and breast tumor pathology information was 3.23 × 10-8 Our data indicate that c.594-2A > C is always in cis with c.641A > G. The spliceogenic effect of c.[594-2A > C;641A > G] was characterized using RNA analysis of human samples and splicing minigenes. As expected, c.[594-2A > C; 641A > G] caused exon 10 skipping, albeit not due to c.594-2A > C impairing the acceptor site but rather by c.641A > G modifying exon 10 splicing regulatory element(s). Multiple blood-based RNA assays indicated that the variant allele did not produce detectable levels of full-length transcripts, with a per allele BRCA1 expression profile composed of ≈70-80% truncating transcripts, and ≈20-30% of in-frame Δ9,10 transcripts predicted to encode a BRCA1 protein with tumor suppression function.We confirm that BRCA1c.[594-2A > C;641A > G] should not be considered a high-risk pathogenic variant. Importantly, results from our detailed mRNA analysis suggest that BRCA-associated cancer risk is likely not markedly increased for individuals who carry a truncating variant in BRCA1 exons 9 or 10, or any other BRCA1 allele that permits 20-30% of tumor suppressor function. More generally, our findings highlight the importance of assessing naturally occurring alternative splicing for clinical evaluation of variants in disease-causing genes.

A Clinical Service to Support the Return of Secondary Genomic Findings in Human Research.

Human genome and exome sequencing are powerful research tools that can generate secondary findings beyond the scope of the research. Most secondary genomic findings are of low importance, but some (for a current estimate of 1%-3% of individuals) confer high risk of a serious disease that could be mitigated by timely medical intervention. The impact and scope of secondary findings in genome and exome sequencing will only increase in the future. There is considerable agreement that high-impact findings should be returned to participants, but many researchers performing genomic research studies do not have the background, skills, or resources to identify, verify, interpret, and return such variants. Here, we introduce a proposal for the formation of a secondary-genomic-findings service (SGFS) that would support researchers by enabling the return of clinically actionable sequencing results to research participants in a standardized manner. We describe a proposed structure for such a centralized service and evaluate the advantages and challenges of the approach. We suggest that such a service would be of greater benefit to all parties involved than present practice, which is highly variable. We encourage research centers to consider the adoption of a centralized SGFS.

ClinVar: public archive of interpretations of clinically relevant variants.

ClinVar (https://www.ncbi.nlm.nih.gov/clinvar/) at the National Center for Biotechnology Information (NCBI) is a freely available archive for interpretations of clinical significance of variants for reported conditions. The database includes germline and somatic variants of any size, type or genomic location. Interpretations are submitted by clinical testing laboratories, research laboratories, locus-specific databases, OMIM®, GeneReviews™, UniProt, expert panels and practice guidelines. In NCBI's Variation submission portal, submitters upload batch submissions or use the Submission Wizard for single submissions. Each submitted interpretation is assigned an accession number prefixed with SCV. ClinVar staff review validation reports with data types such as HGVS (Human Genome Variation Society) expressions; however, clinical significance is reported directly from submitters. Interpretations are aggregated by variant-condition combination and assigned an accession number prefixed with RCV. Clinical significance is calculated for the aggregate record, indicating consensus or conflict in the submitted interpretations. ClinVar uses data standards, such as HGVS nomenclature for variants and MedGen identifiers for conditions. The data are available on the web as variant-specific views; the entire data set can be downloaded via ftp. Programmatic access for ClinVar records is available through NCBI's E-utilities. Future development includes providing a variant-centric XML archive and a web page for details of SCV submissions.