Extend the benchmarking indel set by manual review using the individual cell line sequencing data from the Sequencing Quality Control 2 (SEQC2) project.

Accurate indel calling plays an important role in precision medicine. A benchmarking indel set is essential for thoroughly evaluating the indel calling performance of bioinformatics pipelines. A reference sample with a set of known-positive variants was developed in the FDA-led Sequencing Quality Control Phase 2 (SEQC2) project, but the known indels in the known-positive set were limited. This project sought to provide an enriched set of known indels that would be more translationally relevant by focusing on additional cancer related regions. A thorough manual review process completed by 42 reviewers, two advisors, and a judging panel of three researchers significantly enriched the known indel set by an additional 516 indels. The extended benchmarking indel set has a large range of variant allele frequencies (VAFs), with 87% of them having a VAF below 20% in reference Sample A. The reference Sample A and the indel set can be used for comprehensive benchmarking of indel calling across a wider range of VAF values in the lower range. Indel length was also variable, but the majority were under 10 base pairs (bps). Most of the indels were within coding regions, with the remainder in the gene regulatory regions. Although high confidence can be derived from the robust study design and meticulous human review, this extensive indel set has not undergone orthogonal validation. The extended benchmarking indel set, along with the indels in the previously published known-positive set, was the truth set used to benchmark indel calling pipelines in a community challenge hosted on the precisionFDA platform. This benchmarking indel set and reference samples can be utilized for a comprehensive evaluation of indel calling pipelines. Additionally, the insights and solutions obtained during the manual review process can aid in improving the performance of these pipelines.

Cross-oncopanel study reveals high sensitivity and accuracy with overall analytical performance depending on genomic regions.

BACKGROUND: Targeted sequencing using oncopanels requires comprehensive assessments of accuracy and detection sensitivity to ensure analytical validity. By employing reference materials characterized by the U.S. Food and Drug Administration-led SEquence Quality Control project phase2 (SEQC2) effort, we perform a cross-platform multi-lab evaluation of eight Pan-Cancer panels to assess best practices for oncopanel sequencing. RESULTS: All panels demonstrate high sensitivity across targeted high-confidence coding regions and variant types for the variants previously verified to have variant allele frequency (VAF) in the 5-20% range. Sensitivity is reduced by utilizing VAF thresholds due to inherent variability in VAF measurements. Enforcing a VAF threshold for reporting has a positive impact on reducing false positive calls. Importantly, the false positive rate is found to be significantly higher outside the high-confidence coding regions, resulting in lower reproducibility. Thus, region restriction and VAF thresholds lead to low relative technical variability in estimating promising biomarkers and tumor mutational burden. CONCLUSION: This comprehensive study provides actionable guidelines for oncopanel sequencing and clear evidence that supports a simplified approach to assess the analytical performance of oncopanels. It will facilitate the rapid implementation, validation, and quality control of oncopanels in clinical use.

Evaluating the analytical validity of circulating tumor DNA sequencing assays for precision oncology.

Circulating tumor DNA (ctDNA) sequencing is being rapidly adopted in precision oncology, but the accuracy, sensitivity and reproducibility of ctDNA assays is poorly understood. Here we report the findings of a multi-site, cross-platform evaluation of the analytical performance of five industry-leading ctDNA assays. We evaluated each stage of the ctDNA sequencing workflow with simulations, synthetic DNA spike-in experiments and proficiency testing on standardized, cell-line-derived reference samples. Above 0.5% variant allele frequency, ctDNA mutations were detected with high sensitivity, precision and reproducibility by all five assays, whereas, below this limit, detection became unreliable and varied widely between assays, especially when input material was limited. Missed mutations (false negatives) were more common than erroneous candidates (false positives), indicating that the reliable sampling of rare ctDNA fragments is the key challenge for ctDNA assays. This comprehensive evaluation of the analytical performance of ctDNA assays serves to inform best practice guidelines and provides a resource for precision oncology.

Transcriptional regulation of epidermal barrier formation.

The mammalian epidermis is a self-renewing stratified squamous epithelium. Its basal cell layer contains proliferating keratinocytes that exit the cell cycle when they move into the suprabasal compartment. These cells activate a gene differentiation program aimed at building a protective epidermal barrier as they move toward the surface, successively going through the spinous and granular layers. At the completion of this process, the keratinocytes become enucleated and form the cornified layer, the surface layer of the skin. The highly cross-linked protein-lipid envelope and extracellular lipids in the cornified layer along with cell-cell adhesions in the granular layer are required for an effective epidermal barrier. Transcriptional mechanisms are critical for the formation of the epidermal barrier, and in this chapter, we describe methods to evaluate the role of a transcription factor (TF) in epidermal differentiation. To identify direct target genes of a TF, we propose a combination of bioinformatics and experimental approaches. The ultimate goal of these approaches is to understand the mechanisms whereby a TF regulates epidermal barrier formation.

Grainyhead-like factor Get1/Grhl3 regulates formation of the epidermal leading edge during eyelid closure.

Grainyhead transcription factors play an evolutionarily conserved role in regulating epidermal terminal differentiation. One such factor, the mammalian Grainyhead-like epithelial transactivator (Get1/Grhl3), is important for epidermal barrier formation. In addition to a role in barrier formation, Grainyhead genes play roles in closure of several structures such as the mouse neural tube and Drosophila wounds. Consistent with these observations, we found that Get1 knockout mice have an eye-open at birth phenotype. The failure of eyelid closure appears to be due to critical functions of Get1 in promoting F-actin polymerization, filopodia formation, and the cell shape changes that are required for migration of the keratinocytes at the leading edge during eyelid closure. The expression of TGFalpha, a known regulator of leading edge formation, is decreased in the eyelid tip of Get1(-/-) mice. Levels of phospho-EGFR and phospho-ERK are also decreased at the leading edge tip. Furthermore, in an organ culture model, TGFalpha can increase levels of phospho-EGFR and promote cell shape changes as well as leading edge formation in Get1(-/-) eyelids, indicating that in eyelid closure Get1 acts upstream of TGFalpha in the EGFR/ERK pathway.

The Grainyhead-like epithelial transactivator Get-1/Grhl3 regulates epidermal terminal differentiation and interacts functionally with LMO4.

Defective permeability barrier is an important feature of many skin diseases and causes mortality in premature infants. To investigate the control of barrier formation, we characterized the epidermally expressed Grainyhead-like epithelial transactivator (Get-1)/Grhl3, a conserved mammalian homologue of Grainyhead, which plays important roles in cuticle development in Drosophila. Get-1 interacts with the LIM-only protein LMO4, which is co-expressed in the developing mammalian epidermis. The epidermis of Get-1(-/-) mice showed a severe barrier function defect associated with impaired differentiation of the epidermis, including defects of the stratum corneum, extracellular lipid composition and cell adhesion in the granular layer. The Get-1 mutation affects multiple genes linked to terminal differentiation and barrier function, including most genes of the epidermal differentiation complex. Get-1 therefore directly or indirectly regulates a broad array of epidermal differentiation genes encoding structural proteins, lipid metabolizing enzymes and cell adhesion molecules. Although deletion of the LMO4 gene had no overt consequences for epidermal development, the epidermal terminal differentiation defect in mice deleted for both Get-1 and LMO4 is much more severe than in Get-1(-/-) mice with striking impairment of stratum corneum formation. These findings indicate that the Get-1 and LMO4 genes interact functionally to regulate epidermal terminal differentiation.