Publications as predictors of racial and ethnic differences in NIH research awards.

This research expands efforts to understand differences in NIH funding associated with the self-identified race and ethnicity of applicants. We collected data from 2,397 NIH Biographical Sketches submitted between FY 2003 and 2006 as part of new NIH R01 Type 1 applications to obtain detailed information on the applicants' training and scholarly activities, including publications. Using these data, we examined the association between an NIH R01 applicant's race or ethnicity and the probability of receiving an R01 award. The applicant's publication history as reported in the NIH biographical sketch and the associated bibliometrics narrowed the black/white funding gap for new and experienced investigators in explanatory models. We found that black applicants reported fewer papers on their Biosketches, had fewer citations, and those that were reported appeared in journals with lower impact factors. Incorporating these measures in our models explained a substantial portion of the black/white funding gap. Although these predictors influence the funding gap, they do not fully address race/ethnicity differences in receiving a priority score.

Assessing the value of a Small Grants Program for behavioral research in cancer control.

In 1999, the National Cancer Institute (NCI) issued the first Small Grants Program (SGP) for Behavioral Research in Cancer Control (R03) funding opportunity announcement for investigators new to behavioral cancer prevention and control research. We explored whether the SGP was successful in its goals to encourage new investigators from a variety of disciplines to apply their skills to and promote career development in behavioral cancer prevention and control research. A quasi-experimental design examined applicant characteristics and outcome data by award status. Propensity score matching was used to compare awardees and non-awardees with similar impact scores as a control for application quality. Awardees were more likely than non-awardees to pursue and receive subsequent funding from the NCI and publish their research. Tailored small grant programs create benefit for both promoting and retaining new investigators.

Outcome evaluation of the National Cancer Institute career development awards program.

The National Cancer Institute (NCI) career development (K) awards program supports investigators to develop their cancer research programs and achieve independence. The NCI Center for Cancer Training conducted a K program evaluation by analyzing outcomes of awardees and individuals who applied to the program but were not funded. The evaluation covered seven NCI mechanisms (K01, K07, K08, K11, K22, K23, and K25) between 1980 and 2008. Descriptive statistics and regression modeling were performed on the full cohort (n = 2,893 individuals, 4,081 K applications) and a comparison cohort described herein. K awardees proportionately received more subsequent NIH grants and authored more publications, and time to first R01 grant was unaffected. Of those not pursuing research, K awardees were more likely to participate in activities signaling continued scientific engagement. The NCI K program had a positive impact, not only on participants' biomedical research careers but also on achieving outcomes significant to the scientific enterprise.

Piloting an approach to rapid and automated assessment of a new research initiative: Application to the National Cancer Institute's Provocative Questions initiative.

Funders of biomedical research are often challenged to understand how a new funding initiative fits within the agency's portfolio and the larger research community. While traditional assessment relies on retrospective review by subject matter experts, it is now feasible to design portfolio assessment and gap analysis tools leveraging administrative and grant application data that can be used for early and continued analysis. We piloted such methods on the National Cancer Institute's Provocative Questions (PQ) initiative to address key questions regarding diversity of applicants; whether applicants were proposing new avenues of research; and whether grant applications were filling portfolio gaps. For the latter two questions, we defined measurements called focus shift and relevance, respectively, based on text similarity scoring. We demonstrate that two types of applicants were attracted by the PQs at rates greater than or on par with the general National Cancer Institute applicant pool: those with clinical degrees and new investigators. Focus shift scores tended to be relatively low, with applicants not straying far from previous research, but the majority of applications were found to be relevant to the PQ the application was addressing. Sensitivity to comparison text and inability to distinguish subtle scientific nuances are the primary limitations of our automated approaches based on text similarity, potentially biasing relevance and focus shift measurements. We also discuss potential uses of the relevance and focus shift measures including the design of outcome evaluations, though further experimentation and refinement are needed for a fuller understanding of these measures before broad application.

Measuring the evolution and output of cross-disciplinary collaborations within the NCI Physical Sciences-Oncology Centers Network.

Development of effective quantitative indicators and methodologies to assess the outcomes of cross-disciplinary collaborative initiatives has the potential to improve scientific program management and scientific output. This article highlights an example of a prospective evaluation that has been developed to monitor and improve progress of the National Cancer Institute Physical Sciences-Oncology Centers (PS-OC) program. Study data, including collaboration information, was captured through progress reports and compiled using the web-based analytic database: Interdisciplinary Team Reporting, Analysis, and Query Resource. Analysis of collaborations was further supported by data from the Thomson Reuters Web of Science database, MEDLINE database, and a web-based survey. Integration of novel and standard data sources was augmented by the development of automated methods to mine investigator pre-award publications, assign investigator disciplines, and distinguish cross-disciplinary publication content. The results highlight increases in cross-disciplinary authorship collaborations from pre- to post-award years among the primary investigators and confirm that a majority of cross-disciplinary collaborations have resulted in publications with cross-disciplinary content that rank in the top third of their field. With these evaluation data, PS-OC Program officials have provided ongoing feedback to participating investigators to improve center productivity and thereby facilitate a more successful initiative. Future analysis will continue to expand these methods and metrics to adapt to new advances in research evaluation and changes in the program.

Race, ethnicity, and NIH research awards.

We investigated the association between a U.S. National Institutes of Health (NIH) R01 applicant's self-identified race or ethnicity and the probability of receiving an award by using data from the NIH IMPAC II grant database, the Thomson Reuters Web of Science, and other sources. Although proposals with strong priority scores were equally likely to be funded regardless of race, we find that Asians are 4 percentage points and black or African-American applicants are 13 percentage points less likely to receive NIH investigator-initiated research funding compared with whites. After controlling for the applicant's educational background, country of origin, training, previous research awards, publication record, and employer characteristics, we find that black applicants remain 10 percentage points less likely than whites to be awarded NIH research funding. Our results suggest some leverage points for policy intervention.

The function of yeast epsin and Ede1 ubiquitin-binding domains during receptor internalization.

The formation of a primary endocytic vesicle is a dynamic process involving the transient organization of adaptor and scaffold proteins at the plasma membrane. Epsins and Eps15-like proteins are ubiquitin-binding proteins that act early in this process. The yeast epsins, Ent1 and Ent2, carry functional ubiquitin-interacting motifs (UIMs), whereas the yeast Eps15-like protein, Ede1, has a C-terminal ubiquitin-associated (UBA) domain. Analysis of mutants lacking early endocytic adaptors reveals that the ubiquitin-binding domains (UBDs) of Ent2 and Ede1 are likely to function primarily to mediate protein-protein interactions between components of the early endocytic machinery. Cells that lack epsin and Ede1 UBDs are able to internalize activated, ubiquitinated receptors. Furthermore, under conditions in which epsin UIMs are important for receptor internalization, receptors internalized via both ubiquitin-dependent and ubiquitin-independent signals require the UIMs, indicating that UIM function is not restricted to ubiquitinated receptors. Epsin UIMs share function with non-UBD protein-protein interaction motifs in Ent2 and Ede1, and the Ede1 UBA domain appears to negatively regulate interactions between endocytic proteins. Together, our results suggest that the ubiquitin-binding domains within the yeast epsin Ent2 and Ede1 are involved in the formation and regulation of the endocytic network.

Receptor internalization in yeast requires the Tor2-Rho1 signaling pathway.

Efficient internalization of proteins from the cell surface is essential for regulating cell growth and differentiation. In a screen for yeast mutants defective in ligand-stimulated internalization of the alpha-factor receptor, we identified a mutant allele of TOR2, tor2G2128R. Tor proteins are known to function in translation initiation and nutrient sensing and are required for cell cycle progression through G1. Yeast Tor2 has an additional role in regulating the integrity of the cell wall by activating the Rho1 guanine nucleotide exchange factor Rom2. The endocytic defect in tor2G2128R cells is due to disruption of this Tor2 unique function. Other proteins important for cell integrity, Rom2 and the cell integrity sensor Wsc1, are also required for efficient endocytosis. A rho1 mutant specifically defective in activation of the glucan synthase Fks1/2 does not internalize alpha-factor efficiently, and fks1Delta cells exhibit a similar phenotype. Removal of the cell wall does not inhibit internalization, suggesting that the function of Rho1 and Fks1 in endocytosis is not through cell wall synthesis or structural integrity. These findings reveal a novel function for the Tor2-Rho1 pathway in controlling endocytosis in yeast, a function that is mediated in part through the plasma membrane protein Fks1.

Epsins and Vps27p/Hrs contain ubiquitin-binding domains that function in receptor endocytosis.

Ubiquitin functions as a signal for sorting cargo at multiple steps of the endocytic pathway and controls the activity of trans-acting components of the endocytic machinery (reviewed in refs 1, and 2). By contrast to proteasome degradation, which generally requires a polyubiquitin chain that is at least four subunits long, internalization and sorting of endocytic cargo at the late endosome are mediated by mono-ubiquitination. Here, we demonstrate that ubiquitin-interacting motifs (UIMs) found in epsins and Vps27p (ref. 9) from Saccharomyces cerevisiae are required for ubiquitin binding and protein transport. Epsin UIMs are important for the internalization of receptors into vesicles at the plasma membrane. Vps27p UIMs are necessary to sort biosynthetic and endocytic cargo into vesicles that bud into the lumen of a late endosomal compartment, the multivesicular body. We propose that mono-ubiquitin regulates internalization and endosomal sorting by interacting with modular ubiquitin-binding domains in core components of the protein transport machinery. UIM domains are found in a broad spectrum of proteins, consistent with the idea that mono-ubiquitin can function as a regulatory signal to control diverse biological activities.

The conserved Pkh-Ypk kinase cascade is required for endocytosis in yeast.

Internalization of activated signaling receptors by endocytosis is one way cells downregulate extracellular signals. Like many signaling receptors, the yeast alpha-factor pheromone receptor is downregulated by hyperphosphorylation, ubiquitination, and subsequent internalization and degradation in the lysosome-like vacuole. In a screen to detect proteins involved in ubiquitin-dependent receptor internalization, we identified the sphingoid base-regulated serine-threonine kinase Ypk1. Ypk1 is a homologue of the mammalian serum- and glucocorticoid-induced kinase, SGK, which can substitute for Ypk1 function in yeast. The kinase activity of Ypk1 is required for receptor endocytosis because mutations in two residues important for its catalytic activity cause a severe defect in alpha-factor internalization. Ypk1 is required for both receptor-mediated and fluid-phase endocytosis, and is not necessary for receptor phosphorylation or ubiquitination. Ypk1 itself is phosphorylated by Pkh kinases, homologues of mammalian PDK1. The threonine in Ypk1 that is phosphorylated by Pkh1 is required for efficient endocytosis, and pkh mutant cells are defective in alpha-factor internalization and fluid-phase endocytosis. These observations demonstrate that Ypk1 acts downstream of the Pkh kinases to control endocytosis by phosphorylating components of the endocytic machinery.