Evaluation of the written project approval indexes system of Capital Medical Development Research Foundation / 中华医学科研管理杂志

ABSTRACT

Objective The purpose of this study was to evaluate the written project approval Indexes System of Capital Medical Ddevelopment Research Foundation.We analyzed the approval results of application projects and proposed measures to improve the index system.Methods We evaluated its reliability with Cronbach's alpha coefficient,split-half reliability; validity was evaluated with contract validity and content validity,discrimination was studies according to discretion grouping law,and feasibility was studied with the percentage-of-completion method.Results ① ReliabilityCronbach's alpha coefficient of factor and total scores'and split-half reliability were all over 0.80.②Contract validitythe standard factor loading coefficients of the index system were over 0.70 (range0.57～0.86),indicating path performed well.All factor loading coefficients were statistical significant (T-values were 30.49～54.25,all were over 1.96).Fit Indexes (RMSEA =0.065、NNFI =0.99、IFI =0.99、CFI =0.99、GFI =0.95、AGFI =0.93、X2 =1028.21、X2/DF =11.82) indicated the system's goodness of fit was good.③ Content validityScale-level CVI,S-CVI was 0.97 and Interrater agreement was 0.93,over 0.90,which indicated that indexes system's whole Content validity performed well.Except for the item Academic thought item-level CVI being 0.57 all items' item-level CVI were 1.00.④DiscriminationDiscrimination index of every primary index,secondary index and total score ranged from 0.51 to 0.76 (all were over 0.40),meaning that discrimination performed extremely well.Conclusion The indexes system's reliability,contract validity,content validity and discrimination conformed to the actual application projects appraisal results.