Comparative analysis of subject novelty detection methods in medical literature / 中华医学图书情报杂志

ABSTRACT

Objective To study the feasibility of novelty detection model in assessing the subject novelty of medical literature and comparatively analyze the advantages and disadvantages of words-overlap algorithm and co-words-based inverse file frequency quantitative algorithm. Methods Two novelty detection models were established for the 8 research subjects in PubMed-covered literature. The feasibility of two novelty detection models in assessing the subject novelty of medical literature was assessed according to the subject novelty of literature analyzed by experts, ROC curves and AUC values. Results Words-overlap algorithm showed that the fluctuating amplitude of subject novelty was rather high, which can thus reflect the difference between the contents in literature on the data. ROC curves and AUC values-based analysis revealed a high accuracy of words-overlap algorithm for judging the novelty of literature while co-words-based inverse file frequency quantitative algorithm displayed a low accuracy for judging the novelty of literature. Conclusion The novelty of literature detected with the two novelty detection methods is moderately related. The mean novelty value detected with the two novelty detection methods is of statistical signifi-cance. However, the novelty of literature detected with words-overlap algorithm is higher than that detected with co-words-based inverse file frequency quantitative algorithm.