Statistical P values do not dominate scientific research / 中华预防医学杂志

ABSTRACT

Statistical P value and its threshold have been controversial worldwide for a while. Recent heated debate was triggered by two practical issues unexplainable high false positive rate in biomedical research, and global misunderstood of "statistical significance" in scientific community. Thus, part of scientists suggests applying more stringent significance level (from 0.05 to 0.005), or even giving up the use of significance level. We believe that they are throwing the baby out with the bath water. These suggestions will not contribute to any improvement of this unfavorable situation but will lead the scientific decision-making to a more difficult and subjective corner. Scientists should use statistical P value and threshold only if they correctly understand the soul of statistics-uncertainty. Statistical significance is neither sole nor dominant criterion to measure the scientific value, but an honest assistant. Scientific decision-making should initiate from the scientific experimental design, followed by rigorous implementation and transparent analysis, and synthesize a variety of information to reach a tenable conclusion.