ABSTRACT
There is a growing realization that the complexity of model ensemble studies depends not only on the models used but also on the experience and approach used by modelers to calibrate and validate results, which remain a source of uncertainty. Here, we applied a multi-criteria decision-making method to investigate the rationale applied by modelers in a model ensemble study where 12 process-based different biogeochemical model types were compared across five successive calibration stages. The modelers shared a common level of agreement about the importance of the variables used to initialize their models for calibration. However, we found inconsistency among modelers when judging the importance of input variables across different calibration stages. The level of subjective weighting attributed by modelers to calibration data decreased sequentially as the extent and number of variables provided increased. In this context, the perceived importance attributed to variables such as the fertilization rate, irrigation regime, soil texture, pH, and initial levels of soil organic carbon and nitrogen stocks was statistically different when classified according to model types. The importance attributed to input variables such as experimental duration, gross primary production, and net ecosystem exchange varied significantly according to the length of the modeler's experience. We argue that the gradual access to input data across the five calibration stages negatively influenced the consistency of the interpretations made by the modelers, with cognitive bias in "trial-and-error" calibration routines. Our study highlights that overlooking human and social attributes is critical in the outcomes of modeling and model intercomparison studies. While complexity of the processes captured in the model algorithms and parameterization is important, we contend that (1) the modeler's assumptions on the extent to which parameters should be altered and (2) modeler perceptions of the importance of model parameters are just as critical in obtaining a quality model calibration as numerical or analytical details.
Subject(s)
Carbon , Soil , Ecosystem , Humans , Nitrogen , UncertaintyABSTRACT
Understanding how much inorganic fertilizer (referred to as fertilizer) is applied to different crops at national, regional and global levels is an essential component of fertilizer consumption analysis and demand projection. Good information on fertilizer use by crop (FUBC) is rarely available because it is difficult to collect and time-consuming to process and validate. To fill this gap, a first global FUBC report was published in 1992 for the 1990/1991 period, based on an expert survey conducted jointly by the Food and Agriculture Organization (FAO) of the UN, the International Fertilizer Development Center (IFDC) and the International Fertilizer Association (IFA). Since then, similar expert surveys have been carried out and published every two to four years in the main fertilizer-consuming countries. Since 2008 IFA has led these efforts and, to our knowledge, remains the only globally available data set on FUBC. This dataset includes data (in CSV format) from a survey carried out by IFA to represent the 2017-18 period as well as a collation of all historic FUBC data.