Evaluation of multi-hazard map produced using MaxEnt machine learning technique.

Natural hazards are diverse and uneven in time and space, therefore, understanding its complexity is key to save human lives and conserve natural ecosystems. Reducing the outputs obtained after each modelling analysis is key to present the results for stakeholders, land managers and policymakers. So, the main goal of this survey was to present a method to synthesize three natural hazards in one multi-hazard map and its evaluation for hazard management and land use planning. To test this methodology, we took as study area the Gorganrood Watershed, located in the Golestan Province (Iran). First, an inventory map of three different types of hazards including flood, landslides, and gullies was prepared using field surveys and different official reports. To generate the susceptibility maps, a total of 17 geo-environmental factors were selected as predictors using the MaxEnt (Maximum Entropy) machine learning technique. The accuracy of the predictive models was evaluated by drawing receiver operating characteristic-ROC curves and calculating the area under the ROC curve-AUCROC. The MaxEnt model not only implemented superbly in the degree of fitting, but also obtained significant results in predictive performance. Variables importance of the three studied types of hazards showed that river density, distance from streams, and elevation were the most important factors for flood, respectively. Lithological units, elevation, and annual mean rainfall were relevant for detecting landslides. On the other hand, annual mean rainfall, elevation, and lithological units were used for gully erosion mapping in this study area. Finally, by combining the flood, landslides, and gully erosion susceptibility maps, an integrated multi-hazard map was created. The results demonstrated that 60% of the area is subjected to hazards, reaching a proportion of landslides up to 21.2% in the whole territory. We conclude that using this type of multi-hazard map may be a useful tool for local administrators to identify areas susceptible to hazards at large scales as we demonstrated in this research.

Assessing the performance of GIS- based machine learning models with different accuracy measures for determining susceptibility to gully erosion.

The main purpose was to compare discrimination and reliability of four machine learning models to create gully erosion susceptibility map (GESM) in a part of Ekbatan Dam Basin, Hamedan, western Iran. Extensive field surveys using GPS, and the visual interpretation of satellite images, used to prepare a digital map of the spatial distribution of gullies. 130 locations were sampled to elucidate the spatial distribution of the soil surface properties. Topographic attributes were provided from digital elevation model (DEM). The land use and normalized difference vegetation index (NDVI) maps were created by satellite imagery. The functional relationships between gully erosion and controlling factors were calculated using the random forest (RF), support vector machine (SVM), Naïve Bayes (NB), and generalized additive model (GAM) models. The performance of models was evaluated by 10-fold cross-validation based on efficiency, Kappa coefficient, receiver operating characteristic curve (ROC), mean absolute error (MAE), and root mean square error (RMSE). The results showed that the RF model had the highest amount of efficiency, Kappa coefficient, and AUC and the lowest amounts of MAE and RMSE compared with SVM, NB, and GAM. The RF model showed the highest predictive performance (mean AUC = 92.4%), followed by SVM (mean AUC = 90.9%), GAM (mean AUC = 89.9%), and NB (mean AUC = 87.2%) models. Overall accuracy of the models ranged from excellent (NB, GAM) to outstanding (RF, SVM) classes. The capacity of all models for creating GESM was quite stable when the calibration and validation samples were changed through10-fold cross-validation technique. According to variable importance analysis performed by RF model, the most important variables are distance from rivers, calcium carbonate equivalent (CCE), and topographic position index (TPI). The obtained maps can help identifying areas at risk of gully erosion and facilitate the implementation of plans for soil conservation and sustainable management.

PMT: New analytical framework for automated evaluation of geo-environmental modelling approaches.

Geospatial computation, data transformation to a relevant statistical software, and step-wise quantitative performance assessment can be cumbersome, especially when considering that the entire modelling procedure is repeatedly interrupted by several input/output steps, and the self-consistency and self-adaptive response to the modelled data and the features therein are lost while handling the data from different kinds of working environments. To date, an automated and a comprehensive validation system, which includes both the cutoff-dependent and -independent evaluation criteria for spatial modelling approaches, has not yet been developed for GIS based methodologies. This study, for the first time, aims to fill this gap by designing and evaluating a user-friendly model validation approach, denoted as Performance Measure Tool (PMT), and developed using freely available Python programming platform. The considered cutoff-dependent criteria include receiver operating characteristic (ROC) curve, success-rate curve (SRC) and prediction-rate curve (PRC), whereas cutoff-independent consist of twenty-one performance metrics such as efficiency, misclassification rate, false omission rate, F-score, threat score, odds ratio, etc. To test the robustness of the developed tool, we applied it to a wide variety of geo-environmental modelling approaches, especially in different countries, data, and spatial contexts around the world including, the USA (soil digital modelling), Australia (drought risk evaluation), Vietnam (landslide studies), Iran (flood studies), and Italy (gully erosion studies). The newly proposed PMT is demonstrated to be capable of analyzing a wide range of environmental modelling results, and provides inclusive performance evaluation metrics in a relatively short time and user-convenient framework whilst each of the metrics is used to address a particular aspect of the predictive model. Drawing on the inferences, a scenario-based protocol for model performance evaluation is suggested.

A comparison of statistical methods and multi-criteria decision making to map flood hazard susceptibility in Northern Iran.

In north of Iran, flood is one of the most important natural hazards that annually inflict great economic damages on humankind infrastructures and natural ecosystems. The Kiasar watershed is known as one of the critical areas in north of Iran, due to numerous floods and waste of water and soil resources, as well as related economic and ecological losses. However, a comprehensive and systematic research to identify flood-prone areas, which may help to establish management and conservation measures, has not been carried out yet. Therefore, this study tested four methods: evidential belief function (EBF), frequency ratio (FR), Technique for Order Preference by Similarity To ideal Solution (TOPSIS) and Vlse Kriterijumsk Optimizacija Kompromisno Resenje (VIKOR) for flood hazard susceptibility mapping (FHSM) in this area. These were combined in two methodological frameworks involving statistical and multi-criteria decision making approaches. The efficiency of statistical and multi-criteria methods in FHSM were compared by using area under receiver operating characteristic (AUROC) curve, seed cell area index and frequency ratio. A database containing flood inventory maps and flood-related conditioning factors was established for this watershed. The flood inventory maps produced included 132 flood conditions, which were randomly classified into two groups, for training (70%) and validation (30%). Analytical hierarchy process (AHP) indicated that slope, distance to stream and land use/land cover are of key importance in flood occurrence in the study catchment. In validation results, the EBF model had a better prediction rate (0.987) and success rate (0.946) than FR, TOPSIS and VIKOR (prediction rate 0.917, 0.888, and 0.810; success rate 0.939, 0.904, and 0.735, respectively). Based on their frequency ratio and seed cell area index values, all models except VIKOR showed acceptable accuracy of classification.