A Novel Statistical and Neural Network Combined Approach for the Cloud Spot Market

ABSTRACT

The price of virtual machine instances in the Amazon EC2 spot model is often much lower than in the on-demand counterpart. However, this price reduction comes with a decrease in the availability guarantees. Several mechanisms have been proposed to analyze the spot model in the last years, employing different strategies. To our knowledge, there is no work that accurately captures the trade-off between spot price and availability, for short term analysis, and does long term analysis for spot price tendencies, in favor of user decision making. In this work, we propose (a) a utility-based strategy, that balances cost and availability of spot instances and is targeted to short-term analysis, and (b) a LSTM (Long Short Term Memory) neural network framework for long term spot price tendency analysis. Our experiments show that, for r4.2xlarge, 90 percent of spot bid suggestions ensured at least 5.73 hours of availability in the second quarter of 2020, with a bid price of approximately 38 percent of the on-demand price. The LSTM experiments were able to predict spot prices tendencies for several instance types with very low error. Our LSTM framework predicted an average value of 0.19 USD/hour for the r5.2xlarge instance type (Mean Squared Error [Formula Omitted]) for a 7-day period of time, which is about 37 percent of the on-demand price. Finally, we used our combined mechanism on an application that compares thousands of SARS-CoV-2 DNA sequences and show that our approach is able to provide good choices of instances, with low bids and very good availability.