Investigating Machine Learning Algorithms for Modeling SSD I/O Performance for Container-based Virtualization - Advanced Connectivity Lab, IRT b<>com Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Cloud Computing Année : 2021

Investigating Machine Learning Algorithms for Modeling SSD I/O Performance for Container-based Virtualization

Résumé

One of the cornerstones of the cloud provider business is to reduce hardware resources cost by maximizing their utilization. This is done through smartly sharing processor, memory, network and storage, while fully satisfying SLOs negotiated with customers. For the storage part, while SSDs are increasingly deployed in data centers mainly for their performance and energy efficiency, their internal mechanisms may cause a dramatic SLO violation. In effect, we measured that I/O interference may induce a 10x performance drop. We are building a framework based on autonomic computing which aims to achieve intelligent container placement on storage systems by preventing bad I/O interference scenarios. One prerequisite to such a framework is to design SSD performance models that take into account interactions between running processes/containers, the operating system and the SSD. These interactions are complex. In this paper, we investigate the use of machine learning for building such models in a container based Cloud environment. We have investigated five popular machine learning algorithms along with six different I/O intensive applications and benchmarks. We analyzed the prediction accuracy, the learning curve, the feature importance and the training time of the tested algorithms on four different SSD models. Beyond describing modeling component of our framework, this paper aims to provide insights for cloud providers to implement SLO compliant container placement algorithms on SSDs. Our machine learning-based framework succeeded in modeling I/O interference with a median Normalized Root-Mean-Square Error (NRMSE) of 2.5%.
Fichier principal
Vignette du fichier
Investigating_Machine_Learning_Algorithms_for_Modeling_SSD_I_O_Performance_for_Container_based_Virtualization.pdf (1.8 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02013421 , version 1 (20-03-2019)

Identifiants

Citer

Jean-Emile Dartois, Jalil Boukhobza, Anas Knefati, Olivier Barais. Investigating Machine Learning Algorithms for Modeling SSD I/O Performance for Container-based Virtualization. IEEE Transactions on Cloud Computing, 2021, 9 (3), pp.1103-1116. ⟨10.1109/TCC.2019.2898192⟩. ⟨hal-02013421⟩
454 Consultations
948 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More