Welcome to DVMS Pages
DVMS stands for Distributed Virtual Machine Scheduler. It is a decentralized Java framework that performs dynamic scheduling of virtual machines by leveraging the scheduling policies implemented in Entropy.
When a node cannot guarantee the Quality of Service (QoS) for its hosted VMs or when it is under-utilized, it starts an iterative scheduling procedure (ISP) by querying its neighbor to find a better placement. If the request cannot be satisfied by the neighbor, it is forwarded to the following free one until the ISP succeeds. This approach allows each ISP to send requests only to a minimal number of nodes, thus decreasing the scheduling time without requiring a central point.
In addition, this approach allows several ISPs to occur independently at the same moment throughout the infrastructure. In other words, scheduling is performed on partitions of the system that are created dynamically, which significantly improves the reactivity of the system. It should be noted that nodes are reserved for exclusive use by a single ISP, in order to prevent conflicts that could occur if several ISPs performed concurrent operations on the same nodes or VMs.
Even if such a strategy allows to maintain a consistent state of the infrastructure, it may lead to deadlocks when all nodes are reserved by active ISPs. To tackle this issue, we propose a (distributed) deadlock prevention mechanism.
Research Fields
- Virtualization
- Distributed infrastructures
- Dynamic scheduling
- Multi-agent systems
- Event-based systems
- Cooperative systems
- Autonomous systems
- Scalability
- Reactivity
- Fault-tolerance & resilience
News
- July 2013 – Paper to be presented at ISPA 2013. [ HAL ]
- May 2013 – Demonstration at the SCALE challenge (CCGrid 2013). [ Presentation ]
- Deployment and scheduling of 1,731 VMs on 206 nodes (distributed across 4 geographical sites).
- February 2013 – Flavien QUESNEL successfully defended his Ph.D. thesis. [ Thesis | Presentation ] (French)
- January 2013 – Wrote a detailed formal correctness proof of the DVMS algorithms. [ PDF ]
- December 2012 – Demonstration at the Grid'5000 challenge. [ Presentation ]
- Deployment and scheduling of 960 VMs on 132 nodes (distributed across 4 geographical sites).
- October 2012 – Jonathan PASTOR started his Ph.D.
Achievements
- Development of a prototype that can be deployed on the Grid'5000 testbed; see the tutorial.
- Evaluated the prototype by means of in vivo experiments on the Grid'5000 testbed: Scheduling of 4,754 VMs hosted on 467 nodes (from 8 clusters geographically distributed on 4 sites).
- Evaluated the prototype by means of simulations with the SimGrid toolkit: Scheduling of 81,920 VMs hosted on 8,192 homogeneous nodes.
Ongoing Work
We are currently working on the implementation of new mechanisms into the DVMS prototype, in order to take into account the resilience concerns of the underlying infrastructure.
Publications
- Flavien QUESNEL, Adrien LÈBRE, Jonathan PASTOR, Mario SÜDHOLT, and Daniel BALOUEK. Advanced validation of the DVMS approach to fully distributed VM scheduling. In The 11th IEEE International Symposium on Parallel and Distributed Processing with Applications, Melbourne, Australia, July 2013. [ HAL ]
- Flavien QUESNEL. Toward Cooperative Management of Large-scale Virtualized Infrastructures: the Case of Scheduling / Vers une gestion coopérative des infrastructures virtualisées à large échelle : le cas de l'ordonnancement. PhD thesis, Ecole Nationale Supérieure des Mines de Nantes, Nantes, France, February 2013. [ Thesis | Presentation ] (French)
- Flavien QUESNEL, Adrien LÈBRE and Mario SÜDHOLT. Cooperative and Reactive Scheduling in Large-Scale Virtualized Platforms with DVMS. Concurrency and Computation: Practice and Experience. 2012. John Wiley and Sons. [ HAL | Wiley ]
- Flavien QUESNEL and Adrien LÈBRE. Cooperative Dynamic Scheduling of Virtual Machines in Distributed Systems. In Euro-Par 2011 Workshops, Part II, Vol. 7156 of Lecture Notes in Computer Science, August 2011. Springer. [ HAL | Springer ]
Advanced Material
- Detailed formal correctness proof of the DVMS algorithms. [ PDF ]
Authors and Contributors
- Adrien LÈBRE ( supervisor, has led the development of the prototypes )
- Jonathan PASTOR ( maintainer, has designed the current prototype in Scala )
- Flavien QUESNEL ( author, former maintainer + current contributor, designed a preliminary version of the prototype in Java )
- Mario SÜDHOLT ( contributor, has proved formally the correctness of the DVMS algorithms )
- Daniel BALOUEK ( contributor, helped with testing a preliminary version of the prototype on the Grid'5000 testbed )