Comparing Moab metascheduling to Condor and MCP (Modified Critical Path)

Project Information

Discipline
Computer Science (401) 
Orientation
Research 
Abstract

One of the key components of any grid system is a job scheduler that chooses proper resources based on the feature requirements of the jobs in the queues. FutureGrid gives us a unique opportunity to compare Moab metascheduling to other possible solutions in order to make informed decisions about the future of grid computing with respect to XD.

Intellectual Merit

Using a metascheduler in environments like the TeraGrid introduces many challenges due to the separate nature of the administration of the machines but metascheduling could allow a system like the TeraGrid to be more grid-like in terms of use.

Broader Impacts

This research will impact the TeraGrid and the XD systems.

Project Contact

Project Lead
Jenett Tillotson (jtillots) 
Project Manager
Jenett Tillotson (jtillots) 

Resource Requirements

Hardware System
  • sierra (IBM iDataPlex at SDSC)
 
Use of FutureGrid

I'm looking to compare Adaptive Computing's Moab metascheduler to Condor and MCP in terms of job throughput and cluster utilization. I'm also interested in how well Moab will work with a disparate group of admins all personally controlling their local machines but wanting to operate as a grid. This information will be directly used for evaluating future designs of the Teragrid. I'll be working very closely with Warren Smith.

Scale of Use

I'm going to be starting with 28 VMs - 8 computer nodes plus a head node will comprise a compute cluster and I will have three such clusters. I then need 1 VM to be the metascheduler. These can be nimbus VMs just fine - meaning they don't have to be persistent. I also would like external internet access to the head nodes and the metascheduler node, but I could be fine with external access to just the metascheduler. After initial testing, I will probably want to scale it up as large as I can, but that may not be necessary. I expect this research will take several months to accomplish.

Project Timeline

Submitted
11/09/2010 - 11:59 
»