Combining Quick-Turnaround and Batch Workloads at ScaleNAS uses PBS Professional to schedule and manage the workload on Pleiades, an 11,000+ node 1B cluster. At this scale the user experience for quick-turnaround jobs can degrade, which led NAS initially to set up two separate PBS servers, each dedicated to a particular workload. Recently we have employed PBS hooks and scheduler modifications to merge these workloads together under one PBS server, delivering sub-1-minute start times for the quick-turnaround workload, and enabling dynamic management of the resources set aside for that workload.
Document ID
20120016619
Acquisition Source
Ames Research Center
Document Type
Presentation
Authors
Matthews, Gregory A. (Computer Sciences Corp. Moffett Field, CA, United States)