Technology requirements for supporting on-demand interactive grid computing

Albert I. Reuther, Tim Currie, Jeremy Kepner, Hahn G. Kim, Andrew McCabe, Peter Michaleas, Nadya Travinin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Scopus citations

Abstract

It is increasingly being recognized that a large pool of High Performance Computing (HPC) users requires interactive, on-demand access to HPC resources. How to provide these resources is a significant technical challenge that can be addressed from two directions. The first approach is to adapt existing batch queue based HPC systems to make them more interactive. The second approach is to start with existing interactive desktop environments (e.g., MATLAB®) and design a system from the ground up that allows interactive parallel computing. The Lincoln Laboratory Grid (LLGrid) project has taken the latter approach. The LLGrid system has been operational for over a year with a few hundred processors and roughly 70 users, having run over 13,000 interactive jobs and consumed approximately 10,000 processor days of computation. This paper compares the on-demand and interactive computing features of four prominent batch queuing systems: openPBS, Sun GridEngine, Condor, and LSF. It goes on to briefly describe the LLGrid system, and how interactive, on-demand computing was achieved on it by binding to a resource management system. Finally, usage characteristics of the LLGrid system are discussed.

Original languageEnglish (US)
Title of host publicationDoD High Performance Computing Modernization Program
Subtitle of host publicationProceedings of the HPCMP Users Group Conference 2005
Pages320-327
Number of pages8
DOIs
StatePublished - Dec 1 2005
Externally publishedYes
EventDepartment of Defense High Performance Computing Modernization Program: HPCMP Users Group Conference 2005 - Nashville, TN, United States
Duration: Jun 27 2005Jun 30 2005

Publication series

NameDepartment of Defense High Performance Computing Modernization Program: Proceedings of the HPCMP Users Group Conference 2005
Volume2005

Other

OtherDepartment of Defense High Performance Computing Modernization Program: HPCMP Users Group Conference 2005
Country/TerritoryUnited States
CityNashville, TN
Period6/27/056/30/05

Keywords

  • Cluster computing
  • Grid computing
  • Interactive high performance computing
  • On-demand
  • Parallel MATLAB

ASJC Scopus subject areas

  • General Engineering

Fingerprint

Dive into the research topics of 'Technology requirements for supporting on-demand interactive grid computing'. Together they form a unique fingerprint.

Cite this