Runtime Prediction Based Grid Scheduling of Parameter Sweep Jobs

Abstract

This paper examines the problem of predicting job runtimes by exploiting the properties of parameter sweeps. A new parameter sweep prediction framework GIPSy (Grid Information Prediction System) is introduced. Predictions are made based on prior runtime information and the parameters used to configure each job. The main objective is providing a tool combining development, simulation and application of prediction models within one framework. The different kinds of available sample selectors and models are discussed in detail. Results are presented for a quantum physics problem. A previously introduced scheduling technique and the implementation called PGS (Prediction based Grid Scheduling) is improved and presented in combination with GIPSy to obtain a realworld grid implementation that optimizes the distribution of parameter sweeps.