[StarCluster] Delay when using Sun Grid Engine

Jesse Lu jesselu at stanford.edu
Wed Sep 5 13:10:47 EDT 2012


Okay, so it turns out that scheduling-on-demand is turned on by default,
and any additional delays are eliminated by setting the scheduler_interval
to 0:0:1.

However, if I run in a parallel environment (e.g. qsub -pe orte ...) then
there is an approximately 40 sec delay after job completion. That is to
say, the job has technically finished, although qstat still lists it as
running, and subsequent jobs are held up. Any ideas?

Thanks in advance!

On Tue, Sep 4, 2012 at 5:33 PM, Rayson Ho <raysonlogin at gmail.com> wrote:

> That's the default scheduling time, and if you really want the
> scheduler to react to your qsub requests ASAP, you can turn on
> "scheduling-on-demand":
>
> http://gridscheduler.sourceforge.net/howto/tuning.html
>
> And in OGS/GE 2011.11 u1 p1 (we need a better name), the time it takes
> to report job done should be reduced.
>
> Rayson
>
> ==================================================
> Open Grid Scheduler - The Official Open Source Grid Engine
> http://gridscheduler.sourceforge.net/
>
>
>
> On Tue, Sep 4, 2012 at 8:05 PM, Jesse Lu <mr.jesselu at gmail.com> wrote:
> > Yes! Exactly.
> >
> > -- Jesse
> > ________________________________
> > On Sep 4, 2012 4:19 PM, Rayson Ho <raysonlogin at gmail.com> wrote:
> >
> > Hi Jesse,
> >
> > Are you referring to the scheduling time of Grid Engine??
> >
> > Rayson
> >
> > ==================================================
> > Open Grid Scheduler - The Official Open Source Grid Engine
> > http://gridscheduler.sourceforge.net/
> >
> >
> > On Tue, Sep 4, 2012 at 6:37 PM, Jesse Lu <jesselu at stanford.edu> wrote:
> >> Hi StarCluster users,
> >>
> >> I've noticed long delays with Sun Grid Engine when submitting jobs and
> >> especially after job execution. Even running a simple "hostname" job
> takes
> >> several seconds. Moreover, running an MPI version of "hostname" can
> take 2
> >> minutes!!
> >>
> >> Can someone help me get rid of this delay? Thank you.
> >>
> >> Jesse
> >>
> >> _______________________________________________
> >> StarCluster mailing list
> >> StarCluster at mit.edu
> >> http://mailman.mit.edu/mailman/listinfo/starcluster
> >>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20120905/44ff41ee/attachment.htm


More information about the StarCluster mailing list