[StarCluster] loadbalancer race condition with plugin.on_add_node()
Rajat Banerjee
rbanerj at fas.harvard.edu
Mon Feb 21 16:38:08 EST 2011
Hi Jeff,
Your assumption seems correct. I know a lot about ELB but very little about
plugins. I know Justin is still very busy so may not get to your question
soon.
>From the looks of things, you could add plugin code to:
starcluster/cluster.py : line 788-789
OR
starcluster/clustersetup.py: line 473
As a stop gap until there is time to add something more formal and check it
in.
Let us know if that works for you temporarily.
Raj
On Mon, Feb 21, 2011 at 2:50 PM, Jeff White <jeff at decide.com> wrote:
> I believe there is a race condition when nodes are added via the
> loadbalancer. The configured plugins are run after the new node is added to
> SGE. The issue is our plugin needs to do some setup on the new node before
> jobs get submitted to the new node. It would be better if plugins were run
> before the node is available to run jobs. If there is a use case for running
> a plugin after the node is added to SGE, then more hooks should be added,
> e.g. on_add_node_before_sge(), on_add_node_after_sge().
>
> jeff
>
> _______________________________________________
> StarCluster mailing list
> StarCluster at mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20110221/7372813b/attachment.htm
More information about the StarCluster
mailing list