[StarCluster] loadbalance removes nodes one at a time
Rajat Banerjee
rajatb at post.harvard.edu
Wed Oct 21 18:28:03 EDT 2015
Hi Ryan,
No real reason, except that Justin added remove_nodes more than a year
after I wrote the LB:
https://github.com/jtriley/StarCluster/blame/develop/starcluster/cluster.py#L200
So the loadbalancer uses remove_node() instead of remove_nodes() plural.
Me/You/Anyone else could modify and test the load balancer with the new
function, it should not be too difficult. I would be interested in adding
it but don't have a lot of spare time right now.
Best,
Raj
On Wed, Oct 21, 2015 at 3:11 PM, Ryan G <ngsbioinformatics at gmail.com> wrote:
> I'm using loadbalance to shrink my cluster after submitting a bunch of
> jobs. I noticed that StarClustser may identify a group of nodes that can
> be shutdown. It then shuts them down one by one by running each plugin for
> every node. Why not run the plugins once and remove the group of nodes at
> the same time? This seems a bit inefficient.
>
> _______________________________________________
> StarCluster mailing list
> StarCluster at mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20151021/c3d79477/attachment.html
More information about the StarCluster
mailing list