[StarCluster] Re: Starcluster and elastic load balancing

[Rajat Banerjee]

Hi Archie,
Yes, there is ELB built into the latest releases of StarCluster. I wrote it,
so feel free to write me (+ the list) with any questions.

The docs on
http://web.mit.edu/stardev/cluster/docs/index.html

haven't been updated in a while. There is a documentation page on
starcluster in the code base, see
/starcluster/StarCluster/docs/sphinx/load_balancer.rst

That doc should have all of the information you need, and is readable in
plain text.

Typically, this is how I fire up the load balancer:
starcluster bal <cluster_tag> -m <MAX_NODES you want> -n <MIN_NODES you
want>

It will poll the cluster every 60 seconds and make decisions. The decisions
are described in load_balancer.rst. There is a visualizer which makes 6
graphs with matplotlib to show you how many nodes are working, how many jobs
are running, queued, avg load, etc, but the visualizer still needs a little
bit of work.

Hope that helps, and feel free to send back questions.
Rajat Banerjee


On Fri, Jan 28, 2011 at 12:29 PM, <starcluster-request at mit.edu> wrote:

> Send StarCluster mailing list submissions to
>        starcluster at mit.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
>        http://mailman.mit.edu/mailman/listinfo/starcluster
> or, via email, send a message with subject or body 'help' to
>        starcluster-request at mit.edu
>
> You can reach the person managing the list at
>        starcluster-owner at mit.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of StarCluster digest..."
>
> Today's Topics:
>
>   1. Starcluster and elastic load balancing (Archie Russell)
>
>
> ---------- Forwarded message ----------
> From: Archie Russell <archier at gmail.com>
> To: starcluster at mit.edu
> Date: Thu, 27 Jan 2011 11:40:00 -0800
> Subject: [StarCluster] Starcluster and elastic load balancing
>
> Hi,
>
> Online it says Starcluster has Elastic Load Balancing built into the
> latest code
> version at Github.     How would I go about using this?     How does
> it work,  e.g.
> when does it fire up new nodes and when does it shut them down?
>
> Thanks,
> Archie
>
> _______________________________________________
> StarCluster mailing list
> StarCluster at mit.edu
>
> http://mailman.mit.edu/mailman/listinfo/starcluster
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20110128/3e738882/attachment.htm