[StarCluster] Starcluster and elastic load balancing

Rajat Banerjee rbanerj at fas.harvard.edu
Fri Feb 4 16:07:16 EST 2011


Hi Archie,
I believe you are correct. I can't find the date on which 0.91.2 was cut,
but if it doesn't have the "bal" or "loadbalance", then you're not running
new enough code.

That can be rectified if your admin installs with these directions:
http://web.mit.edu/stardev/cluster/docs/installation.html#install-development-version-from-github

And the result should look something like this:

$ starcluster bal
Leopard libedit detected.
StarCluster - (http://web.mit.edu/starcluster) (v. 0.9999)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster at mit.edu

Usage: loadbalance <cluster_tag>

    Start the SGE Load Balancer.

starcluster: error: please specify a <cluster_tag>

rbanerjee:/opt/pose/core [SVN: /main/core/trunk]
$ starcluster loadbalance
Leopard libedit detected.
StarCluster - (http://web.mit.edu/starcluster) (v. 0.9999)
Software Tools for Academics and Researchers (STAR)
Please submit bug reports to starcluster at mit.edu

Usage: loadbalance <cluster_tag>

    Start the SGE Load Balancer.

starcluster: error: please specify a <cluster_tag>


Best,
Rajat


On Fri, Feb 4, 2011 at 3:56 PM, Archie Russell <archier at gmail.com> wrote:

> Hi Rajat
>
> My version doesn't have "bal",   does that mean it is not the most recent
> version
> from github?  (our  system administrator installed it and may have missed
> that detail).
>
> Is there a version string to look for?
>
> $ starcluster bal mycluster -m 10 -n 2
> StarCluster - (http://web.mit.edu/starcluster)
> Software Tools for Academics and Researchers (STAR)
> Please submit bug reports to starcluster at mit.edu
>
> Error: invalid command 'bal'
>
>
> $ starcluster --version
> StarCluster - (http://web.mit.edu/starcluster)
> Software Tools for Academics and Researchers (STAR)
> Please submit bug reports to starcluster at mit.edu
>
> 0.91.2
>
>
> -A
>
>
> On Fri, Jan 28, 2011 at 10:31 AM, Rajat Banerjee <rbanerj at fas.harvard.edu>wrote:
>
>> Hi Archie,
>> Yes, there is ELB built into the latest releases of StarCluster. I wrote
>> it, so feel free to write me (+ the list) with any questions.
>>
>> The docs on
>> http://web.mit.edu/stardev/cluster/docs/index.html
>>
>> haven't been updated in a while. There is a documentation page on
>> starcluster in the code base, see
>> /starcluster/StarCluster/docs/sphinx/load_balancer.rst
>>
>> That doc should have all of the information you need, and is readable in
>> plain text.
>>
>> Typically, this is how I fire up the load balancer:
>> starcluster bal <cluster_tag> -m <MAX_NODES you want> -n <MIN_NODES you
>> want>
>>
>> It will poll the cluster every 60 seconds and make decisions. The
>> decisions are described in load_balancer.rst. There is a visualizer which
>> makes 6 graphs with matplotlib to show you how many nodes are working, how
>> many jobs are running, queued, avg load, etc, but the visualizer still needs
>> a little bit of work.
>>
>> Hope that helps, and feel free to send back questions.
>> Rajat Banerjee
>>
>>
>> On Fri, Jan 28, 2011 at 12:29 PM, <starcluster-request at mit.edu> wrote:
>>
>>> Send StarCluster mailing list submissions to
>>>        starcluster at mit.edu
>>>
>>> To subscribe or unsubscribe via the World Wide Web, visit
>>>        http://mailman.mit.edu/mailman/listinfo/starcluster
>>> or, via email, send a message with subject or body 'help' to
>>>        starcluster-request at mit.edu
>>>
>>> You can reach the person managing the list at
>>>        starcluster-owner at mit.edu
>>>
>>> When replying, please edit your Subject line so it is more specific
>>> than "Re: Contents of StarCluster digest..."
>>>
>>> Today's Topics:
>>>
>>>   1. Starcluster and elastic load balancing (Archie Russell)
>>>
>>>
>>>
>>> ---------- Forwarded message ----------
>>> From: Archie Russell <archier at gmail.com>
>>> To: starcluster at mit.edu
>>> Date: Thu, 27 Jan 2011 11:40:00 -0800
>>> Subject: [StarCluster] Starcluster and elastic load balancing
>>>
>>> Hi,
>>>
>>> Online it says Starcluster has Elastic Load Balancing built into the
>>> latest code
>>> version at Github.     How would I go about using this?     How does
>>> it work,  e.g.
>>> when does it fire up new nodes and when does it shut them down?
>>>
>>> Thanks,
>>> Archie
>>>
>>> _______________________________________________
>>> StarCluster mailing list
>>> StarCluster at mit.edu
>>>
>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>>
>>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20110204/3b78c564/attachment.htm


More information about the StarCluster mailing list