[StarCluster] Changing iinstance type for everynode in the cluster

[Rayson Ho]

Hugh, thanks for testing instance type change, it was very late last night
and I did not have time to test it.

Ramon, we can add code in StarCluster to provide support for instance type
change, and in my original email I wanted to point out that you need to use
StarCluster to stop the cluster first, as changing the instance type means
changing the IP of the instance too, and thus a change of instance type
without letting StarCluster know wouldn't work.

Rayson

==================================================
Open Grid Scheduler - The Official Open Source Grid Engine
http://gridscheduler.sourceforge.net/
http://gridscheduler.sourceforge.net/GridEngine/GridEngineCloud.html

On Thu, Sep 18, 2014 at 10:22 AM, MacMullan, Hugh <hughmac at wharton.upenn.edu
> wrote:

>  Wow, I can't believe I never thought of that. Just tested c3.large >
> c3.8xlarge transformation, and it worked just fine … AWS CLI for the
> command line win!
>
>
>
> starcluster start -i c3.large -c mycluster mycluster
>
> starcluster stop -c mycluster
>
> starcluster lc ## wait till the nodes are all 'stopped'
>
> for ID in $(starcluster lc mycluster 2>/dev/null | grep -e
> node[0-9][0-9][0-9] -e master | awk '{print $3}'); do
>
>    echo $ID
>
>    # the magic:
>
>    aws ec2 modify-instance-attribute --instance-id $ID --instance-type
> c3.8xlarge
>
> done
>
> starcluster start -x mycluster
>
>
>
> Seems like that could be pretty easily integrated into StarCluster.
>
>
>
> -Hugh
>
>
>
> *From:* Rayson Ho [mailto:raysonlogin at gmail.com]
> *Sent:* Thursday, September 18, 2014 1:18 AM
> *To:* Ramon Ramirez-Linan
> *Cc:* MacMullan, Hugh; starcluster at mit.edu
> *Subject:* Re: [StarCluster] Changing iinstance type for everynode in the
> cluster
>
>
>
> I've never tried something like this myself, but I believe it would work
> if you stop the EBS cluster (*NOT* terminate), and then change the instance
> type from the EC2 management Console, and then restart the cluster, then
> StarCluster would happily reconfig the cluster for you:
>
>
> http://star.mit.edu/cluster/docs/latest/manual/launch.html#stopping-an-ebs-backed-cluster
>
> Just a reboot won't do it, as the private IP address changes when you
> change the instance type, and /etc/hosts would need to be changed again.
>
> (Test with a 2-node t1.micro cluster and change the type to t2.micro
> before doing anything experimental on a real production cluster.)
>
>
>  Rayson
>
>
>
>
> On Wed, Sep 17, 2014 at 10:53 PM, Ramon Ramirez-Linan <rlinan at navteca.com>
> wrote:
>
>  Hi,
>
>
>
> Is there a way of changing the instance type for the entire cluster after
> it has already be launched?
>
>
>
> I want to launch a 30  nodes cluster with a cheaper instance type to
> ingest data on each node's volume. Each node has a 1TB EBS attached and
> there is no need to share data between nodes (no nfs or anything). Then
> once the data is injected on each node I want to be able to change the
> cluster instances to a more expensive one (more CPU/RAM)
>
>
>
> Will cluster reboot let me do that?
>
>
>
> Thanks in advance
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20140918/40f8bc4c/attachment.htm