<br><div class="gmail_quote"><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br>
We do have support for even more fine grained control of node instance types (thanks to Dan Yamins) if it's needed,</blockquote><div><br>The syntax is pretty simple (correct me where I go wrong, Justin). It is basically governed y the following rules:<br>
<br>1) To specify N instance-types "type1', ... "typeN", with specific AMIs and number of nodes for each type, you use a comma-separated list of elements, with ":"-separation between declarations for instance type, AMI ID, and number of nodes, e.g.:<br>
<br> NODE_INSTANCE_TYPE = type1 : ami1 : num1 , type2 : ami2 : num 2, ... , typeN : amiN : numN<br><br><br>2) The AMI specification is optional, e.g. <br><br> NODE_INSTANCE_TYPE = type1 : num1 , type2 : num 2, ... , typeN : numN<br>
<br>is a valid specification, with the effect that all instances will use the ami specified by NODE_IMAGE_ID. <br><br><br>3) The num specification is optional as well, e.g. <br> <br> NODE_INSTANCE_TYPE = type1, type2, ... , typeN<br>
<br>is a valid specification, with the effect of bringing up 1 node each for type1, type2, ...typeN-1. If numN is unspecified, it is automatically set to<br>
<br>
numN = CLUSTER_SIZE - num1 - num2 ... - numN-1<br>
<br><br>4) The numbers num1, num2, ... numN, must satisfy;<br><br> CLUSTER_SIZE = num1 + num2 + ... + numN<br><br>If you specify too many or too few nodes, an error will be thrown.<br><br><br>Examples:<br><br>######### this sets up a 4-node cluster with 1 m1.large, 1 c1.xlarge, and 3 m1.xlarge<br>
CLUSTER_SIZE = 5<br>NODE_INSTANCE_TYPE = m1.large,c1.xlarge,m1.xlarge<br>#########<br><br>######### this sets up a 10-node cluster with 4 m1.large, 4 c1.xlarge, and 2 m1.xlarge<br>
CLUSTER_SIZE = 10<br>
NODE_INSTANCE_TYPE = m1.large : 4 , c1.xlarge : 4 ,m1.xlarge<br>
#########<br><br><br>######### this sets up a 10-node cluster with 4 m1.large using ami ami-7aca2213, <br>######### and 6 c1.xlarge using the AMI specified by NODE_IMAGE ID<br>
CLUSTER_SIZE = 10<br>
NODE_INSTANCE_TYPE = m1.large : ami-7aca2213: 4 , c1.xlarge <br>
#########<br>
<br><br>######### this generates an error<br>
CLUSTER_SIZE = 5<br>
NODE_INSTANCE_TYPE = m1.large : 4 , c1.xlarge : 4<br>
#########<br><br>If yo have any questions, feel free to ask<br><br>Dan<br><br><br><br><br> </div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
however, I haven't yet documented this functionality. Let me know if the above doesn't meet your needs and I'll fill you in.<br>
<br>
~Justin<br>
________________________________________<br>
From: <a href="mailto:starcluster-bounces@MIT.EDU">starcluster-bounces@MIT.EDU</a> [<a href="mailto:starcluster-bounces@MIT.EDU">starcluster-bounces@MIT.EDU</a>] On Behalf Of Hesselberth, Jay [<a href="mailto:JAY.HESSELBERTH@ucdenver.edu">JAY.HESSELBERTH@ucdenver.edu</a>]<br>
Sent: Monday, August 09, 2010 3:30 PM<br>
To: <a href="mailto:starcluster@mit.edu">starcluster@mit.edu</a><br>
Subject: [Starcluster] Cluster with mixed NODE_INSTANCE_TYPE's<br>
<div><div></div><div class="h5"><br>
I have an application where I'm running 1000's of jobs with small memory requirements (e.g. ~500 Mb / job), but there is a periodic job that needs substantially more RAM (~8 Gb). I've been running clusters with c1.xlarge instances to maximize throughput of the small jobs, but these don't have the necessary RAM.<br>
<br>
I was thinking it would be nice to specify clusters with mixed NODE_INSTANCE_TYPES; e.g. configuring a cluster with 4 c1.xlarge instances for throughput and 1 m2.xlarge instance to handle large RAM jobs. I don't see how this is currently possible (I'm using the experimental starcluster branch). Is a feature that is planned for the future?<br>
<br>
Thanks,<br>
Jay Hesselberth<br>
_______________________________________________<br>
Starcluster mailing list<br>
<a href="mailto:Starcluster@mit.edu">Starcluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
<br>
_______________________________________________<br>
Starcluster mailing list<br>
<a href="mailto:Starcluster@mit.edu">Starcluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
</div></div></blockquote></div><br>