<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Oops… here is a blog post of his regarding how he tested a 10,000 node cluster on EC2:
<a href="http://blogs.scalablelogic.com/2012/11/running-10000-node-grid-engine-cluster.html">
http://blogs.scalablelogic.com/2012/11/running-10000-node-grid-engine-cluster.html</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">~Steve<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> starcluster-bounces@mit.edu [mailto:starcluster-bounces@mit.edu]
<b>On Behalf Of </b>Steve Darnell<br>
<b>Sent:</b> Friday, November 07, 2014 3:42 PM<br>
<b>To:</b> Rajat Banerjee; Ramon Ramirez-Linan<br>
<b>Cc:</b> starcluster@mit.edu<br>
<b>Subject:</b> Re: [StarCluster] cluster creation best practice<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi Ramon,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">As to best practices for starting a large cluster, Rayson has been an advocate for starting a small cluster (5-10 nodes) and then growing the cluster size using
the elastic load balancer functionality in StarCluster (<a href="http://star.mit.edu/cluster/docs/latest/manual/load_balancer.html">http://star.mit.edu/cluster/docs/latest/manual/load_balancer.html</a>).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Here is a blog post of his regarding how he tested a 10,000 node cluster on EC2.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Best regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Steve<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">
<a href="mailto:starcluster-bounces@mit.edu">starcluster-bounces@mit.edu</a> [<a href="mailto:starcluster-bounces@mit.edu">mailto:starcluster-bounces@mit.edu</a>]
<b>On Behalf Of </b>Rajat Banerjee<br>
<b>Sent:</b> Friday, November 07, 2014 3:23 PM<br>
<b>To:</b> Ramon Ramirez-Linan<br>
<b>Cc:</b> <a href="mailto:starcluster@mit.edu">starcluster@mit.edu</a><br>
<b>Subject:</b> Re: [StarCluster] cluster creation best practice<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Are you requesting a particular type of instance, or in an unusual region or AZ?
<br>
<br>
I work for AWS and though I have no definitive evidence, I doubt that you'd have difficulty launching most types of instances in any of the big regions, N. Virginia, Oregon, or Ireland.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Fri, Nov 7, 2014 at 2:49 PM, Ramon Ramirez-Linan <<a href="mailto:rlinan@navteca.com" target="_blank">rlinan@navteca.com</a>> wrote:<o:p></o:p></p>
<div>
<p class="MsoNormal">Jennifer,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks for your answer although I was aware of all those limits and in fact we requested the limit increased a while ago.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">My question was more about how to check if AWS has the resources that I need before asking StartCluster to start creating the cluster.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">If I need a 300 nodes cluster and it fails after 250 due to AWS not having enough availability of an instance type, I will still have to pay for the 250 nodes for at least an hour. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">After the 250 nodes have been created I have the option of keep trying to add more nodes to complete to 300 but I think to optimize the cost it would be better if I have a way of knowing in advance if AWS is going to have 300 EC2 for me.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">PS: I am an AWS Solutions Architect and my company is an APN and reseller partner. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Thu, Nov 6, 2014 at 12:30 PM, Jennifer Staab <<a href="mailto:jstaab@cs.unc.edu" target="_blank">jstaab@cs.unc.edu</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">AWS does put limits on resources any one AWS account can use (see <a href="http://docs.aws.amazon.com/general/latest/gr/aws_service_limits.html" target="_blank"><span style="color:#1155CC">here </span></a> for details). Specifically see
<a href="http://aws.amazon.com/ec2/faqs/#How_many_instances_can_I_run_in_Amazon_EC2" target="_blank">
here</a> for limits regarding EC2s. You can make requests to AWS to increase limit bounds. Also note there are certain actions AWS users are not allowed take (see <a href="http://aws.amazon.com/aup/" target="_blank"><span style="color:#1155CC">here</span></a>
), if you violate any of those policies Amazon has right to deny service to you.
<br>
<br>
And another thing to consider is the time of the year. AWS started because Amazon wanted to make more use of its resources when they were less than active. I'm not sure what proportion of AWS resources are still used by Amazon itself, but I would think with
holidays approaching the EC2s might be less than available as compared to the start of 2015.<br>
<br>
Good Luck.<br>
<br>
-Jennifer<br>
<br>
<br>
<br>
On 11/6/14 11:41 AM, Ramon Ramirez-Linan wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">I need to create a 300 nodes cluster. <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">1. if there a way to query AWS in advance to see if they have the 300 EC2 availables? I dont want to find out after 299 nodes that they out of that EC2 type. I am not sure if StarCluster already check for that.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">2. Would it be better to create the cluster with less nodes and then add them 20 at a time?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks in advance<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Ramon<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>StarCluster mailing list<o:p></o:p></pre>
<pre><a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><o:p></o:p></pre>
<pre><a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</body>
</html>