<div dir="ltr"><div>Rajat,</div><div><br></div><div>You are right, and it is not common to run out of capacity but not impossible, check the startcluster error bellow.</div><div><br></div>We use US-EAST region<div><br></div><div><blockquote type="cite" style="font-family:arial,sans-serif;font-size:12.6666669845581px"><div style="word-wrap:break-word"><blockquote type="cite"><div style="word-wrap:break-word"><div><font face="Menlo" color="#b51a00"><b>> Starting stopped node: node011</b></font></div><div><font face="Menlo" color="#b51a00"><b>>>> Starting stopped node: node012</b></font></div><div><font face="Menlo" color="#b51a00"><b>>>> Starting stopped node: node013</b></font></div><div><font face="Menlo" color="#b51a00"><b>!!! <span class="">ERROR</span> - InsufficientInstanceCapacity: We currently do not have sufficient c3.4xlarge capacity in the Availability Zone you requested (us-east-1b). Our system will be working on provisioning additional capacity. You can currently get c3.4xlarge capacity by not specifying an Availability Zone in your request or choosing us-east-1d, us-east-1a, us-east-1e.</b></font></div></div></blockquote></div></blockquote></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 7, 2014 at 4:22 PM, Rajat Banerjee <span dir="ltr"><<a href="mailto:rajatb@post.harvard.edu" target="_blank">rajatb@post.harvard.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Are you requesting a particular type of instance, or in an unusual region or AZ? <br><br>I work for AWS and though I have no definitive evidence, I doubt that you'd have difficulty launching most types of instances in any of the big regions, N. Virginia, Oregon, or Ireland.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 7, 2014 at 2:49 PM, Ramon Ramirez-Linan <span dir="ltr"><<a href="mailto:rlinan@navteca.com" target="_blank">rlinan@navteca.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Jennifer,<div><br></div><div>Thanks for your answer although I was aware of all those limits and in fact we requested the limit increased a while ago.</div><div><br></div><div>My question was more about how to check if AWS has the resources that I need before asking StartCluster to start creating the cluster.</div><div><br></div><div>If I need a 300 nodes cluster and it fails after 250 due to AWS not having enough availability of an instance type, I will still have to pay for the 250 nodes for at least an hour. </div><div>After the 250 nodes have been created I have the option of keep trying to add more nodes to complete to 300 but I think to optimize the cost it would be better if I have a way of knowing in advance if AWS is going to have 300 EC2 for me.</div><div><br></div><div><br></div><div><br></div><div>PS: I am an AWS Solutions Architect and my company is an APN and reseller partner. </div><div><br></div></div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Nov 6, 2014 at 12:30 PM, Jennifer Staab <span dir="ltr"><<a href="mailto:jstaab@cs.unc.edu" target="_blank">jstaab@cs.unc.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>AWS does put limits on resources any
one AWS account can use (see<span> </span><a href="http://docs.aws.amazon.com/general/latest/gr/aws_service_limits.html" style="color:rgb(17,85,204)" target="_blank">here<span> </span></a> for details).
Specifically see <a href="http://aws.amazon.com/ec2/faqs/#How_many_instances_can_I_run_in_Amazon_EC2" target="_blank">here</a>
for limits regarding EC2s. You can make requests to AWS to
increase limit bounds. Also note there are certain actions AWS
users are not allowed take (see<span> </span><a href="http://aws.amazon.com/aup/" style="color:rgb(17,85,204)" target="_blank">here</a><span>
)</span>, if you violate any of those policies Amazon has right
to deny service to you. <br>
<br>
And another thing to consider is the time of the year. AWS started
because Amazon wanted to make more use of its resources when they
were less than active. I'm not sure what proportion of AWS
resources are still used by Amazon itself, but I would think with
holidays approaching the EC2s might be less than available as
compared to the start of 2015.<br>
<br>
Good Luck.<br>
<br>
-Jennifer<br>
<br>
<br>
<br>
On 11/6/14 11:41 AM, Ramon Ramirez-Linan wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">I need to create a 300 nodes cluster.
<div><br>
</div>
<div>1. if there a way to query AWS in advance to see if they
have the 300 EC2 availables? I dont want to find out after 299
nodes that they out of that EC2 type. I am not sure if
StarCluster already check for that.</div>
<div><br>
</div>
<div>2. Would it be better to create the cluster with less nodes
and then add them 20 at a time?</div>
<div><br>
</div>
<div>Thanks in advance</div>
<div>Ramon</div>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>_______________________________________________
StarCluster mailing list
<a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a>
</pre>
</blockquote>
<br>
</div>
</blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br></div>