[StarCluster] cluster creation best practice

Jennifer Staab jstaab at cs.unc.edu
Thu Nov 6 12:30:48 EST 2014


AWS does put limits on resources any one AWS account can use 
(seehere<http://docs.aws.amazon.com/general/latest/gr/aws_service_limits.html> for 
details). Specifically see here 
<http://aws.amazon.com/ec2/faqs/#How_many_instances_can_I_run_in_Amazon_EC2> 
for limits regarding EC2s. You can make requests to AWS to increase 
limit bounds. Also note there are certain actions AWS users are not 
allowed take (seehere <http://aws.amazon.com/aup/>), if you violate any 
of those policies Amazon has right to deny service to you.

And another thing to consider is the time of the year. AWS started 
because Amazon wanted to make more use of its resources when they were 
less than active.  I'm not sure what proportion of AWS resources are 
still used by Amazon itself, but I would think with holidays approaching 
the EC2s might be less than available as compared to the start of 2015.

Good Luck.

-Jennifer



On 11/6/14 11:41 AM, Ramon Ramirez-Linan wrote:
> I need to create a 300 nodes cluster.
>
> 1. if there a way to query AWS in advance to see if they have the 300 
> EC2 availables? I dont want to find out after 299 nodes that they out 
> of that EC2 type. I am not sure if StarCluster already check for that.
>
> 2. Would it be better to create the cluster with less nodes and then 
> add them 20 at a time?
>
> Thanks in advance
> Ramon
>
>
> _______________________________________________
> StarCluster mailing list
> StarCluster at mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20141106/ef80ec5a/attachment-0001.htm


More information about the StarCluster mailing list