[StarCluster] Starcluster, etc., in Public AMI?

Jacob Barhak jacob.barhak at gmail.com
Wed Oct 16 20:57:19 EDT 2013


Hi Lyn,

The advantage of using the Anaconda solution is that you can upgrade the python libraries and keep a python version with all the library versions you like through easy install, pip install, and conda commands. You don't need a new AMI copy if you decide to upgrade starcluster there. 

I believe you can control such things from the configuration file. Yet I did not try it so correct me if I am wrong. 

I hope this helps you decide better. 

       Jacob

Sent from my iPhone

On Oct 16, 2013, at 7:50 PM, Lyn Gerner <schedulerqueen at gmail.com> wrote:

> Thanks, Rayson and Jacob.
> 
> I already have an AMI I'm developing for the back end (SGE) nodes; was hoping to not have to do another one (under a crunched schedule at this point).
> 
> Jacob, will let you know if I use the Anaconda image you've pointed to.
> 
> Thanks,
> Lyn 
> 
> 
> On Wed, Oct 16, 2013 at 2:15 PM, Jacob Barhak <jacob.barhak at gmail.com> wrote:
>> Hi Lyn,
>> 
>> The Anaconda AMI that I am using has the capability to easy_install or pip install. See:
>> https://github.com/ContinuumIO/anaconda-ec2/blob/master/README.md
>> 
>> Therefore it is one shell command away from what you need. 
>> 
>> However, I did encounter issues with easy install with version 0.94 of starcluster. I did not check the new version yet I saw something on the list.  
>> 
>> If you try it, let us know if it works for you. 
>> 
>>            Jacob
>> 
>> Sent from my iPhone
>> 
>> On Oct 16, 2013, at 6:16 PM, Lyn Gerner <schedulerqueen at gmail.com> wrote:
>> 
>>> Hi All,
>>> 
>>> Is there a public, paravirtual, relatively recent Linux AMI out there that has starcluster built into it?  I'd like to integrate a web-front-end/SQL cluster with a back-end SGE compute cluster by having the former launch the latter.
>>> 
>>> More generally, is there an AMI that already has the ec2-api and ec2-ami command-line tools, aws, s3cmd, etc., in addition to starcluster, built into it?  
>>> 
>>> Would love to not reinvent the wheel to the greatest extent possible.  Thanks for any pointers.
>>> 
>>> Best,
>>> Lyn
>>> _______________________________________________
>>> 
>>> StarCluster mailing list
>>> StarCluster at mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/starcluster
> 
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20131016/721fca03/attachment.htm


More information about the StarCluster mailing list