[StarCluster] Starcluster, etc., in Public AMI?

Lyn Gerner schedulerqueen at gmail.com
Thu Oct 17 00:55:14 EDT 2013


Thanks for the additional perspective, Jacob.

Best,
Lyn


On Wed, Oct 16, 2013 at 2:57 PM, Jacob Barhak <jacob.barhak at gmail.com>wrote:

> Hi Lyn,
>
> The advantage of using the Anaconda solution is that you can upgrade the
> python libraries and keep a python version with all the library versions
> you like through easy install, pip install, and conda commands. You don't
> need a new AMI copy if you decide to upgrade starcluster there.
>
> I believe you can control such things from the configuration file. Yet I
> did not try it so correct me if I am wrong.
>
> I hope this helps you decide better.
>
>        Jacob
>
> Sent from my iPhone
>
> On Oct 16, 2013, at 7:50 PM, Lyn Gerner <schedulerqueen at gmail.com> wrote:
>
> Thanks, Rayson and Jacob.
>
> I already have an AMI I'm developing for the back end (SGE) nodes; was
> hoping to not have to do another one (under a crunched schedule at this
> point).
>
> Jacob, will let you know if I use the Anaconda image you've pointed to.
>
> Thanks,
> Lyn
>
>
> On Wed, Oct 16, 2013 at 2:15 PM, Jacob Barhak <jacob.barhak at gmail.com>wrote:
>
>> Hi Lyn,
>>
>> The Anaconda AMI that I am using has the capability to easy_install or
>> pip install. See:
>> https://github.com/ContinuumIO/anaconda-ec2/blob/master/README.md
>>
>> Therefore it is one shell command away from what you need.
>>
>> However, I did encounter issues with easy install with version 0.94 of
>> starcluster. I did not check the new version yet I saw something on the
>> list.
>>
>> If you try it, let us know if it works for you.
>>
>>            Jacob
>>
>> Sent from my iPhone
>>
>> On Oct 16, 2013, at 6:16 PM, Lyn Gerner <schedulerqueen at gmail.com> wrote:
>>
>> Hi All,
>>
>> Is there a public, paravirtual, relatively recent Linux AMI out there
>> that has starcluster built into it?  I'd like to integrate a
>> web-front-end/SQL cluster with a back-end SGE compute cluster by having the
>> former launch the latter.
>>
>> More generally, is there an AMI that already has the ec2-api and ec2-ami
>> command-line tools, aws, s3cmd, etc., in addition to starcluster, built
>> into it?
>>
>> Would love to not reinvent the wheel to the greatest extent possible.
>>  Thanks for any pointers.
>>
>> Best,
>> Lyn
>>
>> _______________________________________________
>>
>> StarCluster mailing list
>> StarCluster at mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20131016/cb4c0cdd/attachment.htm


More information about the StarCluster mailing list