[StarCluster] Moving to ubuntu 14.04 Trusty

[Christopher Clearfield]

Hi All,
I've been poking around with Starcluster and think it's a fantastic tool.
Really nice work. It's very clean and understandable, and takes something
that's extremely complicated and makes it work. Kudos.

I'm trying to write some code in a local ipython notebook and run it on an
ec2 cluster The ipython plugin works great, I can connect and use basic
functionality just fine. However, I'm having some problems with version
mismatches, mostly with ipython, pandas, tables etc. being too old.

As you probably know, Ubuntu 13.04 is End of Life (EOL), which means that
even security updates aren't being propagated anymore. This also means that
it's difficult to install new versions through native package management
tools (though, of course, one can use pip for some of these things.)

What would be required to update to a more current version of ubuntu 14.04
(which will be supported until 2019), and perhaps update some software to
newer versions? Is this a huge undertaking? Is there something I could do
to help.

Also, where does the "soul" of starcluster live on the AMIs? I took a first
(very ugly) stab of rolling my own AMI built on  amazon's ubuntu 14.04
instances, mostly by using apt-get to install a list of packages I dumped
from ami-3393a45a (starcluster-base-ubuntu-13.04-x86_64). But obviously
this drops all optimization in how utilities like openblas were compiled
and configuration for things like condor.

Is there a straightforward way to proceed on this?

Thanks,
Chris Clearfield
Principal, System Logic <http://www.system-logic.com/>
(646) 543-4250
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20150724/a7e492e1/attachment.htm