[StarCluster] about using the cg1.4xlarge or cc1.4xlarge instances

Justin Riley jtriley at MIT.EDU
Wed Dec 1 11:23:39 EST 2010


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Moussa,

The current stable version of StarCluster doesn't support the new
cg1/cc1 instance types. The latest github code
(http://github.com/jtriley/StarCluster) does have support for these new
instance types. I recently created a new StarCluster HVM AMI for Cluster
Compute/GPU instance types that has the same software stack as the
paravirtual AMIs and also includes the NVIDIA Driver/CUDA
toolkit/PyCuda/PyOpenCL for GPU programming.

I haven't made the AMI public yet given that 0.91.2 doesn't support the
new types but if you want to test the latest github code with the new
HVM AMI, send me your AWS user id and I'll share the AMI with you. This
goes for anyone else interested in testing the new Cluster Compute/GPU
support as well.

~Justin

On 11/29/2010 01:29 PM, Moussa Taifi wrote:
> Hello,
> 
> I am kind of new to this.
> 
> I was trying to use the starcluster with the new cg1.4xlarge instances
> but I found out that the images that are provided as example
> (ami-a5c42dcc and ami-d1c42db8) are both paravirtual while the cluster
> instances require hvm, hardware virtualization. not that I understand
> fully all this yet but is there anyone that had this problem? and is
> there an ami available to use for the cluster instances that is at the
> same time configured like the available amis?
> 
> Thank you,
> 
> Moussa 
> 
> On Sat, Nov 27, 2010 at 12:21 PM, <starcluster-request at mit.edu
> <mailto:starcluster-request at mit.edu>> wrote:
> 
>     Send StarCluster mailing list submissions to
>            starcluster at mit.edu <mailto:starcluster at mit.edu>
> 
>     To subscribe or unsubscribe via the World Wide Web, visit
>            http://mailman.mit.edu/mailman/listinfo/starcluster
>     or, via email, send a message with subject or body 'help' to
>            starcluster-request at mit.edu <mailto:starcluster-request at mit.edu>
> 
>     You can reach the person managing the list at
>            starcluster-owner at mit.edu <mailto:starcluster-owner at mit.edu>
> 
>     When replying, please edit your Subject line so it is more specific
>     than "Re: Contents of StarCluster digest..."
> 
> 
>     Today's Topics:
> 
>       1. access cluster object from plugin (Dan Yamins)
>       2. Re: access cluster object from plugin (Justin Riley)
>       3. Re: access cluster object from plugin (Dan Yamins)
>       4. Re: access cluster object from plugin (Justin Riley)
> 
> 
>     ----------------------------------------------------------------------
> 
>     Message: 1
>     Date: Fri, 26 Nov 2010 18:19:51 -0500
>     From: Dan Yamins <dyamins at gmail.com <mailto:dyamins at gmail.com>>
>     Subject: [StarCluster] access cluster object from plugin
>     To: starcluster <starcluster at mit.edu <mailto:starcluster at mit.edu>>
>     Message-ID:
>            <AANLkTimC6Ox57-Pq+_FgGpaQyOary50MW4H7Fi_TDCSp at mail.gmail.com
>     <mailto:AANLkTimC6Ox57-Pq%2B_FgGpaQyOary50MW4H7Fi_TDCSp at mail.gmail.com>>
>     Content-Type: text/plain; charset="iso-8859-1"
> 
>     Hi Justin:
> 
>     Is there any way to access to the cluster object (and in particular the
>     cluster object's .ec2 attribute) from within the plugin?
> 
>     What I want to be able to do is modify the cluster permissions (e.g.
>     to open
>     a specific port) in the plugin logic ... I could do it via boto with the
>     cluster.ec2 object if that object is available ... or what is the right
>     way?
> 
>     Dan
>     -------------- next part --------------
>     An HTML attachment was scrubbed...
>     URL:
>     http://mailman.mit.edu/pipermail/starcluster/attachments/20101126/c15fd033/attachment-0001.htm
> 
>     ------------------------------
> 
>     Message: 2
>     Date: Fri, 26 Nov 2010 18:27:14 -0500
>     From: Justin Riley <jtriley at MIT.EDU <mailto:jtriley at MIT.EDU>>
>     Subject: Re: [StarCluster] access cluster object from plugin
>     To: starcluster at MIT.EDU <mailto:starcluster at MIT.EDU>
>     Message-ID: <4CF04252.9040304 at mit.edu <mailto:4CF04252.9040304 at mit.edu>>
>     Content-Type: text/plain; charset=ISO-8859-1; format=flowed
> 
>     On 11/26/10 6:19 PM, Dan Yamins wrote:
>     > Is there any way to access to the cluster object (and in particular
>     > the cluster object's .ec2 attribute) from within the plugin?
>     >
>     > What I want to be able to do is modify the cluster permissions (e.g.
>     > to open a specific port) in the plugin logic ... I could do it via
>     > boto with the cluster.ec2 object if that object is available ... or
>     > what is the right way?
> 
>     Assuming you're using the latest github code, each Node instance now has
>     an 'ec2' attribute the same as the Cluster class. So you could use
>     master.ec2.* in a plugin.
> 
>     ~Justin
> 
> 
>     ------------------------------
> 
>     Message: 3
>     Date: Fri, 26 Nov 2010 18:30:28 -0500
>     From: Dan Yamins <dyamins at gmail.com <mailto:dyamins at gmail.com>>
>     Subject: Re: [StarCluster] access cluster object from plugin
>     To: starcluster at mit.edu <mailto:starcluster at mit.edu>
>     Message-ID:
>            <AANLkTin8698PjstJS7iLi-Zg4=64aT65zAyUPDB1v232 at mail.gmail.com
>     <mailto:64aT65zAyUPDB1v232 at mail.gmail.com>>
>     Content-Type: text/plain; charset="iso-8859-1"
> 
>     Great thanks.
> 
>     Hope you (and all on this list) had a great Thanksgiving!
> 
>     Dan
> 
>     On Fri, Nov 26, 2010 at 6:27 PM, Justin Riley <jtriley at mit.edu
>     <mailto:jtriley at mit.edu>> wrote:
> 
>     > On 11/26/10 6:19 PM, Dan Yamins wrote:
>     > > Is there any way to access to the cluster object (and in particular
>     > > the cluster object's .ec2 attribute) from within the plugin?
>     > >
>     > > What I want to be able to do is modify the cluster permissions (e.g.
>     > > to open a specific port) in the plugin logic ... I could do it via
>     > > boto with the cluster.ec2 object if that object is available ... or
>     > > what is the right way?
>     >
>     > Assuming you're using the latest github code, each Node instance
>     now has
>     > an 'ec2' attribute the same as the Cluster class. So you could use
>     > master.ec2.* in a plugin.
>     >
>     > ~Justin
>     > _______________________________________________
>     > StarCluster mailing list
>     > StarCluster at mit.edu <mailto:StarCluster at mit.edu>
>     > http://mailman.mit.edu/mailman/listinfo/starcluster
>     >
>     -------------- next part --------------
>     An HTML attachment was scrubbed...
>     URL:
>     http://mailman.mit.edu/pipermail/starcluster/attachments/20101126/a30a27fc/attachment-0001.htm
> 
>     ------------------------------
> 
>     Message: 4
>     Date: Fri, 26 Nov 2010 18:32:02 -0500
>     From: Justin Riley <jtriley at MIT.EDU <mailto:jtriley at MIT.EDU>>
>     Subject: Re: [StarCluster] access cluster object from plugin
>     To: starcluster at MIT.EDU <mailto:starcluster at MIT.EDU>
>     Message-ID: <4CF04372.3040106 at mit.edu <mailto:4CF04372.3040106 at mit.edu>>
>     Content-Type: text/plain; charset=ISO-8859-1; format=flowed
> 
>     On 11/26/10 6:19 PM, Dan Yamins wrote:
>     >
>     > What I want to be able to do is modify the cluster permissions (e.g.
>     > to open a specific port) in the plugin logic ... I could do it via
>     > boto with the cluster.ec2 object if that object is available ... or
>     > what is the right way?
>     I assume you don't know the permissions you need before runtime and this
>     is why you're needing to modify security group permission settings in a
>     plugin. Just as a reminder, if you *do* know the permissions you can use
>     the new [permission] config settings.
> 
>     ~Justin
> 
> 
>     ------------------------------
> 
>     _______________________________________________
>     StarCluster mailing list
>     StarCluster at mit.edu <mailto:StarCluster at mit.edu>
>     http://mailman.mit.edu/mailman/listinfo/starcluster
> 
> 
>     End of StarCluster Digest, Vol 15, Issue 10
>     *******************************************
> 
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkz2dosACgkQ4llAkMfDcrnBQgCfYbZcO5Wb+wDFSXdUnd5si+fy
7KcAoJQMiU9lB40oZfkV1nW5raBK4+o9
=g05z
-----END PGP SIGNATURE-----



More information about the StarCluster mailing list