[StarCluster] starcluster-extras plugin project on git --- PackageLoader

Justin Riley jtriley at MIT.EDU
Sat Oct 23 13:44:57 EDT 2010


  Hi Austin,

Great, I'll set up a new starcluster-plugins repo this weekend and pull 
the code from your starcluster-extras project. Then we should be all set 
and I'll send out an email about forking this new repo for users who 
want to contribute new plugins.

>  Also, how on earth would I write a test for something like this
>  plugin?  Seems messy.

Well it is possible to script it out, however, even just testing that 
you can launch a cluster, install your packages using your 
cluster-install script, stop the cluster, start a new cluster and check 
that those packages were automatically installed without any user 
intervention would be enough. Doesn't have to be scripted.

~Justin


On 10/23/10 1:08 PM, Austin Godber wrote:
> Hi Justin,
>       Yeah, thats fine by me.  If you want, you can cherrypick from what
> I have done and go from there.  Making it a proper package and doing
> whatever you see fit.  I didn't quite get the packaging done.  Same goes
> for automatically copying the cluster-install, which is on my TODO list
> in the README.  I had kinda thought that copying the cluster-install
> would be easier after I made it package, thus forcing some structure on
> the directory layout ...
>
>       Also, how on earth would I write a test for something like this
> plugin?  Seems messy.
>
>       Just gimme a holler with instructions once you have em.
>
> Austin
>
> On 10/23/2010 12:49 PM, Justin Riley wrote:
>>     Austin,
>>
>> The starcluster-extras project is a good idea. I'm thinking about making
>> a starcluster-plugins project instead and having folks fork off that for
>> committing plugin code so that it's easier for me to absorb plugins into
>> the main code base (in the starcluster.plugins module) once they're been
>> tested and documented thoroughly. Would you be willing to use this model
>> instead of the starcluster-extras project you've created?
>>
>> Also, concerning your package installer plugin, it doesn't appear that
>> your plugin installs the 'cluster-install' script on the cluster so that
>> it can be used locally after, say, an sshmaster command. The plugin
>> should probably be modified to copy the script to /usr/bin and make it
>> executable. Nice plugin, thanks for sharing!
>>
>> ~Justin
>>
>> On 10/22/10 4:03 PM, Austin Godber wrote:
>>> Hello Folks,
>>>         I have just pushed the starcluster plugin I was working on to a
>>> project on git.  This is where I will push any plugins I add:
>>>
>>> http://github.com/godber/starcluster-extras
>>>
>>> There is only one plugin at the moment, the README is fairly
>>> descriptive, but to save you from clicking, what it does is provides a
>>> way to automatically install packages on cluster nodes.  Rather than
>>> specifying the package in a plugin configuration list (like the sample
>>> plugin) I wrote a wrapper script, 'cluster-install', that you use to
>>> install packages on the cluster ... this will install the packages on
>>> all of the nodes, as well as record the set of packages on the cluster
>>> in /home/.starcluster-packages.  This file will be used to setup the
>>> nodes on the next cluster launch.
>>>
>>> For those who are interested, I'd be happy to discuss it more.  Email me
>>> or the list.
>>>
>>> Austin
>>> _______________________________________________
>>> StarCluster mailing list
>>> StarCluster at mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster at mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
> _______________________________________________
> StarCluster mailing list
> StarCluster at mit.edu
> http://mailman.mit.edu/mailman/listinfo/starcluster




More information about the StarCluster mailing list