[StarCluster] No panic, but Disco is now available with starcluster

Don MacMillen macd at nimbic.com
Fri Mar 30 17:48:34 EDT 2012


Hi Justin,

Great ideas, Justin.  It is all very doable.  One of Chris' points
was that Disco is a lot easier to install than Hadoop.  He did not
mention any gotcha's on the install but I will ask.  Let me know
if there is anything I can help you with.

Regards,

Don

On Fri, Mar 30, 2012 at 9:32 AM, Justin Riley <jtriley at mit.edu> wrote:
> Hi Don,
>
> Awesome stuff, thanks for sharing! I'm definitely interested in
> integrating disco with the next round of AMIs and including the disco
> plugin with StarCluster. I'm thinking we should also support installing
> disco from the plugin to support the current SC AMIs until new AMIs can
> be released. Not sure how hairy the install process is but if it's not
> too bad it's probably worth doing. I'll look into this but any gotchas I
> should know about?
>
> Thanks again for sharing!
>
> ~Justin
>
> On Wed, Mar 28, 2012 at 06:44:40PM -0700, Don MacMillen wrote:
>> Hi All,
>>
>> For those who'd like to try an alternative to Hadoop, Chris Mueller
>> has put together
>> a StarCluster image with Disco (an alternative, open source map-reduce system
>> from Nokia Research, more at http://discoproject.org/ ) and a plugin for it.
>> It's a great Python way into map-reduce.
>>
>> The post to the disco group is here and it has the link to github and a link to
>> a video of Chris' talk at the PyData  Workshop.
>>
>> http://groups.google.com/group/disco-dev/browse_thread/thread/50d6d8de5cfce252
>>
>> Don
>>
>> PS: Although I helped with the plugin, my ability to help with Disco
>> may be limited.
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster at mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster



More information about the StarCluster mailing list