[StarCluster] Adding new nodes to hadoop cluster

Justin Riley jtriley at MIT.EDU
Tue Jul 31 13:54:32 EDT 2012


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Håvard,

Unfortunately the Hadoop plugin doesn't currently implement the
on_add_node and on_remove_node methods which is why new nodes are not
configured to work with the existing Hadoop cluster. We need to
experiment with this and see what's required to add a node to the
cluster. I've created an issue to keep track of this:

https://github.com/jtriley/StarCluster/issues/131

If you have time to experiment with the steps needed to manually add a
node to the Hadoop cluster and then comment on the issue with the
necessary steps I can translate that to plugin code. Otherwise this
will need to wait until I have time to experiment...

~Justin

On 06/27/2012 05:31 AM, Håvard Wahl Kongsgård wrote:
> Hi, when adding nodes 
> (http://web.mit.edu/star/cluster/docs/latest/manual/addremovenode.html)
>
> 
to a hadoop cluster, starcluster skips the hadoop part. Therefore the
> new nodes will not be configured to work with the rest of the
> hadoop cluster. Is it possible to correct this behavior?
> 
> -Håvard
> 
> _______________________________________________ StarCluster mailing
> list StarCluster at mit.edu 
> http://mailman.mit.edu/mailman/listinfo/starcluster
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAlAYG9gACgkQ4llAkMfDcrkGEwCeLyIRH8e1E1IGm2z81rqde+ra
E74An06lKcDnz2FHD9Gj4xe04JfFbbtB
=8Jjc
-----END PGP SIGNATURE-----


More information about the StarCluster mailing list