Hi Justin,<div><br></div><div>This definitely helped!</div><div><br></div><div>Your email reminded me I was experimenting with getting the X remote display working around the time I tried to install a Python module. </div>
<div>So I had ssh'd in as opposed to using the starcluster command. </div><div><br></div><div>I found the point of confusion that led me down the wrong track using ssh directly. In my config file, I defined a cluster called 'singleinstance'.</div>
<div>So I execute 'starcluster start singleinstance' to fire it up. At the end of the startup process, I see the following output.</div><div><br></div><div>"The cluster has been started and configured. <div>
<br>
</div><div>Login to the master node as root by running: </div><div><br></div><div> $ starcluster sshmaster singleinstance</div><div><br></div><div>or manually as sgeadmin:</div><div><br></div><div> $ ssh -i <rsa file> sgeadmin@<machine name></div>
<div><br></div><div>When you are finished using the cluster, run:</div><div><br></div><div> $ starcluster stop singleinstance</div><div><br></div><div>to shutdown the cluster and stop paying for service"</div><div>
<br></div><div>Notice the instructions for making a manual connection using ssh. It says to connect as sgeadmin, not as root. </div><div>When you connect using 'starcluster sshmaster singleinstance', you are connected as root. </div>
<div><br></div><div>Once I substitute root for sgeadmin, all is well.</div><div><br></div><div>Should the starcluster commands get remote X display working properly? Even with ssh -X from my Mac, I had no luck. </div><div>
It took ssh -X -C -c blowfish -i <rsa file> root@<machine name> for me to display a matplotlib figure remotely. </div><div>I was following the suggestion in this post. <a href="http://blog.grayproductions.net/articles/load_an_ec2_gui_on_your_mac_os_x_box">http://blog.grayproductions.net/articles/load_an_ec2_gui_on_your_mac_os_x_box</a></div>
<div><br></div><div>Thanks for your help Justin. </div><div><br></div><div>Chris</div><meta charset="utf-8"><br><div class="gmail_quote">On Mon, Mar 14, 2011 at 8:09 PM, Justin Riley <span dir="ltr"><<a href="mailto:jtriley@mit.edu">jtriley@mit.edu</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA1<br>
<br>
Hi Chris,<br>
<div class="im"><br>
> I should have mentioned that I tried 'sudo easy_install ...' and it<br>
> prompted me for a password. Hitting return didn't do the trick...<br>
><br>
<br>
</div>How are you logging into the instance? Have you tried the<br>
sshmaster/sshnode/sshinstance commands? All of these commands should log<br>
you in as root by default:<br>
<br>
# login as root on the master node of 'mycluster'<br>
$ starcluster sshmaster mycluster<br>
<br>
# login as root to node001 of 'mycluster'<br>
$ starcluster sshnode mycluster node001<br>
<br>
# login as root to any instance by instance id (keypair must be defined<br>
in config)<br>
$ starcluster sshinstance i-14e9157c<br>
<br>
# login as root to any instance by public dns name (keypair must be<br>
defined in config)<br>
$ starcluster sshinstance <a href="http://ec2-123-123-123-12.compute-1.amazonaws.com" target="_blank">ec2-</a><a href="tel:123-123-123-12">123-123-123-12</a>.<a href="http://compute-1.amazonaws.com">compute-1.amazonaws.com</a><br>
<br>
If these commands work you should be logged in as root and easy_install<br>
should work without any 'permission denied' errors. Pass --help to any<br>
of these commands for more details and a list of available options.<br>
<div class="im"><br>
<br>
> Once I am able to create a new custom AMI, shouldn't I be able to spin<br>
> up a cluster of VMs all using the same image?<br>
<br>
</div>Absolutely. You can do this by putting your new AMI id as the<br>
NODE_IMAGE_ID setting in a cluster template defined in the config. Have<br>
a look at the comments for the NODE_IMAGE_ID setting in the example<br>
'smallcluster' config here:<br>
<a href="http://web.mit.edu/stardev/cluster/docs/configuration.html#defining-cluster-templates" target="_blank">http://web.mit.edu/stardev/cluster/docs/configuration.html#defining-cluster-templates</a><br>
<br>
However, please note that currently the best way to create a new AMI<br>
based on the StarCluster AMI is to launch a single instance of the AMI<br>
using the AWS Console instead of StarCluster. Then login to the instance<br>
as root, modify the install, and create a new AMI from the instance. If<br>
you want to create an S3-backed AMI you can use StarCluster's<br>
'createimage' command to completely automate the process:<br>
<br>
$ starcluster createimage i-999999 my-new-image my-s3-bucket<br>
<br>
Please see <a href="http://web.mit.edu/stardev/cluster/docs/create_new_ami.html" target="_blank">http://web.mit.edu/stardev/cluster/docs/create_new_ami.html</a><br>
for more details.<br>
<br>
Hope that helps,<br>
<br>
~Justin<br>
<div class="im"><br>
<br>
<br>
><br>
> Chris<br>
><br>
> On Mon, Mar 14, 2011 at 6:57 PM, Austin Godber <<a href="mailto:godber@uberhip.com">godber@uberhip.com</a><br>
</div><div><div></div><div class="h5">> <mailto:<a href="mailto:godber@uberhip.com">godber@uberhip.com</a>>> wrote:<br>
><br>
> You should be able to use sudo to do things as the root user:<br>
><br>
> sudo easy_install boto<br>
><br>
> I am pretty sure that works.<br>
><br>
> Though you should keep in mind that will only run it on the current<br>
> node and /usr/local isn't share between nodes ... at least as far as<br>
> I know of.<br>
><br>
> Austin<br>
><br>
><br>
> On 03/14/2011 08:55 PM, Chris Diehl wrote:<br>
>> Hello,<br>
>><br>
>> I just successfully fired up my first cluster in short order which<br>
>> is brilliant!<br>
>><br>
>> My first step was to try and install additional modules so that I<br>
>> could save a custom AMI for future use.<br>
>><br>
>> Doing an 'easy_install <packagename>' yielded:<br>
>><br>
>> -------------------------<br>
>><br>
>> error: can't create or remove files in install directory<br>
>><br>
>> The following error occurred while trying to add or remove files<br>
>> in the<br>
>> installation directory:<br>
>><br>
>> [Errno 13] Permission denied:<br>
>> '/usr/local/lib/python2.6/dist-packages/test-easy-install-5265.write-test'<br>
>><br>
>> The installation directory you specified (via --install-dir,<br>
>> --prefix, or<br>
>> the distutils default setting) was:<br>
>><br>
>> /usr/local/lib/python2.6/dist-packages/<br>
>><br>
>> Perhaps your account does not have write access to this directory?<br>
>> If the<br>
>> installation directory is a system-owned directory, you may need<br>
>> to sign in<br>
>> as the administrator or "root" account. If you do not have<br>
>> administrative<br>
>> access to this machine, you may wish to choose a different<br>
>> installation<br>
>> directory, preferably one that is listed in your PYTHONPATH<br>
>> environment<br>
>> variable.<br>
>><br>
>> -------------------------<br>
>><br>
>> Does sgeadmin not have admin rights? Should I be able to install<br>
>> software at will without permissions issues?<br>
>><br>
>> Chris<br>
>><br>
>><br>
>><br>
>> _______________________________________________<br>
>> StarCluster mailing list<br>
</div></div>>> <a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a> <mailto:<a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a>><br>
<div class="im">>> <a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
><br>
><br>
> _______________________________________________<br>
> StarCluster mailing list<br>
</div>> <a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a> <mailto:<a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a>><br>
<div class="im">> <a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
><br>
><br>
<br>
</div>-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG v2.0.17 (GNU/Linux)<br>
Comment: Using GnuPG with Mozilla - <a href="http://enigmail.mozdev.org/" target="_blank">http://enigmail.mozdev.org/</a><br>
<br>
iEYEARECAAYFAk1+2F0ACgkQ4llAkMfDcrmIUQCgjwAYW/u11uFbR3oBSHiAHxLx<br>
8/8AoIjNpa27nPra3RvI7YWsxTQhVXwA<br>
=jbKi<br>
-----END PGP SIGNATURE-----<br>
<div><div></div><div class="h5">_______________________________________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
</div></div></blockquote></div><br></div>