Hi Alessandro,<br><br>For your use case you might consider making your own customized ami.<br>Once you have one up and running you can use StarCluster's ebscreate<br>command to do this. Then just put the new ami id into the config file.<br>
>From the docs:<br><br>$ starcluster ebsimage -h<br>StarCluster - (<a href="http://web.mit.edu/starcluster">http://web.mit.edu/starcluster</a>) (v. 0.93.3)<br>Software Tools for Academics and Researchers (STAR)<br>Please submit bug reports to <a href="mailto:starcluster@mit.edu">starcluster@mit.edu</a><br>
<br>Usage: ebsimage [options] <instance-id> <image_name><br><br> Create a new EBS image (AMI) from a running EC2 instance<br><br> Example:<br><br> $ starcluster ebsimage i-999999 my-new-image-ebs<br>
<br> NOTE: It should now be safe to create an image from an instance launched by<br> StarCluster. If you have issues please submit a bug report to the mailing<br> list.<br>...<br><br>Now while you have made your life easier with this, there is always the danger that<br>
you delete the image and/or forget the recipe. As long as you don't have a bunch of<br>different instance types, or have very complex image build recipes, this is mostly OK.<br><br>Don<br><br><br><div class="gmail_extra">
<br><br><div class="gmail_quote">On Wed, Nov 14, 2012 at 12:07 PM, Alessandro Gagliardi <span dir="ltr"><<a href="mailto:alessandro@path.com" target="_blank">alessandro@path.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
So it sounds like anything using the <span style="font-family:arial,sans-serif;font-size:13px">StarCluster 11.10 AMIs should be EBS-backed automatically (so long as I'm not using spot instances, which I'm not) and so should be able to be started after being stopped (with the -x) flag. </span><div>
<span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">If that's the case, then it doesn't answer my original question of why, when I tried starting my cluster after stopping it, it got stuck on </span><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:13px">Waiting for JSON connector file.../.</span></div>
<div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:13px"><br></span></div><div><span style="color:rgb(80,0,80);font-family:arial,sans-serif;font-size:13px">I'd really like to solve this problem as I only need to use these clusters about 1/4 of the week, but it takes me almost a full day to configure them the way I want (with installing IPython 0.14 and Pandas and RPy and all that) so I can't just spin up a new one every time I need it. </span></div>
<div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Nov 14, 2012 at 11:44 AM, Justin Riley <span dir="ltr"><<a href="mailto:jtriley@mit.edu" target="_blank">jtriley@mit.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA1<br>
<br>
Hi Alessandro,<br>
<br>
Yes you can only stop an EBS-backed cluster. With that said any<br>
cluster started with EBS-backed AMIs is stoppable provided it's not a<br>
spot cluster. The latest StarCluster 11.10 AMIs are EBS-backed so if<br>
you're using them with on-demand instances you can stop your cluster<br>
using the 'stop' command and then restart them later on using:<br>
<br>
$ starcluster start -x your_stopped_cluster<br>
<br>
HTH,<br>
<br>
~Justin<br>
<div><br>
On 11/08/2012 07:37 PM, Alessandro Gagliardi wrote:<br>
> I think the problem is that I can only start a stopped StarCluster<br>
> if it's EBS-backed. (At least, that's what it looks like from<br>
> reading<br>
> <a href="http://star.mit.edu/cluster/docs/latest/manual/launch.html#stopping-an-ebs-backed-cluster" target="_blank">http://star.mit.edu/cluster/docs/latest/manual/launch.html#stopping-an-ebs-backed-cluster</a>.)<br>
><br>
><br>
But how do I make it EBS-backed? (Sadly, searching the documentation for<br>
> ebs-backed<br>
</div>> <<a href="http://star.mit.edu/cluster/docs/latest/search.html?q=ebs-backed&check_keywords=yes&area=default" target="_blank">http://star.mit.edu/cluster/docs/latest/search.html?q=ebs-backed&check_keywords=yes&area=default</a>><br>
<div>><br>
><br>
yields no results.)<br>
><br>
> Thank you in advance, -Alessandro<br>
><br>
><br>
> On Wed, Oct 31, 2012 at 1:51 PM, Alessandro Gagliardi<br>
</div><div>> <<a href="mailto:alessandro@path.com" target="_blank">alessandro@path.com</a> <mailto:<a href="mailto:alessandro@path.com" target="_blank">alessandro@path.com</a>>> wrote:<br>
><br>
> Hello folks,<br>
><br>
> I stopped my StarCluster (after successfully using it with IPython<br>
> 0.14) and when I tried starting it up again the next day, it hangs<br>
> at this point:<br>
><br>
> !!! ERROR - command 'source /etc/profile && ipcluster start --n=37<br>
> --delay=5 --daemonize' failed with status 10<br>
>>>> Waiting for JSON connector file.../<br>
><br>
> Any idea why and what (if anything) I can do about it?<br>
><br>
> Thanks, -Alessandro<br>
><br>
><br>
><br>
><br>
</div>> -- Alessandro Gagliardi • • <a href="mailto:alessandro@path.com" target="_blank">alessandro@path.com</a><br>
> <mailto:<a href="mailto:alessandro@path.com" target="_blank">alessandro@path.com</a>><br>
><br>
><br>
> _______________________________________________ StarCluster mailing<br>
> list <a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><br>
> <a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
><br>
<br>
-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG v2.0.19 (GNU/Linux)<br>
Comment: Using GnuPG with Mozilla - <a href="http://www.enigmail.net/" target="_blank">http://www.enigmail.net/</a><br>
<br>
iEYEARECAAYFAlCj9KEACgkQ4llAkMfDcrlE/wCeMebO/XJv9IGNgeVidngQYn2J<br>
dCUAn2D9oHS+C/dfNN44ToRqcqDHBO1g<br>
=L/JA<br>
-----END PGP SIGNATURE-----<span class="HOEnZb"><font color="#888888"><br>
</font></span></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">Alessandro Gagliardi</span><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif"> </span><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">•</span><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif"> </span><img style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif"><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif"> </span><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif">•</span><span style="color:rgb(136,136,136);font-size:13px;font-family:arial,sans-serif"> <a href="mailto:alessandro@path.com" target="_blank">alessandro@path.com</a></span><br>
</font></span></div>
<br>_______________________________________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
<br></blockquote></div><br></div>