[StarCluster] Waiting for JSON connector file...

[Justin Riley]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

The ipcluster plugin currently works using SGE so if you have
disable_queue=True that would definitely be your problem.

If that's not it then it's likely due to the ipcluster plugin in
0.93.3 not playing nicely with the IPython 0.14dev version. I know
IPython 0.13 broke the ipcluster plugin a while back and this is fixed
on github. This may not be a problem anymore with IPython 0.14dev but
I'm not sure. In any case I'm trying to push a release out ASAP as
it's needed badly in a lot of areas. I will send an announcement when
it's ready.

Also, I highly recommend creating a custom AMI for your needs via the
ebsimage command instead of building and installing every time you
start a cluster as Don pointed out.

HTH,

~Justin


On 11/14/2012 03:07 PM, Alessandro Gagliardi wrote:
> So it sounds like anything using the StarCluster 11.10 AMIs should
> be EBS-backed automatically (so long as I'm not using spot
> instances, which I'm not) and so should be able to be started after
> being stopped (with the -x) flag.
> 
> If that's the case, then it doesn't answer my original question of
> why, when I tried starting my cluster after stopping it, it got
> stuck on Waiting for JSON connector file.../.
> 
> I'd really like to solve this problem as I only need to use these 
> clusters about 1/4 of the week, but it takes me almost a full day
> to configure them the way I want (with installing IPython 0.14 and
> Pandas and RPy and all that) so I can't just spin up a new one
> every time I need it.
> 
> 
> On Wed, Nov 14, 2012 at 11:44 AM, Justin Riley <jtriley at mit.edu 
> <mailto:jtriley at mit.edu>> wrote:
> 
> Hi Alessandro,
> 
> Yes you can only stop an EBS-backed cluster. With that said any 
> cluster started with EBS-backed AMIs is stoppable provided it's not
> a spot cluster. The latest StarCluster 11.10 AMIs are EBS-backed so
> if you're using them with on-demand instances you can stop your
> cluster using the 'stop' command and then restart them later on
> using:
> 
> $ starcluster start -x your_stopped_cluster
> 
> HTH,
> 
> ~Justin
> 
> On 11/08/2012 07:37 PM, Alessandro Gagliardi wrote:
>> I think the problem is that I can only start a stopped
>> StarCluster if it's EBS-backed. (At least, that's what it looks
>> like from reading
> 
> http://star.mit.edu/cluster/docs/latest/manual/launch.html#stopping-an-ebs-backed-cluster.)
>
> 
> 
> But how do I make it EBS-backed? (Sadly, searching the
> documentation for
>> ebs-backed
> 
> <http://star.mit.edu/cluster/docs/latest/search.html?q=ebs-backed&check_keywords=yes&area=default>
>
> 
> 
> yields no results.)
> 
>> Thank you in advance, -Alessandro
> 
> 
>> On Wed, Oct 31, 2012 at 1:51 PM, Alessandro Gagliardi 
>> <alessandro at path.com <mailto:alessandro at path.com>
> <mailto:alessandro at path.com <mailto:alessandro at path.com>>> wrote:
> 
>> Hello folks,
> 
>> I stopped my StarCluster (after successfully using it with
>> IPython 0.14) and when I tried starting it up again the next day,
>> it hangs at this point:
> 
>> !!! ERROR - command 'source /etc/profile && ipcluster start
>> --n=37 --delay=5 --daemonize' failed with status 10
>>>>> Waiting for JSON connector file.../
> 
>> Any idea why and what (if anything) I can do about it?
> 
>> Thanks, -Alessandro
> 
> 
> 
> 
>> -- Alessandro Gagliardi •  • alessandro at path.com
> <mailto:alessandro at path.com>
>> <mailto:alessandro at path.com <mailto:alessandro at path.com>>
> 
> 
>> _______________________________________________ StarCluster
>> mailing list StarCluster at mit.edu <mailto:StarCluster at mit.edu> 
>> http://mailman.mit.edu/mailman/listinfo/starcluster
> 
> 
> 
> 
> 
> 
> -- Alessandro Gagliardi •  • alessandro at path.com
> <mailto:alessandro at path.com>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://www.enigmail.net/

iEYEARECAAYFAlCmhAQACgkQ4llAkMfDcrk8jgCeI5hlqMgTyR84NdbiKHQxY1ST
u3YAmgOB/XVsHi/MN1fM70rf+MBchTHw
=K7Ut
-----END PGP SIGNATURE-----