[StarCluster] problem with "starcluster put"

[Justin Riley]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Sunjai,

Glad to hear you got it working eventually. For future reference you
do not need to terminate a cluster if a put/get command fails. Just
simply retry the put/get command again. If you're still having issues
you can try reconfiguring the cluster without terminating and losing
instance hours using the 'restart' command:

$ starcluster restart mycluster

This will reboot the instances and reconfigure them from scratch
without wasting instance hours.

HTH

~Justin


On 10/31/2011 04:48 PM, Sujai Kumar wrote:
> Hi Justin
> 
> Thanks for the prompt response. Yes it worked on a subsequent 
> cluster instance (I terminated that previous one because a cluster 
> you can't put data into is not much use :-))
> 
> Cheers,
> 
> - Sujai
> 
> On 31 October 2011 17:32, Justin Riley <jtriley at mit.edu> wrote: Hi 
> Sunjai,
> 
> This happened because some how you lost connection to the EC2 
> instance. This could be because of a network connection issue 
> either on your side or Amazon's side. I've updated the latest code 
> to better report connection-related errors. Were you able to 
> successfully retry the command?
> 
> ~Justin
> 
> On 10/30/2011 04:51 AM, Sujai Kumar wrote:
>>>> Dear Starcluster team
>>>> 
>>>> First of all, thank you for an amazing set of tools!
>>>> 
>>>> Just wanted to report a problem with "starcluster put" on an
>>>>  ubuntu 10.04 desktop. Thanks in advance for your time and 
>>>> help,
>>>> 
>>>> - Sujai
>>>> 
>>>> ----
>>>> 
>>>> I tried this command:
>>>> 
>>>> starcluster put mycluster g_meloflo_100522_2_1.txt.gz /mnt/
>>>> 
>>>> And it seemed to be chugging along nicely:
>>>> 
>>>> g_meloflo_100522_2_1.txt.gz   2% |                  | ETA: 
>>>> 00:04:23 5.24 M/s
>>>> 
>>>> But then gave me this (crash report attached):
>>>> 
>>>> No handlers could be found for logger "paramiko.transport" 
>>>> 00:01:33   3.74 M/s Traceback (most recent call 
>>>> last):///////////// | ETA:  00:01:33   3.73 M/s File 
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/cli.py",
>>>>
>>>>
>
>>>>
>>>> 
line 157, in main
>>>> sc.execute(args) File 
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/commands/put.py",
>>>>
>>>>
>
>>>>
>>>> 
line 59, in execute
>>>> node.ssh.put(lpaths, rpath) File 
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/ssh.py",
>>>>
>>>>
>
>>>>
>>>> 
line 430, in put
>>>> self.scp.put(localpaths, remote_path=remotepath, 
>>>> recursive=recursive) File 
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py",
>>>>
>>>>
>
>>>>
>>>> 
line 100, in put
>>>> self._send_files(files) File 
>>>> "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py",
>>>>
>>>>
>
>>>>
>>>> 
line 168, in _send_files
>>>> chan.sendall(file_hdl.read(buff_size)) File 
>>>> "build/bdist.linux-x86_64/egg/paramiko/channel.py", line
>>>> 763, in sendall raise socket.error('Socket is closed')
>>>> error: Socket is closed !!! ERROR - Oops! Looks like you've
>>>> found a bug in StarCluster !!! ERROR - Crash report written
>>>> to: /home/s0674613/.starcluster/crash-report-11564.txt !!!
>>>> ERROR - Please remove any sensitive data from the crash
>>>> report !!! ERROR - and submit it to starcluster at mit.edu 
>>>> ==================================================
>>>> 
>>>> 
> 
>> 
>> 
> 
> 
> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.17 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk6vGd0ACgkQ4llAkMfDcrn9qwCgkZqhqoMbAk84iEPwof69v2K6
3LIAn1dPTsYSlWx897b1wDC4EvxPJZ5s
=zQ/o
-----END PGP SIGNATURE-----