[StarCluster] problem with "starcluster put"

Sujai Kumar sujai.kumar at ed.ac.uk
Sun Oct 30 04:51:15 EDT 2011


Dear Starcluster team

First of all, thank you for an amazing set of tools!

Just wanted to report a problem with "starcluster put" on an ubuntu
10.04 desktop. Thanks in advance for your time and help,

- Sujai

----

I tried this command:

  starcluster put mycluster g_meloflo_100522_2_1.txt.gz /mnt/

And it seemed to be chugging along nicely:

  g_meloflo_100522_2_1.txt.gz   2% |                  | ETA:  00:04:23
  5.24 M/s

But then gave me this (crash report attached):

No handlers could be found for logger "paramiko.transport"  00:01:33   3.74 M/s
Traceback (most recent call last)://///////////     | ETA:  00:01:33   3.73 M/s
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/cli.py",
line 157, in main
    sc.execute(args)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/commands/put.py",
line 59, in execute
    node.ssh.put(lpaths, rpath)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/ssh.py",
line 430, in put
    self.scp.put(localpaths, remote_path=remotepath, recursive=recursive)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py",
line 100, in put
    self._send_files(files)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py",
line 168, in _send_files
    chan.sendall(file_hdl.read(buff_size))
  File "build/bdist.linux-x86_64/egg/paramiko/channel.py", line 763, in sendall
    raise socket.error('Socket is closed')
error: Socket is closed
!!! ERROR - Oops! Looks like you've found a bug in StarCluster
!!! ERROR - Crash report written to:
/home/s0674613/.starcluster/crash-report-11564.txt
!!! ERROR - Please remove any sensitive data from the crash report
!!! ERROR - and submit it to starcluster at mit.edu
==================================================


-- 
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.
-------------- next part --------------
2011-10-30 08:50:12,783 PID: 11564 config.py:524 - DEBUG - Loading config
2011-10-30 08:50:12,783 PID: 11564 config.py:118 - DEBUG - Loading file: /home/s0674613/.starcluster/config
2011-10-30 08:50:12,785 PID: 11564 awsutils.py:55 - DEBUG - creating self._conn w/ connection_authenticator kwargs = {'path': '/', 'region': None, 'port': None, 'is_secure': True}
2011-10-30 08:50:14,043 PID: 11564 cluster.py:647 - DEBUG - existing nodes: {}
2011-10-30 08:50:14,044 PID: 11564 cluster.py:655 - DEBUG - adding node i-cf9359ac to self._nodes list
2011-10-30 08:50:14,044 PID: 11564 cluster.py:655 - DEBUG - adding node i-cd9359ae to self._nodes list
2011-10-30 08:50:14,044 PID: 11564 cluster.py:663 - DEBUG - returning self._nodes = [<Node: master (i-cf9359ac)>, <Node: node001 (i-cd9359ae)>]
2011-10-30 08:50:14,044 PID: 11564 ssh.py:68 - DEBUG - loading private key /home/s0674613/.ssh/starcluster.pem
2011-10-30 08:50:14,044 PID: 11564 ssh.py:75 - DEBUG - specified key does not end in either rsa or dsa, trying both
2011-10-30 08:50:14,045 PID: 11564 ssh.py:153 - DEBUG - Using private key /home/s0674613/.ssh/starcluster.pem (rsa)
2011-10-30 08:50:14,045 PID: 11564 ssh.py:180 - DEBUG - creating scp connection
2011-10-30 08:50:14,045 PID: 11564 ssh.py:90 - DEBUG - connecting to host ec2-184-72-183-184.compute-1.amazonaws.com on port 22 as user root
2011-10-30 08:55:03,450 PID: 11564 cli.py:189 - DEBUG - Traceback (most recent call last):
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/cli.py", line 157, in main
    sc.execute(args)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/commands/put.py", line 59, in execute
    node.ssh.put(lpaths, rpath)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/ssh.py", line 430, in put
    self.scp.put(localpaths, remote_path=remotepath, recursive=recursive)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py", line 100, in put
    self._send_files(files)
  File "/usr/local/lib/python2.6/dist-packages/StarCluster-0.92-py2.6.egg/starcluster/scp.py", line 168, in _send_files
    chan.sendall(file_hdl.read(buff_size))
  File "build/bdist.linux-x86_64/egg/paramiko/channel.py", line 763, in sendall
    raise socket.error('Socket is closed')
error: Socket is closed


More information about the StarCluster mailing list