[Starcluster] StarCluster Hanging

Fri Apr 30 14:00:18 EDT 2010

Hi,
I've tried to start up multiple clusters this afternoon, but the process
stalls on "Waiting for cluster to start".  Can you suggest what I may be
doing wrong?

Andy

StarCluster - (http://web.mit.edu/starcluster)
Author: justin.t.riley at gmail.com
Please submit bug reports to starcluster at mit.edu

starcluster:66 - DEBUG - options = {'remove_image': None, 'show_bucket':
None, 'list_nodes': False, 'show_image': None, 'debug': True, 'pretend':
False, 'login_node': False, 'login_master': False, 'list_images': False,
'no_create': False, 'terminate_cluster': False, 'list_buckets': False,
'start_cluster': True}
>>> Starting cluster...
ec2utils.py:37 - DEBUG - EC2_CONNECTION is None, creating...
>>> Launching a 2-node cluster...
>>> Launching master node...
>>> MASTER AMI: ami-8f9e71e6
RESERVATION    r-adf81cc6    154930467416    default
INSTANCE    i-6581c50e    ami-8f9e71e6            pending
reynoldsboykotest    0        m1.small    2010-04-30T17:56:41.000Z
us-east-1a    aki-6eaa4907    ari-42b95a2b
>>> Launching worker nodes...
>>> NODE AMI: ami-8f9e71e6
RESERVATION    r-a3f81cc8    154930467416    default
INSTANCE    i-7b81c510    ami-8f9e71e6            pending
reynoldsboykotest    0        m1.small    2010-04-30T17:56:42.000Z
us-east-1a    aki-6eaa4907    ari-42b95a2b
>>> Waiting for cluster to start...|ec2utils.py:160 - DEBUG -
INSTANCE_RESPONSE = None, refresh = True, creating
|ec2utils.py:160 - DEBUG - INSTANCE_RESPONSE = [['RESERVATION',
'r-49ee0a22', '154930467416', 'reynoldsboyko'], ['INSTANCE', 'i-c36f2ba8',
'ami-eb896582', '', '', 'terminated', 'reynoldsBoykoV2', '0', '',
'm1.small', '2010-04-30T16:46:05.000Z', 'us-east-1a', 'aki-a71cf9ce',
'ari-a51cf9cc'], ['RESERVATION', 'r-1bf51170', '154930467416', 'default'],
['INSTANCE', 'i-5171353a', 'ami-8f9e71e6', '', '', 'terminated',
'reynoldsboykotest', '0', '', 'm1.small', '2010-04-30T17:12:35.000Z',
'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-1ff51174',
'154930467416', 'default'], ['INSTANCE', 'i-5571353e', 'ami-8f9e71e6', '',
'', 'terminated', 'reynoldsboykotest', '0', '', 'm1.small',
'2010-04-30T17:12:36.000Z', 'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'],
['RESERVATION', 'r-cff713a4', '154930467416', 'default'], ['INSTANCE',
'i-cf7337a4', 'ami-8f9e71e6', 'ec2-184-73-93-115.compute-1.amazonaws.com',
'domU-12-31-39-03-48-D4.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:20:40.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-9ff713f4',
'154930467416', 'default'], ['INSTANCE', 'i-6b7c3800', 'ami-8f9e71e6', '
ec2-174-129-93-39.compute-1.amazonaws.com',
'domU-12-31-39-03-48-F2.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:21:40.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-45f0142e',
'154930467416', 'default'], ['INSTANCE', 'i-577c383c', 'ami-8f9e71e6', '
ec2-204-236-195-190.compute-1.amazonaws.com',
'domU-12-31-39-02-B6-43.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-557c383e', 'ami-8f9e71e6',
'ec2-75-101-222-215.compute-1.amazonaws.com',
'domU-12-31-39-02-6A-31.compute-1.internal', 'running', 'reynoldsboykotest',
'1', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-2b7c3840', 'ami-8f9e71e6',
'ec2-184-73-101-20.compute-1.amazonaws.com',
'domU-12-31-39-03-70-C4.compute-1.internal', 'running', 'reynoldsboykotest',
'2', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-297c3842', 'ami-8f9e71e6',
'ec2-184-73-7-143.compute-1.amazonaws.com',
'domU-12-31-39-03-01-D3.compute-1.internal', 'running', 'reynoldsboykotest',
'3', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-81fe1aea',
'154930467416', 'default'], ['INSTANCE', 'i-fb86c290', 'ami-8f9e71e6', '
ec2-204-236-209-145.compute-1.amazonaws.com',
'ip-10-250-15-47.ec2.internal', 'running', 'reynoldsboykotest', '0', '',
'm1.small', '2010-04-30T17:50:31.000Z', 'us-east-1a', 'aki-6eaa4907',
'ari-42b95a2b'], ['RESERVATION', 'r-87fe1aec', '154930467416', 'default'],
['INSTANCE', 'i-f986c292', 'ami-8f9e71e6', '
ec2-174-129-131-189.compute-1.amazonaws.com',
'ip-10-250-15-176.ec2.internal', 'running', 'reynoldsboykotest', '0', '',
'm1.small', '2010-04-30T17:50:31.000Z', 'us-east-1a', 'aki-6eaa4907',
'ari-42b95a2b'], ['RESERVATION', 'r-adf81cc6', '154930467416', 'default'],
['INSTANCE', 'i-6581c50e', 'ami-8f9e71e6', '', '', 'pending',
'reynoldsboykotest', '0', '', 'm1.small', '2010-04-30T17:56:41.000Z',
'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-a3f81cc8',
'154930467416', 'default'], ['INSTANCE', 'i-7b81c510', 'ami-8f9e71e6', '',
'', 'pending', 'reynoldsboykotest', '0', '', 'm1.small',
'2010-04-30T17:56:42.000Z', 'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b']],
refresh = True, creating
|ec2utils.py:160 - DEBUG - INSTANCE_RESPONSE = [['RESERVATION',
'r-49ee0a22', '154930467416', 'reynoldsboyko'], ['INSTANCE', 'i-c36f2ba8',
'ami-eb896582', '', '', 'terminated', 'reynoldsBoykoV2', '0', '',
'm1.small', '2010-04-30T16:46:05.000Z', 'us-east-1a', 'aki-a71cf9ce',
'ari-a51cf9cc'], ['RESERVATION', 'r-1bf51170', '154930467416', 'default'],
['INSTANCE', 'i-5171353a', 'ami-8f9e71e6', '', '', 'terminated',
'reynoldsboykotest', '0', '', 'm1.small', '2010-04-30T17:12:35.000Z',
'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-1ff51174',
'154930467416', 'default'], ['INSTANCE', 'i-5571353e', 'ami-8f9e71e6', '',
'', 'terminated', 'reynoldsboykotest', '0', '', 'm1.small',
'2010-04-30T17:12:36.000Z', 'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'],
['RESERVATION', 'r-cff713a4', '154930467416', 'default'], ['INSTANCE',
'i-cf7337a4', 'ami-8f9e71e6', 'ec2-184-73-93-115.compute-1.amazonaws.com',
'domU-12-31-39-03-48-D4.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:20:40.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-9ff713f4',
'154930467416', 'default'], ['INSTANCE', 'i-6b7c3800', 'ami-8f9e71e6', '
ec2-174-129-93-39.compute-1.amazonaws.com',
'domU-12-31-39-03-48-F2.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:21:40.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-45f0142e',
'154930467416', 'default'], ['INSTANCE', 'i-577c383c', 'ami-8f9e71e6', '
ec2-204-236-195-190.compute-1.amazonaws.com',
'domU-12-31-39-02-B6-43.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-557c383e', 'ami-8f9e71e6',
'ec2-75-101-222-215.compute-1.amazonaws.com',
'domU-12-31-39-02-6A-31.compute-1.internal', 'running', 'reynoldsboykotest',
'1', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-2b7c3840', 'ami-8f9e71e6',
'ec2-184-73-101-20.compute-1.amazonaws.com',
'domU-12-31-39-03-70-C4.compute-1.internal', 'running', 'reynoldsboykotest',
'2', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-297c3842', 'ami-8f9e71e6',
'ec2-184-73-7-143.compute-1.amazonaws.com',
'domU-12-31-39-03-01-D3.compute-1.internal', 'running', 'reynoldsboykotest',
'3', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-81fe1aea',
'154930467416', 'default'], ['INSTANCE', 'i-fb86c290', 'ami-8f9e71e6', '
ec2-204-236-209-145.compute-1.amazonaws.com',
'ip-10-250-15-47.ec2.internal', 'running', 'reynoldsboykotest', '0', '',
'm1.small', '2010-04-30T17:50:31.000Z', 'us-east-1a', 'aki-6eaa4907',
'ari-42b95a2b'], ['RESERVATION', 'r-87fe1aec', '154930467416', 'default'],
['INSTANCE', 'i-f986c292', 'ami-8f9e71e6', '
ec2-174-129-131-189.compute-1.amazonaws.com',
'ip-10-250-15-176.ec2.internal', 'running', 'reynoldsboykotest', '0', '',
'm1.small', '2010-04-30T17:50:31.000Z', 'us-east-1a', 'aki-6eaa4907',
'ari-42b95a2b'], ['RESERVATION', 'r-adf81cc6', '154930467416', 'default'],
['INSTANCE', 'i-6581c50e', 'ami-8f9e71e6', '', '', 'pending',
'reynoldsboykotest', '0', '', 'm1.small', '2010-04-30T17:56:41.000Z',
'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-a3f81cc8',
'154930467416', 'default'], ['INSTANCE', 'i-7b81c510', 'ami-8f9e71e6', '',
'', 'pending', 'reynoldsboykotest', '0', '', 'm1.small',
'2010-04-30T17:56:42.000Z', 'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b']],
refresh = True, creating
|ec2utils.py:160 - DEBUG - INSTANCE_RESPONSE = [['RESERVATION',
'r-49ee0a22', '154930467416', 'reynoldsboyko'], ['INSTANCE', 'i-c36f2ba8',
'ami-eb896582', '', '', 'terminated', 'reynoldsBoykoV2', '0', '',
'm1.small', '2010-04-30T16:46:05.000Z', 'us-east-1a', 'aki-a71cf9ce',
'ari-a51cf9cc'], ['RESERVATION', 'r-1bf51170', '154930467416', 'default'],
['INSTANCE', 'i-5171353a', 'ami-8f9e71e6', '', '', 'terminated',
'reynoldsboykotest', '0', '', 'm1.small', '2010-04-30T17:12:35.000Z',
'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-1ff51174',
'154930467416', 'default'], ['INSTANCE', 'i-5571353e', 'ami-8f9e71e6', '',
'', 'terminated', 'reynoldsboykotest', '0', '', 'm1.small',
'2010-04-30T17:12:36.000Z', 'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'],
['RESERVATION', 'r-cff713a4', '154930467416', 'default'], ['INSTANCE',
'i-cf7337a4', 'ami-8f9e71e6', 'ec2-184-73-93-115.compute-1.amazonaws.com',
'domU-12-31-39-03-48-D4.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:20:40.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-9ff713f4',
'154930467416', 'default'], ['INSTANCE', 'i-6b7c3800', 'ami-8f9e71e6', '
ec2-174-129-93-39.compute-1.amazonaws.com',
'domU-12-31-39-03-48-F2.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:21:40.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-45f0142e',
'154930467416', 'default'], ['INSTANCE', 'i-577c383c', 'ami-8f9e71e6', '
ec2-204-236-195-190.compute-1.amazonaws.com',
'domU-12-31-39-02-B6-43.compute-1.internal', 'running', 'reynoldsboykotest',
'0', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-557c383e', 'ami-8f9e71e6',
'ec2-75-101-222-215.compute-1.amazonaws.com',
'domU-12-31-39-02-6A-31.compute-1.internal', 'running', 'reynoldsboykotest',
'1', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-2b7c3840', 'ami-8f9e71e6',
'ec2-184-73-101-20.compute-1.amazonaws.com',
'domU-12-31-39-03-70-C4.compute-1.internal', 'running', 'reynoldsboykotest',
'2', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['INSTANCE', 'i-297c3842', 'ami-8f9e71e6',
'ec2-184-73-7-143.compute-1.amazonaws.com',
'domU-12-31-39-03-01-D3.compute-1.internal', 'running', 'reynoldsboykotest',
'3', '', 'm1.small', '2010-04-30T17:22:45.000Z', 'us-east-1b',
'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-81fe1aea',
'154930467416', 'default'], ['INSTANCE', 'i-fb86c290', 'ami-8f9e71e6', '
ec2-204-236-209-145.compute-1.amazonaws.com',
'ip-10-250-15-47.ec2.internal', 'running', 'reynoldsboykotest', '0', '',
'm1.small', '2010-04-30T17:50:31.000Z', 'us-east-1a', 'aki-6eaa4907',
'ari-42b95a2b'], ['RESERVATION', 'r-87fe1aec', '154930467416', 'default'],
['INSTANCE', 'i-f986c292', 'ami-8f9e71e6', '
ec2-174-129-131-189.compute-1.amazonaws.com',
'ip-10-250-15-176.ec2.internal', 'running', 'reynoldsboykotest', '0', '',
'm1.small', '2010-04-30T17:50:31.000Z', 'us-east-1a', 'aki-6eaa4907',
'ari-42b95a2b'], ['RESERVATION', 'r-adf81cc6', '154930467416', 'default'],
['INSTANCE', 'i-6581c50e', 'ami-8f9e71e6', '', '', 'pending',
'reynoldsboykotest', '0', '', 'm1.small', '2010-04-30T17:56:41.000Z',
'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b'], ['RESERVATION', 'r-a3f81cc8',
'154930467416', 'default'], ['INSTANCE', 'i-7b81c510', 'ami-8f9e71e6', '',
'', 'pending', 'reynoldsboykotest', '0', '', 'm1.small',
'2010-04-30T17:56:42.000Z', 'us-east-1a', 'aki-6eaa4907', 'ari-42b95a2b']],
refresh = True, creating
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20100430/80786c93/attachment.htm