<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none"><!--P{margin-top:0;margin-bottom:0;} .ms-cui-menu {background-color:#ffffff;border:1px rgb(171, 171, 171) solid;font-family:'Segoe UI WPC', 'Segoe UI', Tahoma, 'Microsoft Sans Serif', Verdana, sans-serif;font-size:11pt;color:rgb(51, 51, 51);} .ms-cui-menusection-title {display:none;} .ms-cui-ctl {vertical-align:text-top;text-decoration:none;color:rgb(51, 51, 51);} .ms-cui-ctl-on {background-color:rgb(223, 237, 250);opacity: 0.8;} .ms-cui-img-cont-float {display:inline-block;margin-top:2px} .ms-cui-smenu-inner {padding-top:0px;} .ms-owa-paste-option-icon {margin: 2px 4px 0px 4px;vertical-align:sub;padding-bottom: 2px;display:inline-block;} .ms-rtePasteFlyout-option:hover {background-color:rgb(223, 237, 250) !important;opacity:1 !important;} .ms-rtePasteFlyout-option {padding:8px 4px 8px 4px;outline:none;} .ms-cui-menusection {float:left; width:85px;height:24px;overflow:hidden}.wf {speak:none; font-weight:normal; font-variant:normal; text-transform:none; -webkit-font-smoothing:antialiased; vertical-align:middle; display:inline-block;}.wf-family-owa {font-family:'o365Icons'}@font-face { font-family:'o365IconsIE8'; src:url('prem/15.0.898.11/resources/styles/office365icons.ie8.eot?#iefix') format('embedded-opentype'), url('prem/15.0.898.11/resources/styles/office365icons.ie8.woff') format('woff'), url('prem/15.0.898.11/resources/styles/office365icons.ie8.ttf') format('truetype'); font-weight:normal; font-style:normal;}@font-face { font-family:'o365IconsMouse'; src:url('prem/15.0.898.11/resources/styles/office365icons.mouse.eot?#iefix') format('embedded-opentype'), url('prem/15.0.898.11/resources/styles/office365icons.mouse.woff') format('woff'), url('prem/15.0.898.11/resources/styles/office365icons.mouse.ttf') format('truetype'); font-weight:normal; font-style:normal;}.wf-family-owa {font-family:'o365IconsMouse'}.ie8 .wf-family-owa {font-family:'o365IconsIE8'}.ie8 .wf-owa-play-large:before {content:'\e254';}.notIE8 .wf-owa-play-large:before {content:'\e054';}.ie8 .wf-owa-play-large {color:#FFFFFF/*$WFWhiteColor*/;}.notIE8 .wf-owa-play-large {border-color:#FFFFFF/*$WFWhiteColor*/; width:1.4em; height:1.4em; border-width:.1em; border-style:solid; border-radius:.8em; text-align:center; box-sizing:border-box; -moz-box-sizing:border-box; padding:0.1em; color:#FFFFFF/*$WFWhiteColor*/;}.ie8 .wf-size-play-large {width:40px; height:40px; font-size:30px}.notIE8 .wf-size-play-large {width:40px; height:40px; font-size:30px}
<!--
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:Tahoma}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif"}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif"}
span.EmailStyle17
{font-family:"Calibri","sans-serif";
color:#1F497D}
span.BalloonTextChar
{font-family:"Tahoma","sans-serif"}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
-->
--></style>
</head>
<body>
<div style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p>I'll add another voice for being able to add spot nodes using addnode even without the special options.<br>
</p>
<p>The settings in your cluster template will be used when running addnode. The extra options come in handy to use other values if needed, but otherwise just setting the spot bid in the cluster template will ensure that all nodes added later use that bid. This
is what we do regularly, so I know that this works. Also, this is critical to allow the loadbalancer to auto-scale your cluster with spot instances, which is a very useful feature as well!<br>
</p>
<p><br>
</p>
<p>Best regards!<br>
</p>
<p>-Dmitry<br>
</p>
<p><br>
</p>
<p><br>
</p>
<div style="color: #282828;">
<hr tabindex="-1" style="display: inline-block; width: 98%;">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size: 11pt;"><b>From:</b> starcluster-bounces@mit.edu <starcluster-bounces@mit.edu> on behalf of Steve Darnell <darnells@dnastar.com><br>
<b>Sent:</b> Tuesday, March 25, 2014 3:14 PM<br>
<b>To:</b> Cory Dolphin<br>
<b>Cc:</b> starcluster@mit.edu<br>
<b>Subject:</b> Re: [StarCluster] Starcluster stuck during setup</font>
<div> </div>
</div>
<div>
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">Hi Cory,</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">Rayson offered the following advice last year:
<a href="http://star.mit.edu/cluster/mlarchives/1742.html">http://star.mit.edu/cluster/mlarchives/1742.html</a></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;"> </span></p>
<p class="MsoNormal" style="margin-left: 0.5in;"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">The "right" way is to first boot a cluster of say, 8-10 nodes, submit
</span></p>
<p class="MsoNormal" style="margin-left: 0.5in;"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">jobs, and then use the StarCluster addnode command to grow your
</span></p>
<p class="MsoNormal" style="margin-left: 0.5in;"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">cluster.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">I do not see why you cannot add spot instances using addnode. The documentation says it is supported:
<a href="http://star.mit.edu/cluster/docs/latest/manual/addremovenode.html">http://star.mit.edu/cluster/docs/latest/manual/addremovenode.html</a></span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;"> </span></p>
<p class="MsoNormal" style="margin-left: 0.5in;"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">The addnode command has additional options for customizing the new node’s instance type, AMI, spot bid, and more.
</span></p>
<p class="MsoNormal" style="margin-left: 0.5in;"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">See the help menu for a detailed list of all available options:</span></p>
<p class="MsoNormal" style="margin-left: 0.5in;"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">$ starcluster addnode –help</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">Best regards,</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">Steve</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;"> </span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">--</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">Steve Darnell</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">DNASTAR, Inc.</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;">Madison, WI USA</span></p>
<p class="MsoNormal"><span style="font-size: 11pt; font-family: calibri, sans-serif; color: #1f497d;"> </span></p>
<p class="MsoNormal"><b><span style="font-size: 10pt; font-family: tahoma, sans-serif;">From:</span></b><span style="font-size: 10pt; font-family: tahoma, sans-serif;"> starcluster-bounces@mit.edu [mailto:starcluster-bounces@mit.edu]
<b>On Behalf Of </b>Cory Dolphin<br>
<b>Sent:</b> Tuesday, March 25, 2014 4:16 PM<br>
<b>To:</b> Butson, Christopher<br>
<b>Cc:</b> starcluster@mit.edu<br>
<b>Subject:</b> Re: [StarCluster] Starcluster stuck during setup</span></p>
<p class="MsoNormal"> </p>
<div>
<div>
<p class="MsoNormal">I have had similar issues starting large (30+) node clusters. Anyone else find a good pattern for doing so? Sadly I cannot add nodes incrementally since I need spot instances. </p>
</div>
</div>
<div>
<p class="MsoNormal" style="margin-bottom: 12pt;"> </p>
<div>
<p class="MsoNormal">On Tue, Mar 25, 2014 at 8:04 AM, Butson, Christopher <<a href="mailto:cbutson@mcw.edu" target="_blank">cbutson@mcw.edu</a>> wrote:</p>
<p class="MsoNormal">Interesting: I let it go and it eventually continued but it took over an hour to Configuring passwordless ssh for root. Still waiting for the cluster to finish startup…</p>
<div>
<p class="MsoNormal" style="margin-bottom: 12pt;"><br>
Christopher R. Butson, Ph.D.<br>
Associate Professor<br>
Biotechnology & Bioengineering Center<br>
Departments of Neurology, Neurosurgery, Psychiatry & Behavioral Medicine<br>
Medical College of Wisconsin<br>
<a href="tel:%28414%29%20955-2678">(414) 955-2678</a><br>
<a href="mailto:cbutson@mcw.edu">cbutson@mcw.edu</a><mailto:<a href="mailto:cbutson@mcw.edu">cbutson@mcw.edu</a>><br>
<br>
</p>
</div>
<p class="MsoNormal">From: <Butson>, Christopher Butson <<a href="mailto:cbutson@mcw.edu">cbutson@mcw.edu</a><mailto:<a href="mailto:cbutson@mcw.edu">cbutson@mcw.edu</a>>><br>
Date: Tuesday, March 25, 2014 12:13 PM<br>
To: "<a href="mailto:starcluster@mit.edu">starcluster@mit.edu</a><mailto:<a href="mailto:starcluster@mit.edu">starcluster@mit.edu</a>>" <<a href="mailto:starcluster@mit.edu">starcluster@mit.edu</a><mailto:<a href="mailto:starcluster@mit.edu">starcluster@mit.edu</a>>><br>
Subject: Starcluster stuck during setup</p>
<div>
<div>
<p class="MsoNormal"><br>
I'm on a slow internet connection overseas, trying to initiate a cluster using StarCluster. Once I type "starcluster start mycluster" everything seems to go ok but it gets stuck at the following point and never seems to get past it:<br>
>>> Mounting all NFS export path(s) on 79 worker node(s)<br>
79/79 |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||| 100%<br>
>>> Setting up NFS took 2.777 mins<br>
>>> Configuring passwordless ssh for root<br>
<br>
Any idea why this might occur? Thanks,<br>
Chris<br>
<br>
Christopher R. Butson, Ph.D.<br>
Associate Professor<br>
Biotechnology & Bioengineering Center<br>
Departments of Neurology, Neurosurgery, Psychiatry & Behavioral Medicine<br>
Medical College of Wisconsin<br>
<a href="tel:%28414%29%20955-2678">(414) 955-2678</a><br>
<a href="mailto:cbutson@mcw.edu">cbutson@mcw.edu</a><mailto:<a href="mailto:cbutson@mcw.edu">cbutson@mcw.edu</a>><br>
<br>
<br>
_______________________________________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a></p>
</div>
</div>
</div>
<p class="MsoNormal"> </p>
</div>
</div>
</div>
</div>
</div>
</body>
</html>