<div dir="ltr">Hi Colby,<div>Sorry for the misinformation. I looked at the code more and you are correct:</div><div><br></div><div><a href="https://github.com/jtriley/StarCluster/blob/develop/starcluster/balancers/sge/__init__.py#L727">https://github.com/jtriley/StarCluster/blob/develop/starcluster/balancers/sge/__init__.py#L727</a><br></div><div><br></div><div>calls cluster.add_nodes(need_to_add) and doesn't fill the optional param 'image_id' that would have helped your use case.</div><div><a href="https://github.com/jtriley/StarCluster/blob/develop/starcluster/cluster.py#L179">https://github.com/jtriley/StarCluster/blob/develop/starcluster/cluster.py#L179</a><br></div><div><br></div><div>that uses self.node_image_id:</div><div><a href="https://github.com/jtriley/StarCluster/blob/develop/starcluster/cluster.py#L938">https://github.com/jtriley/StarCluster/blob/develop/starcluster/cluster.py#L938</a><br></div><div><br></div><div>self.node_image_id is set during cluster's __init__ . I have a vague memory that this gets stored in the cluster's TAGs in EC2. Do you see a big JSON blob in the tags?</div><div><br>Sorry for the misinformation before. If you're running in develop mode, you can modify the call to add_nodes in balancers/sge/__init__.py to take the image_id from your current config.</div><div><br></div><div>Rajat</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Oct 25, 2017 at 1:30 PM, Colby Taperts <span dir="ltr"><<a href="mailto:colby.taperts@codewilling.com" target="_blank">colby.taperts@codewilling.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hey Raj,<br><br>It does not seem to pick up the new node AMI name and uses the old AMI for the node, even though it is not in the ~/.starcluster/config. <br><br>My steps to reproduce are:<br>1. Setup config with different master/node AMI's<br>2. Start load balancing<br>3. Stop Load Balancing<br>4. Change node AMI<br>5. Start Load balancing<br><br>If I were to terminate the starcluster and start it again then the AMI for the cluster will be updated. Is there another ephemeral location for the starcluster configuration between starting and terminating the cluster? I did look through the source but could not find the reference.<br><br><br><br><br></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Wed, Oct 25, 2017 at 11:48 AM, Rajat Banerjee <span dir="ltr"><<a href="mailto:rajatb@post.harvard.edu" target="_blank">rajatb@post.harvard.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Cody,<div>I don't see why not. I haven't touched the load balancer code in a few years. But from my memory, it reads the config file on startup whenever you run <span style="font-size:12.8px">`starcluster loadbalance </span><span style="font-size:12.8px">s<wbr>tarcluster-name` </span>and will pick up the new AMI then. So if you kill the last loadbalance process, swap the AMI in the config file, then restart, the load balancer should begin adding the new AMI. The new AMI must be compatible with starcluster obviously, and be ready for starcluster and SGE bootstrapping. This is easy to verify by simply using it to start a new cluster as a test.</div><div><br></div><div>Give it a try and let us know?</div><div>Best,</div><div>Raj</div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-7097255775148342762h5">On Wed, Oct 25, 2017 at 12:32 PM, Colby Taperts <span dir="ltr"><<a href="mailto:colby.taperts@codewilling.com" target="_blank">colby.taperts@codewilling.com</a><wbr>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_-7097255775148342762h5"><div dir="ltr">Hello,<br><br>Would it be possible to change the node AMI after the StarCluster is up?<br><br>for example, use the below setup to initialize the StarCluster<br><div><br><div>master_image_id = ami-0330d16a</div><div>master_instance_type = m1.small</div><div>node_image_id = ami-0330d16a</div><div>node_instance_type = m1.small<br><br><br>then change the config to:<br><br><div>master_image_id = ami-0330d16a</div><div>master_instance_type = m1.small</div><div>node_image_id = ami-0111111 # New AMI name</div><div>node_instance_type = m1.small<br><br>Start `starcluster loadbalance starc<wbr>luster-name`<br><br>and have the new node AMI created when a node is needed<br><br>Or would I need to destroy the cluster if I need to set up the new AMI?<br><br>Thanks so much!<span class="m_-7097255775148342762m_4859756730520998568HOEnZb"><font color="#888888"><br>-Colby Taperts</font></span></div></div></div></div>
<br></div></div>______________________________<wbr>_________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" rel="noreferrer" target="_blank">http://mailman.mit.edu/mailman<wbr>/listinfo/starcluster</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div class="m_-7097255775148342762gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div> Colby Taperts</div><div> <span style="margin:0px;padding:0px;border:0px;font-stretch:inherit;line-height:inherit;vertical-align:baseline"><font color="#66696a" face="Helvetica, FreeSans, Liberation Sans, Helmet, Arial, sans-serif"><span style="font-size:12px"><a href="https://maps.google.com/?q=3488+Brentwood+Drive%C2%A0%C2%A0+Suite+104%C2%A0+%C2%A0+Baton+Rouge,+LA+70809&entry=gmail&source=g">3488 Brentwood Drive </a></span></font></span></div><div><span style="margin:0px;padding:0px;border:0px;font-stretch:inherit;line-height:inherit;vertical-align:baseline"><font color="#66696a" face="Helvetica, FreeSans, Liberation Sans, Helmet, Arial, sans-serif"><span style="font-size:12px"><a href="https://maps.google.com/?q=3488+Brentwood+Drive%C2%A0%C2%A0+Suite+104%C2%A0+%C2%A0+Baton+Rouge,+LA+70809&entry=gmail&source=g"> Suite 104 </a></span></font></span></div><div><span style="margin:0px;padding:0px;border:0px;font-stretch:inherit;line-height:inherit;vertical-align:baseline"><font color="#66696a" face="Helvetica, FreeSans, Liberation Sans, Helmet, Arial, sans-serif"><span style="font-size:12px"><a href="https://maps.google.com/?q=3488+Brentwood+Drive%C2%A0%C2%A0+Suite+104%C2%A0+%C2%A0+Baton+Rouge,+LA+70809&entry=gmail&source=g"> Baton Rouge, LA 70809</a></span></font><br></span> <img width="96" height="39" style="font-size:12.8px"></div></div></div>
</font></span></div>
</blockquote></div><br></div>