<html><head><style>body{font-family:Helvetica,Arial;font-size:13px}</style></head><body style="word-wrap:break-word;line-break:after-white-space"><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Hi Sergio,</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">The _get_volume_device function in volume.py will also need to be modified. There seem to be utilities (name id-ctrl) that can map the NVMe device to a volume id. I don’t know if doing this upfront on the base image will resolve the mount issues without having to modify the underlying code. </div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Cheers,</div><div id="bloop_customfont" style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Vasisht</div> <br> <div id="bloop_sign_1524152539948040960" class="bloop_sign"></div> <br><p class="airmail_on">On April 19, 2018 at 8:25:26 AM, Sergio Mafra (<a href="mailto:sergiohmafra@gmail.com">sergiohmafra@gmail.com</a>) wrote:</p> <blockquote type="cite" class="clean_bq"><span><div><div></div><div>
<title></title>
<div dir="ltr">Hi folks,
<div><br></div>
<div>Unfortunately it seems that this will require a change in the
code of StarCluster to comply with the new C5 instances and its new
devices.</div>
<div>If you take a look to clustersetup.py, you can notice that
some job must be done.</div>
<div><br></div>
<div>All best,</div>
<div><br></div>
<div>Sergio</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2018-04-18 20:28 GMT-03:00 Lyn Gerner
<span dir="ltr"><<a href="mailto:schedulerqueen@gmail.com" target="_blank">schedulerqueen@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Sergio, sounds like you're getting close.
/dev/xvdz is the real device behind the link to it that some
Linux variants create, which would be (the perhaps more familiar to
starcluster users) /dev/sdz. You will need to update any reference
to it from /dev/xvdz to /dev/nvme25n01. (In NVMe land, "a" maps to
0 (zero), b maps to 1, ... , z maps to 25.)
<div><br></div>
<div><br></div>
</div>
<div class="HOEnZb">
<div class="h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, Apr 18, 2018 at 2:28 PM, Colby
Taperts <span dir="ltr"><<a href="mailto:colby.taperts@codewilling.com" target="_blank">colby.taperts@codewilling.com</a><wbr>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><span style="font-size:small">Hi
Sergio, <br></span><br style="font-size:small">
<font size="2">I would check the `~/.starcluster/config` file looks
like you copied over an older config and have the leftover volumes
in there still.</font><br>
<br>
Also<font size="2">, see <a href="http://star.mit.edu/cluster/docs/0.93.3/manual/configuration.html" target="_blank">http://star.mit.edu/cluster/do<wbr>cs/0.93.3/manual/configuration<wbr>.html</a> it
may help you out</font><br>
<br>
Good luck,<br>
Colby</div>
<div class="m_5065401060812702087HOEnZb">
<div class="m_5065401060812702087h5"><br>
<div class="gmail_quote">
<div dir="ltr">On Wed, Apr 18, 2018 at 4:19 PM Sergio Mafra
<<a href="mailto:sergiohmafra@gmail.com" target="_blank">sergiohmafra@gmail.com</a>> wrote:<br></div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi folks..
<div><br></div>
<div>Good news.. I´ve managed to resolve the previous issue with
SGEPlugin just by deleting /opt/sge6 in the AMI base.</div>
<div><br></div>
<div>Now the problem is the following:</div>
<div><br></div>
<div>
<div>*** WARNING - Cannot find device /dev/xvdz for volume
vol-0d8792d3f9ae70b7a</div>
<div>*** WARNING - Not mounting vol-0d8792d3f9ae70b7a on
/home</div>
<div>*** WARNING - This usually means there was a problem attaching
the EBS volume to the master node</div>
</div>
<div><br></div>
<div>Starcluster is looking for old names for EBS.. how to manage
that in the C5 instance?</div>
<div><br></div>
<div>All best,</div>
<div><br></div>
<div>Sergio</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">2018-04-18 8:54 GMT-03:00 Sergio Mafra
<span dir="ltr"><<a href="mailto:sergiohmafra@gmail.com" target="_blank">sergiohmafra@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi Teddy,
<div><br></div>
<div>It´s really odd. I´ve got two base AMI for StarCluster.. one
for Ubuntu 14.04 and other for Ubuntu 16.04.</div>
<div>The oldest one (14.04) has been converted to ENA with no
problems, but when I tried to provision it with StarCluster, it
gave a old error of SGEpluging:</div>
<div><span style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">
!!! ERROR - Error occured while running
plugin<span> </span></span><br style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">
<span style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">
'starcluster.plugins.sge.SGEPl<wbr>ugin':<span> </span></span><br style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">
<span style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">
!!! ERROR - remote command 'source /etc/profile && cd
/opt/sge6 &&<span> </span></span><br style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">
<span style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">
!!! ERROR - TERM=rxvt ./inst_sge_sc -x -noremote -auto
./ec2_sge.conf'<span> </span></span><br style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">
<span style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">
!!! ERROR - failed with status
1:<span> </span></span><br style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">
<span style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">
!!! ERROR - Reading configuration from file
./ec2_sge.conf<span> </span></span><br style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">
<span style="color:rgb(62,67,73);font-family:NobileRegular,sans-serif;font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">
!!! ERROR - [H[2J<span> </span></span><br></div>
<div>The 16.04 seems not to be ENA converted... and became
unreachable.</div>
<div><br></div>
<div>I don´t have a AWS support...:(</div>
<div><br></div>
<div>All best,</div>
<div><br>
Sergio</div>
</div>
<div class="m_5065401060812702087m_1003373482241852550m_-2717902676141870829HOEnZb">
<div class="m_5065401060812702087m_1003373482241852550m_-2717902676141870829h5">
<div class="gmail_extra"><br>
<div class="gmail_quote">2018-04-17 19:36 GMT-03:00 Teddy Thomas
<span dir="ltr"><<a href="mailto:tjthomas292@gmail.com" target="_blank">tjthomas292@gmail.com</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div>
<div>Hi Sergio-<br>
<br></div>
I looked in the GitHub repo's issue for the Amazon drivers, and
found someone having a similar issue, though with Debian instead of
Ubuntu: <a href="https://github.com/amzn/amzn-drivers/issues/63" target="_blank">https://github.com/amzn/amzn-d<wbr>rivers/issues/63</a>.
It's possible there's an issue with the driver, or something in the
AMI. In the issue, the recommended reaching out to AWS. Have you
reached out to AWS Support yet? If you do end up finding out the
problem, or get this working, I'd be curious to know about it. I
hope that's a pointer in the right direction at least, and sorry
I'm not more help.<br>
<br></div>
-Teddy<br></div>
<br>
<div class="gmail_quote">
<div>
<div class="m_5065401060812702087m_1003373482241852550m_-2717902676141870829m_-3868267854630574442h5">
<div dir="ltr">On Mon, Apr 16, 2018 at 12:55 PM Sergio Mafra
<<a href="mailto:sergiohmafra@gmail.com" target="_blank">sergiohmafra@gmail.com</a>> wrote:<br></div>
</div>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>
<div class="m_5065401060812702087m_1003373482241852550m_-2717902676141870829m_-3868267854630574442h5">
<div dir="ltr">Hi fellows,
<div><br></div>
<div>I´ve tried to prepare the StarCluster AMI Ubuntu 16.04
Public - ami-040b6113 to be compatible iuth ENA and so, able to be
provisioned as C5 instance type.</div>
<div><br></div>
<div>I´ve followed this steps: <a href="https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/enhanced-networking-ena.html#enhanced-networking-ena-ubuntu" target="_blank">https://docs.aws.amazon<wbr>.com/AWSEC2/latest/UserGuide/<wbr>enhanced-networking-ena.html#<wbr>enhanced-networking-ena-ubuntu</a><wbr>. </div>
<div><br></div>
<div>After rebooting, the instance could not be reached as
provisioned as C5 type.</div>
<div><br></div>
<div>Does anyone has made progress on this...</div>
<div><br></div>
<div>All best,</div>
<div><br>
Sergio Mafra</div>
</div>
</div>
</div>
<span>______________________________<wbr>_________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" rel="noreferrer" target="_blank">http://mailman.mit.edu/mailman<wbr>/listinfo/starcluster</a><br>
</span></blockquote>
</div>
<span class="m_5065401060812702087m_1003373482241852550m_-2717902676141870829m_-3868267854630574442HOEnZb"><font color="#888888">--<br>
</font></span>
<div dir="ltr" class="m_5065401060812702087m_1003373482241852550m_-2717902676141870829m_-3868267854630574442m_-5102377599569763919gmail_signature" data-smartmail="gmail_signature">
<div dir="ltr"><span class="m_5065401060812702087m_1003373482241852550m_-2717902676141870829m_-3868267854630574442HOEnZb">
<font color="#888888">Sent from my iPhone</font></span></div>
</div>
</blockquote>
</div>
<br></div>
</div>
</div>
</blockquote>
</div>
<br></div>
______________________________<wbr>_________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" rel="noreferrer" target="_blank">http://mailman.mit.edu/mailman<wbr>/listinfo/starcluster</a><br>
</blockquote>
</div>
</div>
</div>
<br>
______________________________<wbr>_________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" rel="noreferrer" target="_blank">http://mailman.mit.edu/mailman<wbr>/listinfo/starcluster</a><br>
<br></blockquote>
</div>
<br></div>
</div>
</div>
</blockquote>
</div>
<br></div>
_______________________________________________
<br>StarCluster mailing list
<br><a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a>
<br><a href="http://mailman.mit.edu/mailman/listinfo/starcluster">http://mailman.mit.edu/mailman/listinfo/starcluster</a>
<br></div></div></span></blockquote></body></html>