<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>Hi Lyn,</div><div><br></div><div>You have me as a second for improving sharing and EBS handling. I had difficulties with these issues. </div><div><br></div><div>I know Justin had a thread in github discussing improving the NFS share command. Yet there was little progress there. Here is the link:</div><div><a href="https://github.com/jtriley/StarCluster/issues/44">https://github.com/jtriley/StarCluster/issues/44</a></div><div><br></div><div>This may not be the full solution you are looking for, yet there may be parts there you are looking for. </div><div><br></div><div>I hope someone moves in that direction next version. </div><div><br></div><div> Jacob</div><div><br>Sent from my iPhone</div><div><br>On Oct 4, 2013, at 2:26 PM, Lyn Gerner <<a href="mailto:schedulerqueen@gmail.com">schedulerqueen@gmail.com</a>> wrote:<br><br></div><blockquote type="cite"><div><div dir="ltr">Hi Developers, All,<div><br></div><div style="">I am struggling operationally with the snapshots and volumes that starcluster creates when I attach extra (non-root) EBS volumes to the cluster nodes that I launch. </div>
<div style=""><br></div><div style="">I have read everything I can find that's relevant in the mailing list -- in particular, <a href="http://star.mit.edu/cluster/mlarchives/1368.html">this</a> -- and understand that this is just how it's designed to work. </div>
<div style=""><br></div><div style="">As background for anyone unfamiliar with this, currently, starcluster only will NFS-share volumes that are specified in the cluster template. It doesn't share volumes that are already existing devices in an AMI. </div>
<div style=""><br></div><div style="">I have also experimented with the Delete on Termination setting for volumes associated with my AMIs. The volume has to be built into an AMI (as a block device), and has to be attached to an instance when it's terminated, in order for the deletion to take place.</div>
<div style=""><br></div><div style="">Starcluster terminate operation umounts devices and detaches volumes before terminating cluster instances. This negates the Delete on Termination operation for such volumes.</div><div style="">
<br></div><div style="">I would like to be able to have starcluster share such additional volumes that are already present as block devices in the AMI. This would allow me to flip the bit in the AMI that would cause delete-on-termination for the volume.</div>
<div style=""><br></div><div style="">Could we have a new option, basically a "--share-also=<dev>:<mount_point>"? I think you would also need to *not* detach such extra volumes (though you'd of course umount them) in the cluster termination process, in order for the Delete-on-Termination setting to take effect.</div>
<div style=""><br></div><div style="">I acknowledge that it's more complex than I've described, because the "volumes" attached to the instances are actually snapshots, in the way that starcluster (and AWS) functions. I haven't found anything in AWS-land that auto-deletes snapshots on termination.</div>
<div style=""><br></div><div style="">This is all pretty confusing and frustrating. </div><div style=""><br></div><div style="">I'd appreciate it if Justin and others would discuss the feasibility of such a "--share-also" function, any reasons why it could not work correctly, or would foul up the Starcluster design or operations.</div>
<div style=""><br></div><div style="">And if anyone has overcome the operational issue of volumes and snapshots piling up -- that is, if you've automated recognition and deletion of temporary copies of volumes and snapshopts -- I'd love to hear about your approach.</div>
<div style=""><br></div><div style="">Thanks to all,</div><div style="">Lyn</div></div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>StarCluster mailing list</span><br><span><a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a></span><br><span><a href="http://mailman.mit.edu/mailman/listinfo/starcluster">http://mailman.mit.edu/mailman/listinfo/starcluster</a></span><br></div></blockquote></body></html>