<div dir="ltr">so I should include "sge" at the end of the plugin list? I tried that but no luck, I think the actual plugin is called "clustersetup" when I see the status of adding a new node, that is what adds the node to SGE? I tried adding that to the end of the plugins and it gave me an error, is it called something else?<br><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jun 27, 2015 at 6:13 PM, Lyn Gerner <span dir="ltr"><<a href="mailto:schedulerqueen@gmail.com" target="_blank">schedulerqueen@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">If you disable_queue=true, and also have your own plugin in front of (preceding) the sge plugin in the plugins= line for your cluster config, then your plugin should run first.</div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jun 27, 2015 at 12:07 PM, James Ching <span dir="ltr"><<a href="mailto:evolve20@gmail.com" target="_blank">evolve20@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thank you for the reply Lyn, yes I do have a def on_add_node, everything works fine with the scaling action, there are no failures. The problem I have is that, the node is added to the SGE queue before the formatting happens. The built-in plugin "clustersetup" executes first before any other plugins get executed so the node gets added and starts accepting jobs before the ephemeral drive gets formatted which causes my jobs to fail because it's looking for the local drive. I do not think there's a way to set the clustersetup plugin to run after custom plugins which would be ideal but maybe I have to customize my plugin to disable the node format then enable? There may be a better way?</div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jun 27, 2015 at 5:54 PM, Lyn Gerner <span dir="ltr"><<a href="mailto:schedulerqueen@gmail.com" target="_blank">schedulerqueen@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi James,<div><br></div><div>Your high-level process seems correct. Do you have a "def on_add_node" line in your plugin?</div><div><br></div><div>If yes, it's probably best if you post your config, plugin, and the log from your failed scaling action.</div><div><br></div><div>Best,<br></div><div>Lyn</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Sat, Jun 27, 2015 at 10:06 AM, James Ching <span dir="ltr"><<a href="mailto:evolve20@gmail.com" target="_blank">evolve20@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr">Re-posting this question, any thoughts on how I may be able to have the clustersetup plugin run after a custom plugin? I have jobs that rely on the local space hence why I want the ephemeral drives formatted first before dropping it into the queue to take jobs.<div><br></div><div>Thanks in advance!<br><div><br></div><div><br><div class="gmail_extra"><div class="gmail_quote">On Wed, May 27, 2015 at 10:29 AM, James Ching <span dir="ltr"><<a href="mailto:evolve20@gmail.com" target="_blank">evolve20@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>I'm currently using a plugin to format the local ephemeral drives and it works great when I launch a new cluster but when I use the load balance feature and it adds nodes to expand the queue, the node being formatted takes in jobs and they end up failing because it's in the process of formatting the drives.</div><div><br></div><div>I tried the queue disable_queue feature and it doesn't seem to work, I also ensured that when I declared PLUGINS, i have the format first, then sge last but still no luck... is there something that I am missing to have the node added to the queue after the plugins are executed?</div><div><br></div><div>Thanks!</div></div>
</blockquote></div><br></div></div></div></div>
<br></div></div>_______________________________________________<br>
StarCluster mailing list<br>
<a href="mailto:StarCluster@mit.edu" target="_blank">StarCluster@mit.edu</a><br>
<a href="http://mailman.mit.edu/mailman/listinfo/starcluster" rel="noreferrer" target="_blank">http://mailman.mit.edu/mailman/listinfo/starcluster</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div></div>