[StarCluster] parallel ssh support?
Ryan G
ngsbioinformatics at gmail.com
Thu Apr 16 13:37:24 EDT 2015
Turns out this is supported by StarCluster in the config file using
USERDATA_SCRIPTS
On Thu, Apr 16, 2015 at 10:52 AM, Ryan G <ngsbioinformatics at gmail.com>
wrote:
> I've discovered AWS allows you to upload user data aka a script that is
> run when an instance us brought up. Perhaps this is the way to configure
> in parallel. I'll look into this more if someone hasn't already.
>
> On Mon, Apr 13, 2015 at 2:53 PM, MacMullan, Hugh <
> hughmac at wharton.upenn.edu> wrote:
>
>> I concur. Threading for this? It's pretty non-intensive, just
>> time-consuming. And adding/removing nodes can be pretty painful, as well,
>> as it monkeys (serially) with /etc/hosts, keys, etc.
>>
>>
>>
>> -Hugh
>>
>>
>>
>> *From:* starcluster-bounces at mit.edu [mailto:starcluster-bounces at mit.edu] *On
>> Behalf Of *Ryan G
>> *Sent:* Monday, April 13, 2015 2:43 PM
>> *To:* starcluster at mit.edu
>> *Subject:* [StarCluster] parallel ssh support?
>>
>>
>>
>> Hi all - Whenever I launch a cluster with a large # of nodes, I have to
>> wait quite a bit of time because each node has to be configured
>> separately. The commands in my custom plugin are the same regardless of
>> machine. I was wondering if there was any support in StarCluster to use
>> parallel-ssh to run the plugin on all the nodes at once? This could save a
>> lot of start-up time....
>>
>> Ryan
>>
>> _______________________________________________
>> StarCluster mailing list
>> StarCluster at mit.edu
>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20150416/8812f4ee/attachment.htm
More information about the StarCluster
mailing list