[StarCluster] IPython parallel DirectView not distributing to starcluster nodes.

Austin So austin.so at tomabio.com
Sat Jul 4 15:16:33 EDT 2015


I am not getting a different “result” per se, rather how the engines are defined appears to depend on whether ipcluster is invoked through notebooks or through the command line. 

Regardless, this doesn’t explain why the only recognized domain name is ‘master’ if ipcluster is properly invoked across all nodes when using the attached notebook. This is the reproducible part for me on my setup. None of the node domain names are ever returned. The attached test script is pretty simple, and I think unambiguous. I don’t know what to make of it, which is why I’m asking.

If someone doesn’t see the same thing, rather than thinking it unlikely, then I’d like to know.

A.



> On Jul 3, 2015, at 11:03 AM, MinRK <benjaminrk at gmail.com <mailto:benjaminrk at gmail.com>> wrote:
> 
> Connecting to the same client with the same profile yields different results in the notebook and not? Can you share a notebook demonstrating this problem?
> 
> -MinRK
> 
> On Fri, Jul 3, 2015 at 10:17 AM, Austin So <austin.so at tomabio.com <mailto:austin.so at tomabio.com>> wrote:
> Okay. So it appears to be related to IP[y]: Notebook.
> 
> Running the test script from the command line on the master shows distribution across all nodes. Running it on the same cluster through IP[y]: Notebook just shows the master.
> 
> A.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20150704/18ffa8f5/attachment.htm
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Untitled0.ipynb
Type: application/octet-stream
Size: 2429 bytes
Desc: not available
Url : http://mailman.mit.edu/pipermail/starcluster/attachments/20150704/18ffa8f5/attachment.obj
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20150704/18ffa8f5/attachment-0001.htm


More information about the StarCluster mailing list