<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div><span></span></div><div><meta http-equiv="content-type" content="text/html; charset=utf-8"><div>Hi Ya,</div><div><br></div><div>When you execute it, do check that you are using the home directory since this is the only one shared by all modes and master by default. </div><div><br></div><div>Also, I notice you use iron python. To simplify things, can you run using sshmaster and sshnode. This may give you additional indication on what is going on. </div><div><br></div><div>I am unsure of a solution, yet these seem reasonable steps to check. </div><div><br></div><div>I hope this helps narrow down the issue. </div><div><br></div><div> Jacob</div><div><br></div><div><br></div><div><br>Sent from my iPhone</div><div><br>On Aug 18, 2014, at 2:49 PM, Ya Xue <<a href="mailto:yxue@measinc.com">yxue@measinc.com</a>> wrote:<br><br></div><blockquote type="cite"><div>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 12 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal">Hi, <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I have a script that needs to import a module and the module name is given as an input parameter. It works well on a local machine but generates “ImportError” with StarCluster. Here is a simple script that can reproduce the error:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">error.py:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">def imp(fname):<o:p></o:p></p>
<p class="MsoNormal"> if fname[-3:] == '.py':<o:p></o:p></p>
<p class="MsoNormal"> fname = fname[:-3]<o:p></o:p></p>
<p class="MsoNormal"> exec('import ' + fname + ' as params')<o:p></o:p></p>
<p class="MsoNormal"> print params.alpha<o:p></o:p></p>
<p class="MsoNormal"> f = open(fname+'_alpha.txt', 'w')<o:p></o:p></p>
<p class="MsoNormal"> f.write('%f' % params.alpha)<o:p></o:p></p>
<p class="MsoNormal"> f.close()<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">If I run it on the StarCluster master, no problem:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [1]: run error.py<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [3]: imp('p1.py')<o:p></o:p></p>
<p class="MsoNormal">1<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">However, on the cluster:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [4]: from IPython.parallel import Client<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [5]: c = Client()<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [6]: v = c[:]<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [7]: files = ['p1.py','p2.py','p3.py']<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [8]: r = v.map(imp, files)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [9]: r[0]<o:p></o:p></p>
<p class="MsoNormal">[0:apply]: <o:p></o:p></p>
<p class="MsoNormal">---------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">ImportError Traceback (most recent call last)<string> in <module>()<o:p></o:p></p>
<p class="MsoNormal">/home/ya/Code/error.py in imp(fname)<o:p></o:p></p>
<p class="MsoNormal"> 4 if fname[-3:] == '.py':<o:p></o:p></p>
<p class="MsoNormal"> 5 fname = fname[:-3]<o:p></o:p></p>
<p class="MsoNormal">----> 6 exec('import ' + fname + ' as params')<o:p></o:p></p>
<p class="MsoNormal"> 7 print params.alpha<o:p></o:p></p>
<p class="MsoNormal"> 8 f = open(fname+'_alpha.txt', 'w')<o:p></o:p></p>
<p class="MsoNormal"><string> in <module>()<o:p></o:p></p>
<p class="MsoNormal">ImportError: No module named p1<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Does anyone know how to fix it?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">Ya<o:p></o:p></p>
</div>
<br>
<font face="Arial" color="Gray" size="2">This email (including any attachments) may contain confidential information intended solely for acknowledged recipients. If you think you have received this information in error, please reply to the sender and delete
all copies from your system. Please note that unauthorized use, disclosure, or further distribution of this information is prohibited by the sender. Note also that we may monitor email directed to or originating from our network. Thank you for your consideration
and assistance. |<br>
</font>
</div></blockquote><blockquote type="cite"><div><p3.py></div></blockquote><blockquote type="cite"><div><p2.py></div></blockquote><blockquote type="cite"><div><p1.py></div></blockquote><blockquote type="cite"><div><error.py></div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>StarCluster mailing list</span><br><span><a href="mailto:StarCluster@mit.edu">StarCluster@mit.edu</a></span><br><span><a href="http://mailman.mit.edu/mailman/listinfo/starcluster">http://mailman.mit.edu/mailman/listinfo/starcluster</a></span><br></div></blockquote></div></body></html>