<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 12 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi, <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I have a script that needs to import a module and the module name is given as an input parameter. It works well on a local machine but generates “ImportError” with StarCluster. Here is a simple script that can reproduce the error:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">error.py:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">def imp(fname):<o:p></o:p></p>
<p class="MsoNormal"> if fname[-3:] == '.py':<o:p></o:p></p>
<p class="MsoNormal"> fname = fname[:-3]<o:p></o:p></p>
<p class="MsoNormal"> exec('import ' + fname + ' as params')<o:p></o:p></p>
<p class="MsoNormal"> print params.alpha<o:p></o:p></p>
<p class="MsoNormal"> f = open(fname+'_alpha.txt', 'w')<o:p></o:p></p>
<p class="MsoNormal"> f.write('%f' % params.alpha)<o:p></o:p></p>
<p class="MsoNormal"> f.close()<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">If I run it on the StarCluster master, no problem:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [1]: run error.py<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [3]: imp('p1.py')<o:p></o:p></p>
<p class="MsoNormal">1<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">However, on the cluster:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [4]: from IPython.parallel import Client<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [5]: c = Client()<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [6]: v = c[:]<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [7]: files = ['p1.py','p2.py','p3.py']<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [8]: r = v.map(imp, files)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In [9]: r[0]<o:p></o:p></p>
<p class="MsoNormal">[0:apply]: <o:p></o:p></p>
<p class="MsoNormal">---------------------------------------------------------------------------<o:p></o:p></p>
<p class="MsoNormal">ImportError Traceback (most recent call last)<string> in <module>()<o:p></o:p></p>
<p class="MsoNormal">/home/ya/Code/error.py in imp(fname)<o:p></o:p></p>
<p class="MsoNormal"> 4 if fname[-3:] == '.py':<o:p></o:p></p>
<p class="MsoNormal"> 5 fname = fname[:-3]<o:p></o:p></p>
<p class="MsoNormal">----> 6 exec('import ' + fname + ' as params')<o:p></o:p></p>
<p class="MsoNormal"> 7 print params.alpha<o:p></o:p></p>
<p class="MsoNormal"> 8 f = open(fname+'_alpha.txt', 'w')<o:p></o:p></p>
<p class="MsoNormal"><string> in <module>()<o:p></o:p></p>
<p class="MsoNormal">ImportError: No module named p1<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Does anyone know how to fix it?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">Ya<o:p></o:p></p>
</div>
<br>
<font face="Arial" color="Gray" size="2">This email (including any attachments) may contain confidential information intended solely for acknowledged recipients. If you think you have received this information in error, please reply to the sender and delete
all copies from your system. Please note that unauthorized use, disclosure, or further distribution of this information is prohibited by the sender. Note also that we may monitor email directed to or originating from our network. Thank you for your consideration
and assistance. |<br>
</font>
</body>
</html>