[StarCluster] Using DRMAA on StarCluster

[Justin Riley]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Chris/Min,

I'm super behind on responding to mailing list threads. Apologies to all!

You're correct that DRMAA_LIBRARY_PATH has to be exported. Fortunately
this is already fixed in the latest github version of StarCluster via
the following merged PR from jakebiesinger:

https://github.com/jtriley/StarCluster/pull/122

HTH,

~Justin

On 07/29/2012 08:25 PM, Chris Diehl wrote:
> FYI I was able to successfully submit a job following the
> tutorial. Note that if you start with the "Running a job" example,
> you will need a "s.initialize()" statement after "s =
> drmaa.Session()".
> 
> Chris
> 
> On Sun, Jul 29, 2012 at 5:16 PM, Chris Diehl <cpdiehl at gmail.com> 
> wrote:
>> This export statement seems to solve the problem I was having. 
>> export 
>> DRMAA_LIBRARY_PATH="/opt/sge6-fresh/lib/linux-x64/libdrmaa.so.1.0"
>>
>>
>>
>>
>>
>>
>> 
Going to try the tutorial example for submitting a job now.
>> http://code.google.com/p/drmaa-python/wiki/Tutorial
>> 
>> On Sun, Jul 29, 2012 at 5:13 PM, MinRK <benjaminrk at gmail.com> 
>> wrote:
>>> From IPython's perspective, I would love to use a Python 
>>> library, rather than qsub via a subprocess to launch engines 
>>> with SGE in ipcluster.
>>> 
>>> On Sun, Jul 29, 2012 at 4:56 PM, Chris Diehl 
>>> <cpdiehl at gmail.com> wrote:
>>>> 
>>>> Hi Justin,
>>>> 
>>>> Should I be able to use DRMAA on a StarCluster instance to 
>>>> submit jobs from Python to the Grid Engine? It appears 
>>>> drmaa-python is installed. When I try to do an "import 
>>>> drmaa", I get the following response.
>>>> 
>>>> root at master:/usr# python Python 2.7.2+ (default, Oct  4 2011,
>>>> 20:06:09) [GCC 4.6.1] on linux2 Type "help", "copyright",
>>>> "credits" or "license" for more information.
>>>>>>> import drmaa
>>>> Traceback (most recent call last): File "<stdin>", line 1, in
>>>> <module> File 
>>>> "/usr/local/lib/python2.7/dist-packages/drmaa/__init__.py", 
>>>> line 41, in <module> import drmaa.wrappers as _w File 
>>>> "/usr/local/lib/python2.7/dist-packages/drmaa/wrappers.py", 
>>>> line 43, in <module> raise RuntimeError(errmsg) RuntimeError:
>>>> could not find drmaa library. Please specify its full path
>>>> using the environment variable DRMAA_LIBRARY_PATH
>>>>>>> 
>>>> 
>>>> The Python DRMAA library looked like a good way to submit and
>>>> monitor jobs running in SGE from Python. So I'd like to get
>>>> this up and running if possible.
>>>> 
>>>> Any suggestions you have would be most appreciated!
>>>> 
>>>> Chris _______________________________________________ 
>>>> StarCluster mailing list StarCluster at mit.edu 
>>>> http://mailman.mit.edu/mailman/listinfo/starcluster
>>> 
>>> 

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAlAYBhYACgkQ4llAkMfDcrnFCwCggmH6TgrdphtjoZtj5N3UOiCd
n+wAn1goL7qVRVtGVA0jk3JkPHdfjhw6
=vWll
-----END PGP SIGNATURE-----