[StarCluster] CPU load

Christopher Clearfield chris.clearfield at system-logic.com
Thu Jul 30 03:33:24 EDT 2015


Hi All,
I'm running a set of about 60K relatively short jobs that take 30 minutes
to run. This is through ipython parallel.

Yet my CPU utilization levels are relatively small:

queuename qtype resv/used/tot. load_avg arch states
---------------------------------------------------------------------------------
all.q at master BIP 0/0/2 0.98 linux-x64
---------------------------------------------------------------------------------
all.q at node001 BIP 0/0/8 8.01 linux-x64
---------------------------------------------------------------------------------
all.q at node002 BIP 0/0/8 8.07 linux-x64
---------------------------------------------------------------------------------
all.q at node003 BIP 0/0/8 7.96 linux-x64

(I disabled the ipython engines on master because I was having heartbeat
timeout issues with the worker engines on my nodes, which explains why that
is so low).

But ~8% utilization on the nodes. Is that expected?

Thanks,
Chris
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/starcluster/attachments/20150730/0e4f2cfa/attachment.htm


More information about the StarCluster mailing list