[Dspace-general] too many open files

[Jose Blanco]

Mark:

 

Thanks for answering this question.

 

We run index-all nightly, and when I go to the in <dspace>/search dir this
is what I see:

 

-bash-3.00$ pwd

/l1/dspace/repository/prod/search

-bash-3.00$ ls -la

total 2102880

drwxr-xr-x   2 dspace dspace       4096 Dec  5 06:07 .

drwxr-xr-x  13 dspace dspace       4096 Dec  1 10:52 ..

-rw-r--r--   1 dspace dspace          4 Dec  5 06:07 deletable

-rw-r--r--   1 dspace dspace 2151226568 Dec  5 06:07 _s12.cfs

-rw-r--r--   1 dspace dspace         29 Dec  5 06:07 segments

 

Does this look OK to you?

 

Thanks!!

 

  _____  

From: Mark Diggory [mailto:mdiggory at MIT.EDU] 
Sent: Tuesday, December 05, 2006 3:33 PM
To: Jose Blanco
Cc: dspace-tech at lists.sourceforge.net; dspace-general at MIT.EDU
Subject: Re: [Dspace-general] too many open files

 

FilterMedia doesn't actually interact with Lucene directly, only indirectly
in that any generated text bitstreams will get picked up later when
"index-all" is called. So, no, running filtermedia will not solve your too
many files open issue.

 

The current version of <dspace>/bin/index-all will rebuild your entire
lucene search index (and this will be completely optimized as welli). The
usual suggestion is to run it nightly in a cron job on your dspace server.
if you look in <dspace>/search and see many many "segment" files there, this
may suggest that your index is not optimized.

 

Cheers,

Mark

 

 

On Dec 5, 2006, at 2:43 PM, Jose Blanco wrote:





A day ago I posted that we were getting "too many files open" error and I
found this thread today discussing it:

 

http://sourceforge.net/mailarchive/forum.php?forum_id=39921
<http://sourceforge.net/mailarchive/forum.php?forum_id=39921&max_rows=25&sty
le=flat&viewmonth=200408> &max_rows=25&style=flat&viewmonth=200408

 

I'm a bit confused as to what I need to do.  I have version 1.4 of DSpace,
I'm not sure what version of Lucene I have.  Can some one tell me how I can
find that out?  Do I need to get the latest version of Lucene and run
./filter-media with a -f switch to force all items to be re-indexed to
create compound files and get rid of this error?

 

Thanks!

 

Jose

_______________________________________________

Dspace-general mailing list

Dspace-general at mit.edu

http://mailman.mit.edu/mailman/listinfo/dspace-general

 

Mark R. Diggory

~~~~~~~~~~~~~

DSpace Systems Manager

MIT Libraries, Systems and Technology Services

Massachusetts Institute of Technology





 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/pipermail/dspace-general/attachments/20061205/a160d585/attachment.htm