<HTML><BODY style="word-wrap: break-word; -khtml-nbsp-mode: space; -khtml-line-break: after-white-space; ">Jose,<DIV><BR class="khtml-block-placeholder"></DIV><DIV>This may have much more to do with the number of available inodes on that disk than on the search or filter media, you might do something like "df -i" and post its result to this thread.</DIV><DIV><BR class="khtml-block-placeholder"></DIV><DIV>-Mark</DIV><DIV><BR><DIV><DIV>On Dec 5, 2006, at 3:36 PM, Jose Blanco wrote:</DIV><BR class="Apple-interchange-newline"><BLOCKQUOTE type="cite"> <DIV class="Section1"><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">Mark:<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy"><O:P> </O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">Thanks for answering this question.<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy"><O:P> </O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">We run index-all nightly, and when I go to the </SPAN></FONT>in <dspace>/search dir this is what I see:<O:P></O:P></P><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">-bash-3.00$ pwd<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">/l1/dspace/repository/prod/search<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">-bash-3.00$ ls -la<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">total 2102880<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">drwxr-xr-x 2 dspace dspace 4096 Dec 5 06:07 .<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">drwxr-xr-x 13 dspace dspace 4096 Dec 1 10:52 ..<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">-rw-r--r-- 1 dspace dspace 4 Dec 5 06:07 deletable<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">-rw-r--r-- 1 dspace dspace 2151226568 Dec 5 06:07 _s12.cfs<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">-rw-r--r-- 1 dspace dspace 29 Dec 5 06:07 segments<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy"><O:P> </O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">Does this look OK to you?<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy"><O:P> </O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy">Thanks!!<O:P></O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="2" color="navy" face="Arial"><SPAN style="font-size: 10.0pt;font-family:Arial;color:navy"><O:P> </O:P></SPAN></FONT></P> <DIV> <DIV class="MsoNormal" align="center" style="text-align:center"><FONT size="3" face="Times New Roman"><SPAN style="font-size:12.0pt"> <HR size="2" width="100%" align="center" tabindex="-1"> </SPAN></FONT></DIV><P class="MsoNormal"><B><FONT size="2" face="Tahoma"><SPAN style="font-size:10.0pt; font-family:Tahoma;font-weight:bold">From:</SPAN></FONT></B><FONT size="2" face="Tahoma"><SPAN style="font-size:10.0pt;font-family:Tahoma"> Mark Diggory [<A href="mailto:mdiggory@MIT.EDU">mailto:mdiggory@MIT.EDU</A>] <BR> <B><SPAN style="font-weight:bold">Sent:</SPAN></B> Tuesday, December 05, 2006 3:33 PM<BR> <B><SPAN style="font-weight:bold">To:</SPAN></B> Jose Blanco<BR> <B><SPAN style="font-weight:bold">Cc:</SPAN></B> <A href="mailto:dspace-tech@lists.sourceforge.net">dspace-tech@lists.sourceforge.net</A>; <A href="mailto:dspace-general@MIT.EDU">dspace-general@MIT.EDU</A><BR> <B><SPAN style="font-weight:bold">Subject:</SPAN></B> Re: [Dspace-general] too many open files</SPAN></FONT><O:P></O:P></P> </DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt">FilterMedia doesn't actually interact with Lucene directly, only indirectly in that any generated text bitstreams will get picked up later when "index-all" is called. So, no, running filtermedia will not solve your too many files open issue.<O:P></O:P></SPAN></FONT></P> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt">The current version of <dspace>/bin/index-all will rebuild your entire lucene search index (and this will be completely optimized as welli). The usual suggestion is to run it nightly in a cron job on your dspace server. if you look in <dspace>/search and see many many "segment" files there, this may suggest that your index is not optimized.<O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt">Cheers,<O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt">Mark<O:P></O:P></SPAN></FONT></P> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P> <DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt">On Dec 5, 2006, at 2:43 PM, Jose Blanco wrote:<O:P></O:P></SPAN></FONT></P> </DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><BR> <BR> <O:P></O:P></SPAN></FONT></P> <DIV><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial">A day ago I posted that we were getting “too many files open” error and I found this thread today discussing it:<O:P></O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial"><O:P> </O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial"><A href="http://sourceforge.net/mailarchive/forum.php?forum_id=39921&max_rows=25&style=flat&viewmonth=200408">http://sourceforge.net/mailarchive/forum.php?forum_id=39921&max_rows=25&style=flat&viewmonth=200408</A><O:P></O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial"><O:P> </O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial">I’m a bit confused as to what I need to do. I have version 1.4 of DSpace, I’m not sure what version of Lucene I have. Can some one tell me how I can find that out? Do I need to get the latest version of Lucene and run ./filter-media with a –f switch to force all items to be re-indexed to create compound files and get rid of this error?<O:P></O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial"><O:P> </O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial">Thanks!<O:P></O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial"><O:P> </O:P></SPAN></FONT><O:P></O:P></P><P class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><FONT size="2" face="Arial"><SPAN style="font-size:10.0pt;font-family:Arial">Jose<O:P></O:P></SPAN></FONT><O:P></O:P></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt">_______________________________________________<O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt">Dspace-general mailing list<O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><A href="mailto:Dspace-general@mit.edu">Dspace-general@mit.edu</A><O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><A href="http://mailman.mit.edu/mailman/listinfo/dspace-general">http://mailman.mit.edu/mailman/listinfo/dspace-general</A><O:P></O:P></SPAN></FONT></P> </DIV> </DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P> <DIV><SPAN style="border-spacing: 0px 0px;text-align:auto;-khtml-text-decorations-in-effect: none; -apple-text-size-adjust: auto;orphans: 2;widows: 2;word-spacing:0px"><SPAN style="border-spacing: 0px 0px;text-align:auto;-khtml-text-decorations-in-effect: none; -apple-text-size-adjust: auto;orphans: 2;widows: 2;word-spacing:0px"> <DIV><P class="MsoNormal"><FONT size="1" color="black" face="Helvetica"><SPAN style="font-size:9.0pt;font-family:Helvetica;color:black"><SPAN style="border-spacing: 0px 0px;text-align:auto;-khtml-text-decorations-in-effect: none; -apple-text-size-adjust: auto;orphans: 2;widows: 2;word-spacing:0px"><SPAN style="border-spacing: 0px 0px;text-align:auto;-khtml-text-decorations-in-effect: none; -apple-text-size-adjust: auto;orphans: 2;widows: 2;word-spacing:0px"><SPAN style="border-spacing: 0px 0px;text-align:auto;-khtml-text-decorations-in-effect: none; -apple-text-size-adjust: auto;orphans: 2;widows: 2;word-spacing:0px"><SPAN style="border-spacing: 0px 0px;text-align:auto;-khtml-text-decorations-in-effect: none; -apple-text-size-adjust: auto;orphans: 2;widows: 2;word-spacing:0px">Mark R. Diggory<O:P></O:P></SPAN></SPAN></SPAN></SPAN></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="1" color="black" face="Helvetica"><SPAN style="font-size:9.0pt;font-family:Helvetica;color:black">~~~~~~~~~~~~~<O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="1" color="black" face="Helvetica"><SPAN style="font-size:9.0pt;font-family:Helvetica;color:black">DSpace Systems Manager<O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="1" color="black" face="Helvetica"><SPAN style="font-size:9.0pt;font-family:Helvetica;color:black">MIT Libraries, Systems and Technology Services<O:P></O:P></SPAN></FONT></P> </DIV> <DIV><P class="MsoNormal"><FONT size="1" color="black" face="Helvetica"><SPAN style="font-size:9.0pt;font-family:Helvetica;color:black">Massachusetts Institute of Technology<O:P></O:P></SPAN></FONT></P> </DIV> </SPAN><P class="MsoNormal"><FONT size="1" color="black" face="Helvetica"><SPAN style="font-size:9.0pt;font-family:Helvetica;color:black"><BR> <BR> </SPAN></FONT><O:P></O:P></P> </SPAN></DIV><P class="MsoNormal"><FONT size="3" face="Times New Roman"><SPAN style="font-size: 12.0pt"><O:P> </O:P></SPAN></FONT></P> </DIV> </DIV> </DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">-------------------------------------------------------------------------</DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Take Surveys. Earn Cash. Influence the Future of IT</DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Join SourceForge.net's Techsay panel and you'll get the chance to share your</DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">opinions on IT & business topics through brief surveys - and earn cash</DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><A href="http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV_______________________________________________">http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV_______________________________________________</A></DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">DSpace-tech mailing list</DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><A href="mailto:DSpace-tech@lists.sourceforge.net">DSpace-tech@lists.sourceforge.net</A></DIV><DIV style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><A href="https://lists.sourceforge.net/lists/listinfo/dspace-tech">https://lists.sourceforge.net/lists/listinfo/dspace-tech</A></DIV> </BLOCKQUOTE></DIV><BR><DIV> <SPAN class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><SPAN class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><SPAN class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><SPAN class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><SPAN class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><SPAN class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><DIV>Mark R. Diggory</DIV><DIV>~~~~~~~~~~~~~</DIV><DIV>DSpace Systems Manager</DIV><DIV>MIT Libraries, Systems and Technology Services</DIV><DIV>Massachusetts Institute of Technology</DIV></SPAN><SPAN><BR class="Apple-interchange-newline"></SPAN><SPAN></SPAN></SPAN></SPAN></SPAN></SPAN></SPAN> </DIV><BR></DIV></BODY></HTML>