<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
Thomas,<div><br></div><div>Thanks for what is also a sensible recommendation.</div><div><br></div><div><div><div>On Aug 29, 2008, at 10:01 AM, Thomas A McGee wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><br><font size="2" face="sans-serif">I missed the chat the other day, so some of this may have been covered and dismissed already. </font> <br> <br><font size="2" face="sans-serif">Tomcat has the capacity to output Apache-style "combined" log files for all requests, including bitstreams. There's a whole host of commercial, shareware and freeware products out there designed to slice-and-dice these Apache log files and pull out all the kinds of reports people seem to be talking about here. </font> <br> <br><font size="2" face="sans-serif">The programs range from the very simple, like Analog, to the extremely complex and expensive, like WebTrends Enterprise. They can be configured to download the log files automatically and run reports on a schedule, so that they're there when you come in in the morning. They can incorporate various filters, resolve user IP addresses, analyze request URL paths (which can be translated into collection and community names), referers, logged-in users, user agents, etc. etc.</font> <br> <br><font size="2" face="sans-serif">Rather than reinvent the wheel (and this is an extremely complex wheel),I think for most users it would pay to look at this approach unless there is something really esoteric about your traffic that you are trying to get at. </font> <br></blockquote></div></div><div><br></div><div>Its an inherent issue in the the "address space" of DSpace resources made available in the web-application. For instance. I may have the following Community, Collection and Item</div><div><br></div><div>Computer Science and Artificial Intelligence Lab (CSAIL)</div><div><a href="http://dspace.mit.edu/handle/1721.1/5458">http://dspace.mit.edu/handle/1721.1/5458</a></div><div><br></div><div>CSAIL Technical Reports (July 1, 2003 - present)</div><div><a href="http://dspace.mit.edu/handle/1721.1/29807">http://dspace.mit.edu/handle/1721.1/29807</a></div><div><br></div><div>Adaptive Envelope MDPs for Relational Equivalence-based Planning</div><div><a href="http://dspace.mit.edu/handle/1721.1/41920">http://dspace.mit.edu/handle/1721.1/41920</a></div><div><br></div><div>Via the perception of the Apache/Tomcat logs Requests to these resources are made and based on those logs its quite difficult to ascertain that there is a hierarchy here:</div><div><br></div><div><div>/1721.1/5458 <-- Community</div><div> /1721.1/29807 <-- Collection</div><div> /1721.1/41920 <-- Item</div><div><br></div><div>The challenge is that most logging packages given the lack of the above structure being absent in the path of the resource, cannot roll up the statistics to represent the aggregations at the collection and item level that Managers want to see for a DSpace Community/Collection.</div><div><br></div><div>Likewise, we are in a situation where we are trying to maintain</div><div><br></div><div>1.) Not introducing a ridged expectation that "paths" for which resources are represented can not change over time as dspace evolves</div><div>2.) That we may have more than one path for which a resource is accessed, and may want to either treat those accesses as "the same" or treat them as "uniquely different" statistically.</div><div>3.) That we want to allow hooks so that these stats can be collected off the "logical event" in DSpace rather than the "physical event" in the application server.</div></div><div><br></div><div>By configuring a stats solution like analog/awstats/webtrends, we are restricted to only gathering statistics about the physical event of requesting that address in the web service. And likewise, if that address representing that resource changes in UI (either via development decisions or administrative decisions) then that configuration of that external software will be out of sync and need to be adjusted. By having the application report "logical events" we can step away from this issue. By internalizing the statistics gathering and generation, we have an opportunity to create a solution that can allow DSpace to freely evolve and solution that will meet the requirements requested by the community (or more explicitly, exhibited by the Minho addon).</div><div><br></div><div>Cheers,</div><div>Mark</div><br><div> <span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; -webkit-text-decorations-in-effect: none; text-indent: 0px; -webkit-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; -webkit-text-decorations-in-effect: none; text-indent: 0px; -webkit-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><span class="Apple-style-span" style="border-collapse: separate; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; -webkit-text-decorations-in-effect: none; text-indent: 0px; -webkit-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><span class="Apple-style-span" style="border-collapse: separate; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; -webkit-text-decorations-in-effect: none; text-indent: 0px; -webkit-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><div>~~~~~~~~~~~~~</div><div>Mark R. Diggory - DSpace Developer and Systems Manager</div><div>MIT Libraries, Systems and Technology Services</div><div>Massachusetts Institute of Technology</div><div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Home Page: <a href="http://purl.org/net/mdiggory/homepage">http://purl.org/net/mdiggory/homepage</a></div></div><div><br class="khtml-block-placeholder"></div><br class="Apple-interchange-newline"></span></span></span></div></span></div></span><br class="Apple-interchange-newline"></span><br class="Apple-interchange-newline"></span></span></span> </div><br></body></html>