Project

General

Profile

Task #3527

Story #3526: Material required for Reverse Site Visit

Collate logs from production member nodes for metrics reporting

Added by Dave Vieglais over 11 years ago. Updated over 11 years ago.

Status:
Closed
Priority:
Urgent
Assignee:
Robert Waltz
Category:
-
Target version:
-
Start date:
2013-01-30
Due date:
2013-02-11
% Done:

100%

Milestone:
None
Product Version:
*
Story Points:
Sprint:

Description

Logs from production member nodes need to be retrieved and processed to generate summary statistics indicating:

  • Number of object retrievals (get) per member node

  • Total number of object retrievals (sum of all member and coordinating nodes)

ProductionReadCount.out - Production CN Read Count (3.16 KB) Robert Waltz, 2013-02-13 07:07

reads-by-date-20130212.png - Reads by Date (10.3 KB) Matthew Jones, 2013-02-13 19:28

164

History

#1 Updated by Ben Leinfelder over 11 years ago

-- total read events since July 2012, excludes any DataONE node
SELECT event, count(*) as count
FROM access_log
WHERE date_logged >= '07/01/2012'
AND event = 'read'
AND principal not like 'CN=urn:node:%'
GROUP BY event
order by event, count desc;

#2 Updated by Robert Waltz over 11 years ago

#3 Updated by Matthew Jones over 11 years ago

164

For context, I plotted the reads over time for each month on the KNB. There is a distinct change in 2012. I've attached the graph, and here's the query that I used to generate the plot.

SELECT event, extract(year from date_logged) as yr, extract(month from date_logged) as mnth, count(*) as count FROM access_log WHERE event = 'read' AND principal not like 'CN=urn:node:%' GROUP BY event, yr, mnth order by event, yr, mnth, count desc

#4 Updated by Ben Leinfelder over 11 years ago

KNB:

event | count

-------+---------
read | 1487892

ESA:

event | count
-------+-------
read | 1759

SANPARKS:

event | count
-------+-------
read | 7688

PISCO:

event | count

-------+--------
read | 335113

LTER:

event | count
-------+--------
read | 257467

CLOAKN:

read = 31

ORNLDAAC:

read - 196

USGSCSAS:

read - 99

ONEShare:

read - 25

CDL:

read -33898

#5 Updated by Robert Waltz over 11 years ago

  • translation missing: en.field_remaining_hours set to 0.0
  • Status changed from New to Closed

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)