Task #4140: ORE documents reference pids that do not appear in object list - Member Nodes - DataONE Tasks

I do not yet see a pattern. It appears the dryad /object list may not be presenting all identifiers in use by the ORE docs. All the reported 'missing' identifiers can be found via dryad's /meta/{pid} and /object/{pid} services but I do not find them when using /object?formatId= or just object list slicing.

History

#1 Updated by Ryan Scherle about 11 years ago

We determined that most of these errors were due to items with restricted access. These items were correctly filtered out of the object lists, but not out of the resource maps. We have improved the filtering to make the resource map and object list consistent.

A few other items were the result of dirty data on our development server.

Please re-test.

#2 Updated by Ryan Scherle about 11 years ago

Assignee changed from Ryan Scherle to Skye Roseboom

#3 Updated by Skye Roseboom about 11 years ago

Status changed from New to In Progress

#4 Updated by Skye Roseboom about 11 years ago

Status changed from In Progress to Testing

#5 Updated by Skye Roseboom about 11 years ago

Assignee changed from Skye Roseboom to Ryan Scherle

Test run 11/21.

https://dev.datadryad.org/mn/object/?count=0&formatId=http://www.openarchives.org/ore/terms
-- shows 1932

https://cn-dev-ucsb-1.test.dataone.org/cn/v1/query/solr/?q=datasource:urn\:node\:mnTestDRYAD%20formatType:RESOURCE
-- shows 1586

So we got a couple hundred more ORE to index.

Inspecting ORE that did not process, seem to indicate this problem still exists:

ORE: http://dx.doi.org/10.5061/dryad.505?format=d1rem&ver=2011-07-28T14:52:47.474-04:00
references data files:
http://dx.doi.org/10.5061/dryad.505/1/bitstream
http://dx.doi.org/10.5061/dryad.505/2/bitstream
however neither of these pids were harvested by the CN and neither appear on dev.datadryad.org's object list although /meta{pid} and /object/{pid} work.

ORE: http://dx.doi.org/10.5061/dryad.389?format=d1rem&ver=2011-07-28T15:13:04.871-04:00
references data file:
http://dx.doi.org/10.5061/dryad.389/1/bitstream
however: https://dev.datadryad.org/mn/object/?count=1000&formatId=text/html yields 0 results. (does not appear on object list). /meta{pid} and /object/{pid} work.

ORE: http://dx.doi.org/10.5061/dryad.509?format=d1rem&ver=2011-07-28T14:53:53.030-04:00
references data file:
http://dx.doi.org/10.5061/dryad.509/1/bitstream
however this pid does not seem to appear on dev.datadryad.org's object list. /meta{pid} and /object/{pid} work however.

Seems to be the same type of error as before. Are these particular ORE meant to be working?

#6 Updated by Skye Roseboom about 11 years ago

Status changed from Testing to In Progress

#7 Updated by Ryan Scherle about 11 years ago

Assignee changed from Ryan Scherle to Skye Roseboom

We have corrected an inconsistency in the object list. Please re-test this.

#8 Updated by Laura Moyers almost 11 years ago

Target version changed from Deploy by end of Y5Q2 to Deploy by end of Y5Q3

#9 Updated by Laura Moyers almost 11 years ago

Target version changed from Deploy by end of Y5Q3 to Operational

#10 Updated by Skye Roseboom almost 11 years ago

translation missing: en.field_remaining_hours set to 0.0
Status changed from In Progress to Closed

Closing this issue as Dryad is now in production and these issues appear resolved.

Also available in: Atom PDF

Project

General

Profile

Member Nodes

Issues

Custom queries

Task #4140

ORE documents reference pids that do not appear in object list