Project

General

Profile

Bug #7919

unloadable system metadata in CNs by Hazelcast

Added by Rob Nahf over 7 years ago. Updated over 7 years ago.

Status:
New
Priority:
High
Assignee:
-
Category:
Metacat
Target version:
Start date:
2016-10-26
Due date:
% Done:

0%

Milestone:
None
Product Version:
*
Story Points:
Sprint:

Description

Looking through the metacat logs, I found a lot of instances where the HzSystemMetadataMap could not load system metadata for particular pids. Most had dryad in the pid (~1200), but another 130 are from elsewhere.

a random sample showed that it couldn't be retrieved via /meta although the pid could be retrieved from the Dryad MN.

This appears to be another type of half-created content on the CN.

rnahf@cn-ucsb-1:~$ grep 'could not load system metadata' /var/metacat/logs/metacat.log | cut -c60- | sort | uniq | grep -v dryad | wc -l
139
rnahf@cn-ucsb-1:~$ grep 'could not load system metadata' /var/metacat/logs/metacat.log | cut -c60- | sort | uniq | grep dryad | wc -l
1216

History

#1 Updated by Dave Vieglais over 7 years ago

Ran a quick check of identifier consistency across CNs for urn:nodeDRYAD using https://github.com/DataONEorg/DataONE_Operations/blob/master/scripts/d1getpids

Found 0/108053 indentifiers in cn-ucsb-1.dataone.org not in cn-ucsb-1.dataone.org
Found 1023/108053 indentifiers in cn-ucsb-1.dataone.org not in cn-unm-1.dataone.org
Found 1027/108053 indentifiers in cn-ucsb-1.dataone.org not in cn-orc-1.dataone.org
Found 0/107030 indentifiers in cn-unm-1.dataone.org not in cn-ucsb-1.dataone.org
Found 0/107030 indentifiers in cn-unm-1.dataone.org not in cn-unm-1.dataone.org
Found 4/107030 indentifiers in cn-unm-1.dataone.org not in cn-orc-1.dataone.org
Found 0/107026 indentifiers in cn-orc-1.dataone.org not in cn-ucsb-1.dataone.org
Found 0/107026 indentifiers in cn-orc-1.dataone.org not in cn-unm-1.dataone.org
Found 0/107026 indentifiers in cn-orc-1.dataone.org not in cn-orc-1.dataone.org

Document comparison
Found 0/108053 filenames listed by cn-ucsb-1.dataone.org but not present on filesystem
Found 28/107030 filenames listed by cn-unm-1.dataone.org but not present on filesystem
Found 30/107026 filenames listed by cn-orc-1.dataone.org but not present on filesystem

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)