Task #6985: Create resource map documents for each package - Member Nodes - DataONE Tasks

Task #6985

MNDeployment #3228: NCEI - National Centers for Environmental Information

Story #6809: NODC: Design, code and component test a new MN implementation

Create resource map documents for each package

Added by Dave Vieglais about 9 years ago. Updated about 6 years ago.

Status:

Closed

Priority:

Normal

Assignee:

Dave Vieglais

Target version:

Operational

Start date:

2015-04-01

Due date:

% Done:

100%

Estimated time:

0.00 h

Story Points:

Sprint:

Description

Packages are described by the manifest file from FTP and the metadata ("Document") link in the CSW getRecords response

Subtasks

Related issues

History

#1 Updated by Dave Vieglais about 9 years ago

Assignee set to Rob Nahf

#2 Updated by Rob Nahf about 9 years ago

a sample SummaryRecord returned from GetRecords

<?xml version="1.0" encoding="UTF-8" standalone="no"?>

csw:SummaryRecord

gov.noaa.nodc:9800108/dc:identifier

{59E374BA-9988-41BF-A43A-0F0AED420E66}/dc:identifier

dc:titleNODC Standard Product: World Ocean Circulation Program (WOCE) Global Data, Version 1: Satellite sea surface height and temperature data on CD-ROM (NODC Accession 9800108)/dc:title
application/dc:type
application/dc:type
downloadableData/dc:type
downloadableData/dc:type
...
dct:modified2015-03-29T19:21:08+00:00/dct:modified

http://accession.nodc.noaa.gov/oas/9800108 /dct:references

https://data.nodc.noaa.gov/geoportal/csw?getxml=%7B59E374BA-9988-41BF-A43A-0F0AED420E66%7D /dct:references

ftp://ftp.nodc.noaa.gov/nodc/archive/arc0001/9800108//dct:references

http://accession.nodc.noaa.gov/download/9800108 /dct:references

1990-01-01Z/dct:date
1998-05-15Z/dct:date
/csw:SummaryRecord
/csw:SearchResults
/csw:GetRecordsResponse

#3 Updated by Rob Nahf about 9 years ago

Estimated time set to 0.00

Roger wrote a utility in GMN to create a ResourceMap, so the task for the slender node is to
provide the correct identifiers from the process that synchronizes GMN with NODC.

Points:
* There should be 1 ResourceMap for every version found on the ftp archive.
* d1_libclient_py data_package.py should be used to generate the resource map(s) themselves and their associated systemMetadata
* A versionless SID should be assigned to the systemMetadata for each generated resourceMap,
* the package should contain all files found in the archive, and all as formatType DATA
* files in the /about directory should be part of the aggregation, but probably not included in the METADATA documents DATA triples.
* sometimes the /about directory will contain an incidental FGDC document, but they are not systematically identified as FGDC, so should only be seen as incidental files (formatID text/xml?)