Project

General

Profile

MNDeployment #3228

NCEI - National Centers for Environmental Information

Added by Matthew Jones over 11 years ago. Updated almost 5 years ago.

Status:
Operational
Priority:
Normal
Assignee:
Dave Vieglais
Target version:
Operational
Start date:
2012-09-06
Due date:
% Done:

96%

Latitude:
38.89
Longitude:
-77.03
MN Description:
The NOAA National Centers for Environmental Information (NCEI) manages the world's largest collection of freely available oceanographic data. The oceanographic archive includes data dating back to the 1700s from every imaginable platform and from every corner of the world ocean. NCEI is the merger of NOAA's three former National Data Centers: The National Oceanographic Data Center (NODC), the National Climatic Data Center (NCDC), and the National Geophysical Data Center (NGDC). Currently, the holdings of the former NODC are available through DataONE though NCEI is investigating the possibility of including more of its environmental data holdings from the atmospheric, climatic, and geophysical domains.
Base URL:
https://www.ncei.noaa.gov/
NodeIdentifier:
urn:node:NCEI
MN Tier:
Tier 1
Software stack:
CSW slender node
MN_Date_Online:
2016-03-31
Name:
Logo URL:
Date Upcoming:
Date Deprecated:
Information URL:
Version:
Sprint:
Ongoing Operational

Description

This issue is to track the contact to and potential deployment of an NODC (National Oceanic Data Center) member node.

Google doc outlining plans: https://docs.google.com/document/d/1C2UB67KsL1YmZG8qFlMcZneNbbsopPO4zMtTLY7-IQE/edit

Subtasks

Task #3229: contact NODC to continue discussions about an NODC MNClosedMatthew Jones

Task #6762: Notes from call 20150116 and forwardClosedLaura Moyers

Task #6806: NODC: Join DataONEClosedLaura Moyers

Task #6807: NODC: Scope the implementationClosed

Task #6808: NODC: Plan the implementationClosed

Story #6809: NODC: Design, code and component test a new MN implementationClosedMark Servilla

Task #6982: FTP Client to retrieve package and package component URLsClosedDave Vieglais

Task #6983: Determine type of metadata and the rules for parsing for indexingClosedMark Servilla

Task #6984: For each Tier 1 MN method, determine how response should be constructedClosedJing Tao

Task #6985: Create resource map documents for each packageClosedDave Vieglais

Task #6990: rerun nodc_listObjects tomorrow to see if any ID values have changedClosedDave Vieglais

Task #6986: Strategy for synchronrizing content after it changes on the NODC serverClosedDave Vieglais

Task #6987: Some FTP end points do not have a manifest document - how to handle?ClosedDave Vieglais

Task #6988: Create System Metadata for data objects ClosedDave Vieglais

Task #6989: Determine how to map objects to DataONE object formatsClosedDave Vieglais

Task #6810: NODC: Implement search index and display support for any new metadata formats required by the MN.ClosedDave Vieglais

Task #6811: NODC: Register any new object formats in all environmentsClosedDave Vieglais

Task #6812: NODC: Local TestingClosedMark Servilla

Task #6813: NODC: Establish DataONE user identity in Testing EnvironmentClosedMark Servilla

Task #6814: NODC: Configure SSL Certificates for Testing EnvironmentClosedMark Servilla

Task #6815: NODC: Verify MN Content and Services in Testing EnvironmentClosedMark Servilla

Task #6816: NODC: Register MN in Testing EnvironmentClosedMark Servilla

Task #6817: NODC: Verify CN Content and Services in Testing EnvironmentClosedMark Servilla

Task #6818: NODC: Check Authentication and Authorization in Testing EnvironmentClosedLaura Moyers

Task #6819: NODC: Show MN as "upcoming" on the dashboardClosedLaura Moyers

Task #6820: NODC: Establish DataONE user identity in ProductionClosed

Task #6821: NODC: Configure SSL Certificates for ProductionClosedMark Servilla

Task #6822: NODC: Verify MN Content and Services in ProductionClosedMark Servilla

Task #6823: NODC: Register MN in ProductionClosedLaura Moyers

Task #6824: NODC: Verify CN Content and Services in ProductionClosedMark Servilla

Task #6825: NODC: Check Authentication and Authorization in ProductionClosedLaura Moyers

Task #6826: NODC: Mutual acceptanceClosedLaura Moyers

Task #6827: NODC: Ensure MN appears on Current MNs webpage (dashboard)ClosedAmber Budden

Task #6828: NODC: Document and AnnounceClosedLaura Moyers

Task #8585: GMN not syncing obsoletedBy field correctlyClosedRoger Dahl

Task #8681: NCEI - install new GMN NewRoger Dahl

Related issues

Related to Member Nodes - Support #8017: NCEI - Implement GMN for replicating Arctic Data Center Data New 2017-02-14

History

#1 Updated by Matthew Jones over 11 years ago

  • Subject changed from deploy the NODC member node to Deploy the NODC member node

#2 Updated by Matthew Jones about 11 years ago

  • Start date deleted (2012-09-06)

#3 Updated by John Cobb about 11 years ago

  • Subject changed from Deploy the NODC member node to NODC member node

#4 Updated by Matthew Jones about 11 years ago

  • Due date set to 2014-01-31
  • Target version set to Deploy by end of Y5Q2
  • Start date set to 2013-01-30

#5 Updated by John Cobb over 10 years ago

  • Due date changed from 2014-01-31 to 2014-08-01
  • Target version changed from Deploy by end of Y5Q2 to Deferred

Documenting conversation with John Cobb, Dave Vieglais, and Matt Jones at the Knoxville Meeting in July:

NODC does not, at present have logging capability. How this will be resolved is not yet known. NODC may implement this functionality, or slender node might finesse the issue or ...

Moving to a deferred wait-state while a work-out is found.

#6 Updated by Bruce Wilson over 10 years ago

  • Status changed from New to Deferred

Updating status to Deferred, per above comments.

#7 Updated by Bruce Wilson almost 10 years ago

  • Due date deleted (2014-08-01)
  • Status changed from Deferred to New
  • Target version deleted (Deferred)
  • Start date deleted (2012-09-06)

Moving this out of Deferred and into the Backlog, as the developments with the DAP MN stack make this a more feasible option.

#8 Updated by Matthew Jones over 9 years ago

Through contacts with NODC, the sent the following service endpoints that may be the best place for implementation of a Slender Node. I suspect that CSW would work well for this.

links to our WAF and some example landing pages. We do also provide CSW, OpenSearch and OAI-PMH endpoints to the the metadata so you can see it through those services as well.

NODC ISO WAF: http://data.nodc.noaa.gov/nodc/archive/metadata/approved/iso/
NODC ISO landing page
http://data.nodc.noaa.gov/cgi-bin/iso?id=gov.noaa.nodc:0110317;view=html
http://data.nodc.noaa.gov/cgi-bin/iso?id=gov.noaa.nodc:AVHRR_Pathfinder-NODC-L3C-v5.2

CSW for collection level discovery
http://data.nodc.noaa.gov/geoportal/csw/discovery?Request=GetCapabilities&Service=CSW&Version=2.0.2

Opensearch description for collection level discovery
http://data.nodc.noaa.gov/geoportal/openSearchDescription

OAI-PMH endpoint
http://data.nodc.noaa.gov/cgi-bin/oai-pmh

#9 Updated by Matthew Jones over 9 years ago

An example CSW request that lists the first 20 records from their CSW service:

http://data.nodc.noaa.gov/geoportal/csw/discovery?Request=GetRecords&Service=CSW&Version=2.0.2&ElementSetName=brief&resultType=results&outputFormat=text/xml&startPosition=1&maxRecords=20

Each of these records has an embedded link to the associated ISO metadata document, such as:

@
http://data.nodc.noaa.gov/geoportal/csw?getxml=%7B8C6DFB99-02E6-482B-BE81-3E9651A0F472%7D
/dct:references@

It also has a link to a service that lists the data granules, which in this case there are more than 16K:

@
http://www.nodc.noaa.gov/geoportal/rest/find/document?searchText=fileIdentifier%3AUPA-L2P-ATS_NR_2P*&start=1&max=100&f=searchPage
/dct:references@

We would need a way to get SystemMetadata for all of the data granules, particularly the checksum.

#10 Updated by Laura Moyers over 9 years ago

  • Start date set to 2015-01-02
  • Target version set to In Progress
  • Status changed from New to Planning
  • Due date set to 2015-09-30

Targeting for implementation by 31 Mar 2016.

#11 Updated by Dave Vieglais over 9 years ago

  • Description updated (diff)

#12 Updated by Laura Moyers about 9 years ago

  • Target version changed from In Progress to Deploy by end of Y1Q4
  • % Done changed from 0 to 10

#13 Updated by Laura Moyers about 9 years ago

  • Status changed from Planning to Ready

#14 Updated by Laura Moyers almost 9 years ago

  • NodeIdentifier set to urn:node:NCEI
  • MN Tier set to Tier 1
  • Software stack set to CSW slender node
  • Subject changed from NODC member node to NCEI - National Centers for Environmental Information (was NODC)

NODC has finished their reorganization with NCDC and NGDC, so we should refer to this MN as NCEI now (National Centers for Environmental Information)

https://www.ncei.noaa.gov/

#15 Updated by Laura Moyers over 8 years ago

  • Target version changed from Deploy by end of Y1Q4 to Deploy by end of Y2Q1

#16 Updated by Laura Moyers over 8 years ago

  • Assignee changed from Matthew Jones to Dave Vieglais

Plan to have an operational MN in stage before Christmas. Mark Flynn will be lead after he finishes up GMN V2 updates (by Thanksgiving). AHM 10/28/15

#17 Updated by Laura Moyers over 8 years ago

  • Target version changed from Deploy by end of Y2Q1 to Deploy by end of Y2Q2

#18 Updated by Laura Moyers over 8 years ago

  • Latitude set to 38.89
  • Longitude set to -77.03

#19 Updated by Laura Moyers about 8 years ago

  • Status changed from Ready to Operational
  • MN Description set to The NOAA National Centers for Environmental Information (NCEI) manages the world's largest collection of freely available oceanographic data. The oceanographic archive includes data dating back to the 1700s from every imaginable platform and from every corner of the world ocean. NCEI is the merger of NOAA's three former National Data Centers: The National Oceanographic Data Center (NODC), the National Climatic Data Center (NCDC), and the National Geophysical Data Center (NGDC). Currently, the holdings of the former NODC are available through DataONE though NCEI is investigating the possibility of including more of its environmental data holdings from the atmospheric, climatic, and geophysical domains.
  • Base URL set to https://www.ncei.noaa.gov/

The metadata-only version of the NCEI MN is operational and in production. Additional functionality will be deployed as developed/tested.

#20 Updated by Laura Moyers about 8 years ago

  • Target version changed from Deploy by end of Y2Q2 to Operational

#21 Updated by Laura Moyers about 8 years ago

  • Subject changed from NCEI - National Centers for Environmental Information (was NODC) to NCEI - National Centers for Environmental Information

#22 Updated by Laura Moyers almost 8 years ago

  • MN_Date_Online set to 2016-03-31

#23 Updated by Monica Ihli about 7 years ago

  • Related to Support #8017: NCEI - Implement GMN for replicating Arctic Data Center Data added

#24 Updated by Dave Vieglais over 6 years ago

  • Sprint set to Ongoing Operational

#25 Updated by Amy Forrester almost 5 years ago

Per Robert.McGuinn@noaa.gov
Northern Gulf Institute, Mississippi State University to start adding regular updates of their deep sea coral and sponge database to the NCEI archive

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)