Project

General

Profile

MNDeployment #6548

R2R Repository

Added by Matthew Jones over 9 years ago. Updated over 5 years ago.

Status:
Operational
Priority:
High
Assignee:
Target version:
Start date:
2015-03-20
Due date:
% Done:

89%

Latitude:
41.02
Longitude:
-73.91
MN Description:
Rolling Deck to Repository (R2R) is the repository for environmental sensor data routinely acquired by oceanographic vessels in the U.S. academic research fleet. The fleet supports hundreds of expeditions around the world each year, ranging from oceans to coasts and estuaries to the Great Lakes. R2R provides a master catalog of expeditions (cruises); an inventory of original field datasets; processed datasets including shiptrack navigation; and links to related publications and content at partner repositories.
Base URL:
http://www.rvdata.us/
NodeIdentifier:
urn:node:R2R
MN Tier:
Tier 1
Software stack:
Slender Node (GMN)
MN_Date_Online:
2017-01-18
Name:
Logo URL:
Date Upcoming:
Date Deprecated:
Information URL:
Version:

Description

The Rolling Deck to Repository (R2R) (http://www.rvdata.us/)

Main contact: Bob Arko arko@ldeo.columbia.edu

As of today, the R2R repository holds over 17,444,740 data files from 3686 cruises using 26 vessels.

Implementation: Interested in deploying this using DSpace which they already have operational.

Associated with GeoLink project which Matt Jones and Mark Schildhauer are on.


Subtasks

Task #6923: R2R: Scope the implementationClosedLaura Moyers

Task #6924: R2R: Plan the implementationClosedMark Servilla

Task #6925: R2R: Design, code and component test a new MN implementationClosedRoger Dahl

Task #6927: R2R: Register any new object formats in all environmentsIn ProgressRoger Dahl

Task #6928: R2R: Local TestingClosed

Task #6929: R2R: Establish DataONE user identity in Testing EnvironmentClosedMark Servilla

Task #6930: R2R: Configure SSL Certificates for Testing EnvironmentClosedMark Servilla

Task #6931: R2R: Verify MN Content and Services in Testing EnvironmentClosedRoger Dahl

Task #6932: R2R: Register MN in Testing EnvironmentClosedRoger Dahl

Task #6933: R2R: Verify CN Content and Services in Testing EnvironmentClosedRoger Dahl

Task #6934: R2R: Check Authentication and Authorization in Testing EnvironmentClosedRoger Dahl

Task #6935: R2R: Show MN as "upcoming" on the dashboardClosed

Task #6936: R2R: Establish DataONE user identity in ProductionClosedRoger Dahl

Task #6937: R2R: Configure SSL Certificates for ProductionClosedMark Servilla

Task #6938: R2R: Verify MN Content and Services in ProductionClosedRoger Dahl

Task #6939: R2R: Register MN in ProductionClosedRoger Dahl

Task #6940: R2R: Verify CN Content and Services in ProductionClosedRoger Dahl

Task #6941: R2R: Check Authentication and Authorization in ProductionClosedRoger Dahl

Task #6942: R2R: Mutual acceptanceClosedLaura Moyers

Task #6943: R2R: Ensure MN appears on Current MNs webpage (dashboard)ClosedAmber Budden

Task #6944: R2R: Document and AnnounceClosedAmber Budden

Task #6922: R2R: Join DataONEClosedLaura Moyers

Task #7899: R2R: modify searchUI to accommodate composite data density with cruise pathsNewLauren Walker

Task #7900: R2R: modify searchUI to accommodate cruise path display for single data packageNewLauren Walker

History

#1 Updated by Laura Moyers about 9 years ago

  • Target version set to Deploy by end of Y2Q1

#2 Updated by Laura Moyers almost 9 years ago

  • Status changed from New to Planning
  • % Done changed from 0 to 10

#3 Updated by Laura Moyers almost 9 years ago

  • NodeIdentifier set to urn:node:R2R

#4 Updated by Laura Moyers over 8 years ago

  • Target version changed from Deploy by end of Y2Q1 to Deploy by end of Y2Q2

#5 Updated by Laura Moyers almost 8 years ago

  • Base URL set to http://www.rvdata.us/
  • Software stack set to DSpace

#6 Updated by Laura Moyers almost 8 years ago

  • Target version changed from Deploy by end of Y2Q2 to Deploy by end of Y2Q3

#7 Updated by Laura Moyers almost 8 years ago

  • Target version changed from Deploy by end of Y2Q3 to Deploy by end of Y2Q4

#8 Updated by Laura Moyers over 7 years ago

Meeting 7 September 2016 with Bob, Dave, Mark and Laura: Bob wants to implement a Slender Node in order to have a MN presence sooner rather than later, but "later" he'd like to revisit the DSpace implementation.

Next steps:
Bob:
CSW endpoint decisions
plan for hosting the GMN
DataONE:
investigate more sophisticated geometries
ensure GMN v2 is live
update redmine ticket to reflect our new direction

Meeting notes: https://epad.dataone.org/pad/p/R2R_and_DataONE

#9 Updated by Laura Moyers over 7 years ago

  • Target version changed from Deploy by end of Y2Q4 to Deploy by end of Y3Q1

#10 Updated by Laura Moyers over 7 years ago

Meeting 28 September 2016 with Bob, Dave, Mark and Laura. Meeting notes: https://epad.dataone.org/pad/p/R2R_and_DataONE

From last time:

Bob:
- CSW endpoint decisions http://api.rvdata.us/

  question:  what's the mutability of this content?  metadata could change if we learn more about a cruise, but the DOI will NOT change

  the R2R DOI will be conceptually the SID (series identifier); the PID could be the checksum of the object, or a timestamp (if that is reliable) 

  clarification:  R2R will be metadata-only at least at first.  Bob says he'd like to include a link back to the actual content/data in the metadata.

  provide a couple NCEI examples to Bob

  a single cruise can have multiple data sets associated with it, each with its own DOI

  comment: an abstract would be helpful in discovery

  there is a lengthy POC section (wonder how this would render?)

  Bob wants to update DOIs in his endpoint, etc.

- plan for hosting the GMN

  - preferred that long-term, R2R host the GMN, but for our December (R2R: 1 Dec; DataONE: 7 Dec) deadlines, it would be easier for DataONE to host the GMN (which Bob could later grab and "copy")

DataONE:
- investigate more sophisticated geometries - Dave had talked with Lauren, who said that as long as the path is expressed in the metadata, the rendering of such shouldn't be a problem. This is for results for a single data package. The overall geospatial rendering or data density (i.e. for all R2R content), it would be a little more difficult to render cruise paths. Requires geohashes.

- ensure GMN v2 is live
- update redmine ticket to reflect our new direction (DONE)

Next steps:
Bob:
- Firm up the CSW implementation
- ensure gmd: date stamp reflects the last updated date
- add in online distribution info (URL)

DataONE:
- Send NCEI examples to Bob (including online distribution info) (Dave)

https://cn.dataone.org/cn/v2/resolve/%7B289A1374-D916-42F3-97C4-90F0E188E96C%7D

https://cn.dataone.org/cn/v2/resolve/%7BF52B9C6F-681D-453C-AE24-31AAB68AD069%7D

https://cn.dataone.org/cn/v2/resolve/%7B23071751-5A5F-4C04-A0BC-A92C8A4E0C91%7D


Service Title: //gmd:distributionInfo/gmd:MD_Distribution/gmd:distributor/gmd:MD_Distributor/gmd:distributorTransferOptions/gmd:MD_DigitalTransferOptions/gmd:onLine/gmd:CI_OnlineResource/gmd:name/gco:CharacterString


Service Description:

//gmd:distributionInfo/gmd:MD_Distribution/gmd:distributor/gmd:MD_Distributor/gmd:distributorTransferOptions/gmd:MD_DigitalTransferOptions/gmd:onLine/gmd:CI_OnlineResource/gmd:description/gco:CharacterString


Service Type:

//gmd:distributionInfo/gmd:MD_Distribution/gmd:distributor/gmd:MD_Distributor/gmd:distributorTransferOptions/gmd:MD_DigitalTransferOptions/gmd:onLine/gmd:CI_OnlineResource/gmd:protocol/gco:CharacterString


Service Endpoint:

//gmd:distributionInfo/gmd:MD_Distribution/gmd:distributor/gmd:MD_Distributor/gmd:distributorTransferOptions/gmd:MD_DigitalTransferOptions/gmd:onLine/gmd:CI_OnlineResource/gmd:linkage/gmd:URL 

| //gmd:distributionInfo/gmd:MD_Distribution/gmd:transferOptions/gmd:MD_DigitalTransferOptions/gmd:onLine/gmd:CI_OnlineResource/gmd:linkage/gmd:URL
  • Set up GMN when v2 is available (testing GMN v2, the R2R adapter/connector, and the R2R endpoint)
  • Laura to create redmine tickets for the searchUI mods (Lauren can execute when there is R2R data available)
  • Mark to inquire with Roger re: GMNv2
  • Mark to set up a VM for a test instance of GMNv2
  • Laura to verify existence of MNDD - DONE, on redmine ticket #6922

#11 Updated by Dave Vieglais over 7 years ago

  • Software stack changed from DSpace to Slender Node (GMN) -DSpace-

Updating to reflect the use of GMN asa slender node for the R2R repository.

#12 Updated by Dave Vieglais over 7 years ago

  • Status changed from Planning to Testing
  • % Done changed from 10 to 50

#13 Updated by Laura Moyers about 7 years ago

  • Assignee changed from Laura Moyers to Monica Ihli
  • Status changed from Testing to In Review
  • % Done changed from 50 to 80

In review. As of 19 December 2015, there were 1820 objects on the R2R MN, 1781 on the CNs and 1781 indexed. We need to identify as much as possible if the cause of the non-sync condition is something that Bob can fix at the MN level or not.

#14 Updated by Laura Moyers about 7 years ago

  • MN_Date_Online set to 2017-01-18
  • Software stack changed from Slender Node (GMN) -DSpace- to Slender Node (GMN)
  • Status changed from In Review to Operational

R2R announced today: https://www.dataone.org/news/oceanographic-data-more-broadly-discoverable-rolling-deck-repository-r2r-program-joins-dataone

We are still investigating 39 objects which did not synchronize. We think these are all ones which have an invalid date format in the system metadata.

#15 Updated by Laura Moyers about 7 years ago

  • Target version changed from Deploy by end of Y3Q1 to Operational

#16 Updated by Laura Moyers about 7 years ago

  • MN Description changed from The Rolling Deck to Repository (R2R) program aims to develop comprehensive fleet-wide management of underway data to ensure preservation of and access to our national oceanographic research data resources. R2R provides is a central gateway through which underway data from oceanographic expeditions will be routinely cataloged and securely transmitted to national long-term archives including the National Geophysical Data Center (NGDC) and National Oceanographic Data Center (NODC). Data submission will be established through vessel operators rather than individual science parties. to Rolling Deck to Repository (R2R) is the repository for environmental sensor data routinely acquired by oceanographic vessels in the U.S. academic research fleet. The fleet supports hundreds of expeditions around the world each year, ranging from oceans to coasts and estuaries to the Great Lakes. R2R provides a master catalog of expeditions (cruises); an inventory of original field datasets; processed datasets including shiptrack navigation; and links to related publications and content at partner repositories.

MN Description changed per Bob Arko. To be shown on MN profile page in DataONE Search.

#17 Updated by Matthew Jones about 7 years ago

Laura -- the MN description text is controlled by the MN through the updateCapabilities() service, that gives them the ability to change their own name, description, etc. in the node registry. After they change it, we may need to trigger an update on the CN end before it shows up, but it should be in their control.

#19 Updated by Dave Vieglais about 6 years ago

  • Sprint set to Ongoing Operational

#20 Updated by Amy Forrester over 5 years ago

7/25/18: I have replaced Bob Arko as the Technical Director for R2R, so I should be the new contact. Please let me know if you have any questions. Suzanne O'Hara sohara@ldeo.columbia.edu

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)