Project

General

Profile

Task #824

CN replica auditing

Added by Robert Waltz over 13 years ago. Updated over 9 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Chris Jones
Category:
d1_cn_service
Target version:
-
Start date:
2011-10-03
Due date:
% Done:

100%

Estimated time:
(Total: 2.00 h)
Milestone:
CCI-1.4
Product Version:
1.4.0
Story Points:
Sprint:

Description

STORY: As a CN, it is necessary to keep system metadata up to date with respect to object avalability on different nodes in the system. For example, when a MN goes offline for some reason, it is necessary for all system metadata to be updated if affected by the loss of the MN. Note that this is a DoS attack risk (inadvertent or otherwise) as turning on and off a significant MN repeatedly will likely causes significant traffic volume through replication and updates propogated through the system.

TASK: Need a process to audit replicas in dataone. A membernode for some reason may drop a replica or a membernode leaves dataone, the replica policy may not correct.

TASK: When a memberNode leaves dataone, the SystemMetadata of all objects that have that memberNode listed as a replica needs to be updated so as to remove the memberNode from the replicaList

ISSUE: When do we determine a membernode as 'offline', does a simple reboot that affects the machine for 30 seconds during a ping amount to 'offline' or do we allow some other mechanism to determine 'offline'

Subtasks

Task #1816: Create a Sequence Diagram under Use Case 9 for CN ReplicationManager's scheduled audit of replicasClosedNicholas Dexter

Task #1817: Implement scheduled replica auditingClosedSkye Roseboom

Task #2568: Identify system metadata to have replication information audited.ClosedSkye Roseboom

Task #2569: Audit Task generation implementation.ClosedSkye Roseboom

Task #2570: Audit task processingClosedSkye Roseboom

Task #2571: Trigger replication auditingClosedSkye Roseboom

Task #3701: Refine CN replica auditingClosedSkye Roseboom

Task #3702: Refine Authoritative MN auditing behaviorClosedSkye Roseboom

Related issues

Related to Infrastructure - Story #885: excluding member nodes from ObjectLocationList when MN stops supporting the get method Closed 2014-10-02 2014-10-02
Related to Infrastructure - Story #3764: Event and exception index log service Closed 2013-05-15 2013-08-24
Related to Infrastructure - Story #5533: CCI 1.4.0 Release Closed

History

#1 Updated by Robert Waltz over 13 years ago

  • Milestone set to CCI-0.6
  • Tracker changed from Task to Story
  • Start date set to 2010-10-07

#2 Updated by Robert Waltz almost 13 years ago

  • Milestone deleted (CCI-0.6)

#3 Updated by Dave Vieglais over 12 years ago

  • Position set to 51

#4 Updated by Dave Vieglais over 12 years ago

  • Position deleted (60)
  • Position set to 41

#5 Updated by Robert Waltz over 12 years ago

  • Position deleted (75)
  • Position set to 1
  • Target version set to Sprint-2011.41-Block.5

#6 Updated by Robert Waltz over 12 years ago

  • Assignee changed from Robert Waltz to Chris Jones
  • Subject changed from As a CN, it is necessary to keep system metadata up to date with respect to object avalability on different nodes in the system. to As a CN, an audit process is necessary to keep system metadata and MN replicas up to date with respect to object availability on different nodes in the system.
  • Milestone set to CCI-0.6.4

#7 Updated by Dave Vieglais over 12 years ago

  • Position set to 1
  • Target version deleted (Sprint-2011.41-Block.5)
  • Position deleted (17)

#8 Updated by Dave Vieglais over 12 years ago

  • Position set to 26
  • Position deleted (54)

#9 Updated by Chris Jones over 11 years ago

  • Due date set to 2012-10-27
  • Target version set to Sprint-2012.41-Block.6.1
  • Milestone changed from CCI-0.6.4 to CCI-1.2

#10 Updated by Skye Roseboom over 11 years ago

  • Target version changed from Sprint-2012.41-Block.6.1 to Sprint-2012.46-Block.6.3
  • Due date changed from 2012-10-27 to 2012-12-01

#11 Updated by Robert Waltz over 11 years ago

  • Target version changed from Sprint-2012.46-Block.6.3 to 2013.2-Block.1.1
  • Due date changed from 2012-12-01 to 2013-01-19

#12 Updated by Chris Jones about 11 years ago

  • Target version changed from 2013.2-Block.1.1 to 2013.14-Block.2.3
  • Due date changed from 2013-01-19 to 2013-04-13

#13 Updated by Skye Roseboom almost 11 years ago

  • Due date changed from 2013-04-13 to 2013-05-11
  • Target version changed from 2013.14-Block.2.3 to 2013.18-Block.3.1

#14 Updated by Skye Roseboom almost 11 years ago

  • Target version changed from 2013.18-Block.3.1 to 2013.20-Block.3.2
  • Due date changed from 2013-05-11 to 2013-05-25

#15 Updated by Skye Roseboom over 10 years ago

  • Due date changed from 2013-05-25 to 2013-08-24
  • Target version changed from 2013.20-Block.3.2 to 2013.33-Block.4.4

#16 Updated by Skye Roseboom over 10 years ago

  • Status changed from New to In Progress

#17 Updated by Dave Vieglais over 10 years ago

  • Status changed from In Progress to New

#18 Updated by Skye Roseboom over 10 years ago

  • Due date changed from 2013-08-24 to 2013-09-21
  • Target version changed from 2013.33-Block.4.4 to 2013.37-Block.5.2

#19 Updated by Robert Waltz over 10 years ago

  • Milestone changed from CCI-1.2 to CCI-1.3
  • Due date changed from 2013-09-21 to 2014-02-15
  • Target version changed from 2013.37-Block.5.2 to 2014.6-Block.1.3

#20 Updated by Robert Waltz about 10 years ago

  • Due date deleted (2014-02-15)
  • Target version deleted (2014.6-Block.1.3)
  • Start date deleted (2011-10-03)

#21 Updated by Robert Waltz about 10 years ago

  • Due date set to 2014-04-12
  • Target version set to 2014.14-Block.2.3
  • Start date set to 2014-03-30

#22 Updated by Robert Waltz about 10 years ago

  • Due date changed from 2014-04-12 to 2014-04-26
  • Target version changed from 2014.14-Block.2.3 to 2014.16-Block.2.4

#23 Updated by Skye Roseboom about 10 years ago

  • Subject changed from As a CN, an audit process is necessary to keep system metadata and MN replicas up to date with respect to object availability on different nodes in the system. to CN replica auditing

#24 Updated by Skye Roseboom almost 10 years ago

  • Target version changed from 2014.16-Block.2.4 to 2014.22-Block.3.3
  • Due date changed from 2014-04-26 to 2014-06-07

#25 Updated by Skye Roseboom almost 10 years ago

  • Status changed from New to In Progress

#26 Updated by Robert Waltz over 9 years ago

  • Product Version set to 1.4.0
  • Target version deleted (2014.22-Block.3.3)
  • Due date deleted (2014-06-07)
  • Milestone changed from CCI-1.3 to CCI-1.4
  • Start date deleted (2011-10-03)

#27 Updated by Skye Roseboom over 9 years ago

  • Start date set to 2014-08-26
  • translation missing: en.field_remaining_hours changed from 0.0 to 2.0
  • Tracker changed from Story to Task

#28 Updated by Skye Roseboom over 9 years ago

  • Status changed from In Progress to Testing

#29 Updated by Skye Roseboom over 9 years ago

  • Status changed from Testing to Closed
  • translation missing: en.field_remaining_hours changed from 2.0 to 0.0

Tested in cn-sandbox and cn-stage

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)