Project

General

Profile

Task #2182

Story #2166: Hazelcast cluster errors need to be isolated

Coordinate d1_indexer locks in the process cluster

Added by Chris Jones almost 13 years ago. Updated almost 13 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Skye Roseboom
Category:
d1_indexer
Start date:
2012-01-09
Due date:
% Done:

100%

Milestone:
CCI-1.0.0
Product Version:
*
Story Points:
Sprint:

Description

Instead of directly locking the pid of an object in the storage cluster to coordinate among processing components, instead create the lock in the Hazelcast process cluster. This should reduce contention on the hzSystemMetadata map calls, but will still allow synchronization, replication, and indexing to coordinate process timing.

History

#1 Updated by Skye Roseboom almost 13 years ago

Delay processing index task until the hz lock is released.

May also check replica entry status on the system metadata object - 'queued' or 'requested' means updates coming soon.

Index processing just performs reads from the distributed datastore using event listener on the system metadata map. Indexing does not create locks.

#2 Updated by Skye Roseboom almost 13 years ago

  • Status changed from New to Closed

Closing...don't think index processing will be effected considering:

Only one update task allowed per PID - so rapid add/update, update/update from locking behavior only generates one task for the most recent event.

Task processor runs on 2 minute schedule - so query for tasks has small chance of occurring between quick add/update, update/update scenarios.

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)