Project

General

Profile

Story #8172

investigate atomic updates for some solr updates

Added by Rob Nahf over 7 years ago. Updated almost 7 years ago.

Status:
In Progress
Priority:
Normal
Assignee:
Category:
d1_indexer
Target version:
Start date:
2017-09-01
Due date:
% Done:

30%

Story Points:

Description

Atomic updates came to solr with v4.0. (We're currently at 5.x)

Atomic updates are supposed to be more efficient, and could help us with the race condition in #7771.
(multiple tasks reading a solr record and then modifying it in divergent ways via overwriting existing values.

atomic add and remove modifiers allow addition and removal of multivalued fields, which is where our race conditions arise.


Related issues

Related to CN Index - Task #7771: Use multiple threads to index objects Closed 2016-05-04
Related to Infrastructure - Story #8702: Indexing Refactor Strategy New 2018-09-24

History

#1 Updated by Rob Nahf over 7 years ago

  • Related to Task #7771: Use multiple threads to index objects added

#2 Updated by Dave Vieglais about 7 years ago

  • Target version changed from CCI-2.3.5 to CCI-2.3.6

#3 Updated by Jing Tao about 7 years ago

  • Target version changed from CCI-2.3.6 to CCI-2.3.7

#4 Updated by Rob Nahf almost 7 years ago

  • Target version changed from CCI-2.3.7 to CCI-2.4.0
  • % Done changed from 0 to 30
  • Status changed from New to In Progress

Work about halfway done in v2.4-SNAPSHOT (trunk). That's to say that the implementation is working but a bit poorly designed, due to the existing structure of the code base (the iterative nature of sub-processor parsing and merging in SolrIndexService.processTask method ) The work is extensive enough that it should be in a new branch.

#5 Updated by Dave Vieglais almost 7 years ago

  • Sprint set to Infrastructure backlog

#6 Updated by Rob Nahf about 6 years ago

  • Related to Story #8702: Indexing Refactor Strategy added

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)