Project

General

Profile

Task #2071

Story #2067: Refactor the index task generator and processor to improve scalability and performance

Update the index task processor to read from task queue

Added by Dave Vieglais over 12 years ago. Updated over 12 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Skye Roseboom
Category:
d1_indexer
Start date:
2011-11-29
Due date:
% Done:

100%

Milestone:
CCI-1.0.0
Product Version:
*
Story Points:
Sprint:

Description

The task processor will need to read from the new index task queue.

It should be possible to select the next task based on priority, age, pid, or formatid.

There may be more than one task processor running at a time, which may influence design decisions.

History

#1 Updated by Skye Roseboom over 12 years ago

  • Status changed from New to In Progress

#2 Updated by Skye Roseboom over 12 years ago

  • Status changed from In Progress to Closed

Completed. Created apache daemon to wrap quartz scheduled processor job. Index task processor reads tasks from repository and hands them off to XPathDocumentParser to generate solr updates.

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)