Task #2119
Story #2067: Refactor the index task generator and processor to improve scalability and performance
Create command line tool to build/update entire solr index
100%
History
#1 Updated by Skye Roseboom about 13 years ago
- Category set to d1_indexer
Need ability to index the current state of the coordinating node. This tool will allow the initial creating of the solr index - containing all documents contained in the local CN node.
This tool can also be run to update the solr index from a supplied date forward.
#2 Updated by Skye Roseboom about 13 years ago
- Status changed from New to In Progress
#3 Updated by Skye Roseboom about 13 years ago
Implemented in project cn/d1_cn_tools/d1_cn_index_tool.
Tool class is SolrIndexBuildTool.java
Tool iterates through system metadata map's values and generates an index task for each entry in map. After 1000 index tasks are generated, the processor is invoked. This continues until all values in the system metadata map have been processed.
#4 Updated by Skye Roseboom about 13 years ago
Completed and tested with SolrIndexBuiltToolTest.
Updated SolrDoc and HttpService classes to filter out solr copy destination fields from SolrDoc fields.
#5 Updated by Skye Roseboom about 13 years ago
- Status changed from In Progress to Closed
