Project

General

Profile

Story #8175

Solr crashing with out of memory error

Added by Dave Vieglais about 4 years ago. Updated almost 3 years ago.

Status:
Closed
Priority:
Immediate
Assignee:
Category:
d1_indexer
Target version:
Start date:
2017-09-05
Due date:
% Done:

100%

Story Points:
Sprint:

Description

Solr has been crashing and/or thrashing with out of memory errors on CN-UCSB-1 resulting in poor or no response when using search.dataone.org.

There are several related issues to be addressed here:

  1. Poorly written queries generated by the search UI are causing excessive demand on the solr index
  2. Solr is running with 2GB allocated to the JVM. This appears to be insufficient.
  3. Should design and implement a load balancing solution so a single instance of Solr is not used all the time
  4. Memory use is always high on cn-ucsb-1 where processing (and so log aggregation) is running. Review the log aggregation process for memory leaks and performance.
  5. The configuration for Solr is using mostly default parameters. This should be reviewed and revised where appropriate.

Subtasks

Task #8176: Adjust memory allocated to SolrClosedDave Vieglais

Task #8177: Ensure that inefficient queries are refactored in the search UIClosedLauren Walker

Task #8178: Design and implement load balancing for the search indexRejectedDave Vieglais

Task #8179: review log aggregation code for memory leaks and efficiencyClosedDave Vieglais

Task #8180: Review solr configuration, schema for efficiencyRejectedDave Vieglais


Related issues

Related to Infrastructure - Story #7939: Indexing is too slow, especially with large packages Rejected 2016-11-25

History

#1 Updated by Dave Vieglais about 4 years ago

  • Related to Story #7939: Indexing is too slow, especially with large packages added

#2 Updated by Jing Tao about 4 years ago

  • Target version changed from CCI-2.3.6 to CCI-2.3.7

#3 Updated by Dave Vieglais almost 4 years ago

  • Sprint set to Infrastructure backlog

#4 Updated by Dave Vieglais almost 4 years ago

  • Sprint changed from Infrastructure backlog to CCI-2.3.7

#5 Updated by Dave Vieglais almost 4 years ago

  • % Done changed from 0 to 30
  • Status changed from New to In Progress

PBI status auto updated to In Progress because at least one task wasn't on New status

#6 Updated by Dave Vieglais almost 3 years ago

  • % Done changed from 30 to 100
  • Status changed from In Progress to Closed

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)