Story #8175
Solr crashing with out of memory error
Start date:
2017-09-05
Due date:
% Done:
100%
Story Points:
Sprint:
Description
Solr has been crashing and/or thrashing with out of memory errors on CN-UCSB-1 resulting in poor or no response when using search.dataone.org.
There are several related issues to be addressed here:
- Poorly written queries generated by the search UI are causing excessive demand on the solr index
- Solr is running with 2GB allocated to the JVM. This appears to be insufficient.
- Should design and implement a load balancing solution so a single instance of Solr is not used all the time
- Memory use is always high on cn-ucsb-1 where processing (and so log aggregation) is running. Review the log aggregation process for memory leaks and performance.
- The configuration for Solr is using mostly default parameters. This should be reviewed and revised where appropriate.
Subtasks
Related issues
History
#1 Updated by Dave Vieglais over 7 years ago
- Related to Story #7939: Indexing is too slow, especially with large packages added
#2 Updated by Jing Tao about 7 years ago
- Target version changed from CCI-2.3.6 to CCI-2.3.7
#3 Updated by Dave Vieglais almost 7 years ago
- Sprint set to Infrastructure backlog
#4 Updated by Dave Vieglais almost 7 years ago
- Sprint changed from Infrastructure backlog to CCI-2.3.7
#5 Updated by Dave Vieglais almost 7 years ago
- % Done changed from 0 to 30
- Status changed from New to In Progress
PBI status auto updated to In Progress because at least one task wasn't on New status
#6 Updated by Dave Vieglais almost 6 years ago
- % Done changed from 30 to 100
- Status changed from In Progress to Closed