Bug #7663
d1-index-task-processor seems to of stopped for no apparent reason (stage environment).
100%
Description
It appears that d1-index-task-processor stopped running on cn-stage-orc-1.test.dataone.org. The log does not show anything of note. Restarting the service was successful and appears to be running normally. Filing this bug as something to watch for.
[ INFO] 2016-02-24 23:13:49,505 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=seriesId%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,510 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=id%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,521 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=seriesId%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,527 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=id%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,546 (OutputStreamHttpEntity:writeTo:93) Creating HTTP Output Stream for 4 docs:
[ INFO] 2016-02-24 23:13:50,181 (IndexTaskProcessor:processTask:119) Indexing complete for pid: doi:10.6073/pasta/3f2fcf0b0dacad708fab392bad550e93
Associated revisions
Bug fix in case of TemplateStringProcessor attempting to replace the template value with a value that contains special characters (backslashes or dollar sign characters - see String.replaceAll javadoc). Replacement value should now be treated as a literal replacement.
refs #7663
Bug fix in case of TemplateStringProcessor attempting to replace the template value with a value that contains special characters (backslashes or dollar sign characters - see String.replaceAll javadoc). Replacement value should now be treated as a literal replacement.
refs #7663
History
#1 Updated by Dave Vieglais over 8 years ago
After startup, did notice:
Feb 25, 2016 2:20:23 PM com.hazelcast.config.FileSystemXmlConfig
INFO: Configuring Hazelcast from '/etc/dataone/storage/hazelcast.xml'.
Feb 25, 2016 2:20:23 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is STARTING
Feb 25, 2016 2:20:24 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is CLIENT_CONNECTION_OPENING
Feb 25, 2016 2:20:24 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is CLIENT_CONNECTION_OPENED
Feb 25, 2016 2:20:24 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is STARTED
java.lang.IllegalArgumentException: Illegal group reference
at java.util.regex.Matcher.appendReplacement(Matcher.java:808)
at java.util.regex.Matcher.replaceAll(Matcher.java:906)
at java.lang.String.replaceAll(String.java:2162)
at org.dataone.cn.indexer.parser.utility.TemplateStringProcessor.process(TemplateStringProcessor.java:41)
at org.dataone.cn.indexer.parser.utility.RootElement.getRootValues(RootElement.java:88)
at org.dataone.cn.indexer.parser.CommonRootSolrField.getFields(CommonRootSolrField.java:65)
at org.dataone.cn.indexer.parser.BaseXPathDocumentSubprocessor.processDocument(BaseXPathDocumentSubprocessor.java:105)
at org.dataone.cn.indexer.parser.ScienceMetadataDocumentSubprocessor.processDocument(ScienceMetadataDocumentSubprocessor.java:42)
at org.dataone.cn.indexer.SolrIndexService.processObject(SolrIndexService.java:160)
at org.dataone.cn.indexer.SolrIndexService.insertIntoIndex(SolrIndexService.java:207)
at org.dataone.cn.index.processor.IndexTaskUpdateProcessor.process(IndexTaskUpdateProcessor.java:49)
at org.dataone.cn.index.processor.IndexTaskProcessor.processTask(IndexTaskProcessor.java:111)
at org.dataone.cn.index.processor.IndexTaskProcessor.processIndexTaskQueue(IndexTaskProcessor.java:92)
at org.dataone.cn.index.processor.IndexTaskProcessorJob.execute(IndexTaskProcessorJob.java:47)
at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
#2 Updated by Dave Vieglais over 8 years ago
- Subject changed from d1-index-task-processor seems to of stopped for no apparent reason. to d1-index-task-processor seems to of stopped for no apparent reason (stage environment).
#3 Updated by Andrei Buium over 8 years ago
- % Done changed from 0 to 30
- Status changed from New to In Progress
#4 Updated by Andrei Buium over 8 years ago
Made a bug fix for what I believe was causing the above stack trace around here:
at java.lang.String.replaceAll(String.java:2162)
at org.dataone.cn.indexer.parser.utility.TemplateStringProcessor.process(TemplateStringProcessor.java:41)
Wasn't able to confirm unfortunately - couldn't find similar stack trace in logs, wanted to check the data for what I think were the culprits (special characters trying to be replaced into template value by the processor).
#5 Updated by Andrei Buium over 8 years ago
- Status changed from In Progress to Testing
- % Done changed from 30 to 50
Should keep an eye on this a little longer and then hopefully close it. The problem doesn't seem to have reappeared though.
#6 Updated by Dave Vieglais over 7 years ago
- Status changed from Testing to Closed
- % Done changed from 50 to 100
