Project

General

Profile

Bug #7663

d1-index-task-processor seems to of stopped for no apparent reason (stage environment).

Added by Dave Vieglais almost 7 years ago. Updated almost 6 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Andrei Buium
Category:
d1_cn_index_processor
Target version:
-
Start date:
2016-02-25
Due date:
% Done:

100%

Story Points:
Sprint:

Description

It appears that d1-index-task-processor stopped running on cn-stage-orc-1.test.dataone.org. The log does not show anything of note. Restarting the service was successful and appears to be running normally. Filing this bug as something to watch for.

[ INFO] 2016-02-24 23:13:49,505 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=seriesId%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,510 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=id%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,521 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=seriesId%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,527 (HTTPService:doRequest:359) REQUEST URI= http://localhost:8983/solr/search_core/select/?q=id%3Ahttps%5C%3A%2F%2Fpasta.lternet.edu%2Fpackage%2Fmetadata%2Feml%2Fknb%5C-lter%5C-pie%2F34%2F12&start=0&rows=1&indent=on
[ INFO] 2016-02-24 23:13:49,546 (OutputStreamHttpEntity:writeTo:93) Creating HTTP Output Stream for 4 docs:
[ INFO] 2016-02-24 23:13:50,181 (IndexTaskProcessor:processTask:119) Indexing complete for pid: doi:10.6073/pasta/3f2fcf0b0dacad708fab392bad550e93

Associated revisions

Revision 17675
Added by Andrei Buium almost 7 years ago

Bug fix in case of TemplateStringProcessor attempting to replace the template value with a value that contains special characters (backslashes or dollar sign characters - see String.replaceAll javadoc). Replacement value should now be treated as a literal replacement.
refs #7663

Revision 17675
Added by Andrei Buium almost 7 years ago

Bug fix in case of TemplateStringProcessor attempting to replace the template value with a value that contains special characters (backslashes or dollar sign characters - see String.replaceAll javadoc). Replacement value should now be treated as a literal replacement.
refs #7663

History

#1 Updated by Dave Vieglais almost 7 years ago

After startup, did notice:

Feb 25, 2016 2:20:23 PM com.hazelcast.config.FileSystemXmlConfig
INFO: Configuring Hazelcast from '/etc/dataone/storage/hazelcast.xml'.
Feb 25, 2016 2:20:23 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is STARTING
Feb 25, 2016 2:20:24 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is CLIENT_CONNECTION_OPENING
Feb 25, 2016 2:20:24 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is CLIENT_CONNECTION_OPENED
Feb 25, 2016 2:20:24 PM com.hazelcast.client.LifecycleServiceClientImpl
INFO: HazelcastClient is STARTED
java.lang.IllegalArgumentException: Illegal group reference
at java.util.regex.Matcher.appendReplacement(Matcher.java:808)
at java.util.regex.Matcher.replaceAll(Matcher.java:906)
at java.lang.String.replaceAll(String.java:2162)
at org.dataone.cn.indexer.parser.utility.TemplateStringProcessor.process(TemplateStringProcessor.java:41)
at org.dataone.cn.indexer.parser.utility.RootElement.getRootValues(RootElement.java:88)
at org.dataone.cn.indexer.parser.CommonRootSolrField.getFields(CommonRootSolrField.java:65)
at org.dataone.cn.indexer.parser.BaseXPathDocumentSubprocessor.processDocument(BaseXPathDocumentSubprocessor.java:105)
at org.dataone.cn.indexer.parser.ScienceMetadataDocumentSubprocessor.processDocument(ScienceMetadataDocumentSubprocessor.java:42)
at org.dataone.cn.indexer.SolrIndexService.processObject(SolrIndexService.java:160)
at org.dataone.cn.indexer.SolrIndexService.insertIntoIndex(SolrIndexService.java:207)
at org.dataone.cn.index.processor.IndexTaskUpdateProcessor.process(IndexTaskUpdateProcessor.java:49)
at org.dataone.cn.index.processor.IndexTaskProcessor.processTask(IndexTaskProcessor.java:111)
at org.dataone.cn.index.processor.IndexTaskProcessor.processIndexTaskQueue(IndexTaskProcessor.java:92)
at org.dataone.cn.index.processor.IndexTaskProcessorJob.execute(IndexTaskProcessorJob.java:47)
at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)

#2 Updated by Dave Vieglais almost 7 years ago

  • Subject changed from d1-index-task-processor seems to of stopped for no apparent reason. to d1-index-task-processor seems to of stopped for no apparent reason (stage environment).

#3 Updated by Andrei Buium almost 7 years ago

  • % Done changed from 0 to 30
  • Status changed from New to In Progress

#4 Updated by Andrei Buium almost 7 years ago

Made a bug fix for what I believe was causing the above stack trace around here:

at java.lang.String.replaceAll(String.java:2162)
at org.dataone.cn.indexer.parser.utility.TemplateStringProcessor.process(TemplateStringProcessor.java:41)

Wasn't able to confirm unfortunately - couldn't find similar stack trace in logs, wanted to check the data for what I think were the culprits (special characters trying to be replaced into template value by the processor).

#5 Updated by Andrei Buium almost 7 years ago

  • Status changed from In Progress to Testing
  • % Done changed from 30 to 50

Should keep an eye on this a little longer and then hopefully close it. The problem doesn't seem to have reappeared though.

#6 Updated by Dave Vieglais almost 6 years ago

  • Status changed from Testing to Closed
  • % Done changed from 50 to 100

Also available in: Atom PDF

Add picture from clipboard (Maximum size: 14.8 MB)