DataONE Tasks: Issueshttps://redmine.dataone.org/https://redmine.dataone.org/favicon.ico2017-11-06T22:18:26ZDataONE Tasks
Redmine Member Nodes - Story #8213 (New): KUBI node is not responding as a MNhttps://redmine.dataone.org/issues/82132017-11-06T22:18:26ZDave Vieglaisdave.vieglais@gmail.com
<p>Determine ongoing status of the KUBI node and develop a plan to deprecate or upgrade.</p>
Infrastructure - Story #8208 (New): Review and adjust memory allocated to d1-index-task-generator...https://redmine.dataone.org/issues/82082017-10-24T16:09:06ZDave Vieglaisdave.vieglais@gmail.com
<p>Configuration for these services is located at:<br>
<br>
/etc/default/d1-index-task-generator<br>
/etc/default/d1-index-task-processor</p>
<p>d1-index-task-generator is probably fine, however d1-index-task-processor may benefit from increased allocation especially for processing resource maps.</p>
Infrastructure - Story #8207 (New): review and adjust memory allocated to d1-processinghttps://redmine.dataone.org/issues/82072017-10-24T16:06:24ZDave Vieglaisdave.vieglais@gmail.com
<p>d1-processing settings are under @/etc/default/d1-processing@</p>
<p>Currently runs like: <br>
<br>
jsvc.exec -home /usr/lib/jvm/java-1.8.0-openjdk-amd64 -cp /usr/share/java/commons-daemon.jar:/usr/share/j<br>
ava/d1_process_daemon.jar -debug -outfile /var/log/dataone/daemon/d1-processing-jsvc.log -errfile /var/log/dataone/daemon/d1-process<br>
ing-jsvc.err -pidfile /var/run/d1-processing.pid -user tomcat7 -Djava.awt.headless=true -XX:UseParallelGC -Xmx4096M -Xms1024M -Xss12<br>
80k -XX:MaxPermSize=512M org.dataone.cn.batch.daemon.SchedulerDaemon</p>
Infrastructure - Story #8204 (New): Adjust memory allocation for services running under JVM on CNshttps://redmine.dataone.org/issues/82042017-10-24T15:29:28ZDave Vieglaisdave.vieglais@gmail.com
<p>Most services on CNs run in JVM instances, each with separate restrictions on memory use.</p>
<p>Current configurations were mostly based on defaults and have not changed much despite significantly higher memory use for systems such as Solr and Hazelcast.</p>
<p>The goal of this story is to evaluate the memory configuration of each JVM instance on the CNs and tune as necessary with the primary goal of avoiding out of memory errors, secondary goal is improving performance.</p>
<p>Note that with increased heap allocation, garbage collection may become a significant bottleneck, with application freeze in the order of several minutes possible or likely with higher heap allocations (e.g. 16GB)</p>
Python GMN - Story #8074 (New): Eliminate unnecessary setuid/setgid programshttps://redmine.dataone.org/issues/80742017-04-17T18:14:15ZRoger Dahldahl@unm.edu
<p>System installers often install numerous setuid/setgid programs that are unnecessary, and in some case introduce vulnerabilities, which enable privilege escalation.</p>
<p>setuid/setgid programs which are not needed for proper functioning of the system should be removed or disabled. Those that are needed should be evaluated for vulnerability and configuration issues.</p>
Python GMN - Story #8073 (New): Make sure unecessary services are disabledhttps://redmine.dataone.org/issues/80732017-04-17T18:12:19ZRoger Dahldahl@unm.edu
<p>From security evaluation:</p>
<p>Unnecessary services introduce weaknesses. Default software installations often start up services that are not needed. These services may be used to garner information about the system, or may have a default configuration that allows unintentional access to a system.</p>
<p>Disable/remove unnecessary services.</p>
<p>Services should be audited on installed systems. If possible, start with all services disabled and add the ones that are required. Or, at a minimum, services that are not required should be disabled.</p>
Python GMN - Story #7219 (In Progress): Upgrade Django version used by GMN, add better support fo...https://redmine.dataone.org/issues/72192015-06-16T14:56:59ZDave Vieglaisdave.vieglais@gmail.comOGC-Slender Node - Story #7170 (New): Evaluate the feasibility of extracting provenance informati...https://redmine.dataone.org/issues/71702015-06-08T19:03:58ZDave Vieglaisdave.vieglais@gmail.comOGC-Slender Node - Story #7166 (New): Create ORE document for an NODC data packagehttps://redmine.dataone.org/issues/71662015-06-08T18:49:41ZDave Vieglaisdave.vieglais@gmail.com
<p>Each accession is treated as a data package. Need to generate a resource map document that describes the contents of an accession.</p>
OGC-Slender Node - Story #7151 (In Progress): Generate system metadata for contenthttps://redmine.dataone.org/issues/71512015-06-04T20:24:16ZDave Vieglaisdave.vieglais@gmail.com
<p>For the three types of content (resource, science meta, data), develop a mechanism to provide system metadata.</p>
OGC-Slender Node - Story #7149 (Testing): Implement mechanism to retrieve a list of objects avail...https://redmine.dataone.org/issues/71492015-06-04T20:20:47ZDave Vieglaisdave.vieglais@gmail.com
<p>Using Python, implement a tool that is able to retrieve a list of packages, and the objects that make up each package.</p>
OGC-Slender Node - Story #7146 (In Progress): Determine formatId for content retrievable from NOD...https://redmine.dataone.org/issues/71462015-06-04T20:15:08ZDave Vieglaisdave.vieglais@gmail.com
<p>In order to create system metadata for objects held by NODC, it is necessary to infer the appropriate formatId for each object.</p>
Python GMN - Story #7095 (New): Support HTTP redirect capability for GMN within the Vendor Specif...https://redmine.dataone.org/issues/70952015-05-12T16:20:39ZMark Servillamark.servilla@gmail.com
<p>GMN provides proxy capabilities to integrate existing content residing in a back-end data repository through its Vendor Specific Extension model. Only minimal support exists within the GMN-VSE model for HTTP redirects. Although the use of HTTP redirects is more of an exception within the the GMN-VSE model, it can provide a flexible mechanism for MNs who dynamically manage data and metadata objects.</p>
DataONE API - Story #6759 (New): ObjectFormat Managementhttps://redmine.dataone.org/issues/67592015-01-13T20:12:14ZRob Nahfrnahf@epscor.unm.edu
<p>There currently are not any API methods for managing the collection of objectFormats registered to a dataone environment. There is a "bootstrap" resource that constitutes a the list in either d1_libclient_java or d1_common_java that can be used in testing environments. There's also a different resource in the cn-os-core project that is used in production.</p>
<p>These 2 resources are difficult to maintain (keep synchronized), and there isn't a defined process for adding formats to production.</p>
<p>We discussed the inclusion of an "addFormat(...) method in V2, but it is not currently in the API. (It would be part of the CNCore API).</p>
<p>It would be good to review the situation with a focused discussion to at least troubleshoot the existing informal management practices and formalize them; and then consider if more infrastructure is needed.</p>
Infrastructure - Story #4091 (New): ESRI GeoPortal MN stackhttps://redmine.dataone.org/issues/40912013-10-15T13:36:56ZBruce Wilsonbwilso27@utk.edu
<p>The objective is to design, develop, and implement a MN Stack to integrate with the ESRI GeoPortal server (<a href="http://www.esri.com/software/arcgis/geoportal">http://www.esri.com/software/arcgis/geoportal</a>).</p>