DataONE Tasks: Issueshttps://redmine.dataone.org/https://redmine.dataone.org/favicon.ico2016-05-31T20:55:02ZDataONE Tasks
Redmine Python Libraries - Task #7821 (New): Verify Expect: 100-Continue header on POST or PUT requestshttps://redmine.dataone.org/issues/78212016-05-31T20:55:02ZRobert Waltz
<p>We may be adding support for the 100-Continue header in order to successfully upload content on some member node servers.</p>
<p>More description of the header's use from a Java client:</p>
<pre> 'Expect: 100-Continue' handshake for the entity enclosing methods.
The purpose of the Expect: 100-Continue handshake is to allow the client
that is sending a request message with a request body to determine if
the origin server is willing to accept the request (based on the request
headers) before the client sends the request body. The use of the
Expect: 100-continue handshake can result in a noticeable performance
improvement for entity enclosing requests (such as POST and PUT) that
require the target server's authentication.
https://hc.apache.org/httpcomponents-client-4.2.x/tutorial/html/fundamentals.html
</pre> Infrastructure - Story #7807 (New): cn.synchronize should support synchronization failure correct...https://redmine.dataone.org/issues/78072016-05-13T16:56:25ZRob Nahfrnahf@epscor.unm.edu
<p>cn.synchronize(session, identifier) works well for its original purpose (supporting MN-driven system metadata updates, and MN-driven push synchronization), but doesn't seem to work for manual synchronization failure workflows. The main problem is that the request can only be made by the MN itself (using the MN client certificate). </p>
<p>As we envision a centralized dashboard for monitoring failed synchronization items, how do we address this situation? </p>
<p>The synchronization processing queue needs both the pid and a nodeId from where to retrieve the object. the NodeId is not specified directly in the method call, but gleaned from the session by a reverse lookup from the certificate. (It uses the first node found in the NodeList where the Node.subject field matches the certificate subject).</p>
<p>Should we allow node.contactSubjects into the algorithm?<br>
Should we add nodeId as a parameter?</p>
Infrastructure - Bug #7698 (New): Exclude SLF4J jars in d1_solr_extensions.jarhttps://redmine.dataone.org/issues/76982016-03-28T16:22:54ZRobert Waltz
<p>Dave reported:<br>
when running “service solr status” on a CN, I see a complaint about multiple SLF4J bindings:<br>
(12:05:53 PM) vieglais: SLF4J: Class path contains multiple SLF4J bindings.<br>
(12:05:53 PM) vieglais: SLF4J: Found binding in <a href="12:05:55 PM" class="external">jar:file:/var/solr/server/solr-webapp/webapp/WEB-INF/lib/d1_solr_extensions.jar!/org/slf4j/impl/StaticLoggerBinder.class</a> vieglais: SLF4J: Found binding in <a href="12:05:56 PM" class="external">jar:file:/var/solr/server/lib/ext/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class</a> vieglais: SLF4J: See <a href="http://www.slf4j.org/codes.html#multiple_bindings">http://www.slf4j.org/codes.html#multiple_bindings</a> for an explanation.<br>
(12:05:56 PM) vieglais: SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]</p>
<p>looks like a class conflict due to the shaded d1_solr_extensions.jar that includes SLF4J and solr jetty that also includes SLF4J.</p>
<p>try excluding SLF4J jars in d1_solr_extensions.jar.</p>
Infrastructure - Bug #4303 (New): Fix potential bug where an object could be created and accepted...https://redmine.dataone.org/issues/43032014-03-06T22:42:59ZRoger Dahldahl@unm.edu
<p>Use SQL "select for update" (or similar) to lock the replication queue while a regular create takes place, so that a replication request cannot be accepted for an object at the same time as that object is being created. GMN already checks, in create(), that a replication request does not exist for the object. It also checks for the opposite, but there is a tiny window in which both could be created at the same time.</p>
Infrastructure - Bug #4300 (New): Create more appropriate "create" entry in the LogRecord for rep...https://redmine.dataone.org/issues/43002014-03-06T22:34:56ZRoger Dahldahl@unm.edu
<p>In the "create" log entry for objects created by the replication processor (replicas), IP address and subject should be for the CN that requested the replica. That information is currently not being captured when the replication request is received.</p>
Infrastructure - Task #3763 (New): Visualize PyPI download statistics for Python componentshttps://redmine.dataone.org/issues/37632013-05-14T21:11:04ZRoger Dahldahl@unm.edu
<p>Create a tool that gets download statistics for DataONE software distributed on PyPI and generates graphs that show how number of downloads change over time.</p>
Infrastructure - Feature #3762 (New): DataONE software download statisticshttps://redmine.dataone.org/issues/37622013-05-14T21:07:03ZRoger Dahldahl@unm.edu
<p>Gather and visualize statistics for downloads and/or installed user base for DataONE software components.</p>
Java Client - Story #3666 (In Progress): D1Client.listUpdateHistory() needs to handle changing ac...https://redmine.dataone.org/issues/36662013-03-15T22:51:23ZRob Nahfrnahf@epscor.unm.edu
<p>the current D1Client.listUpdateHistory() method needs to gracefully handle the situation where a NotAuthorized request is returned. the ObsoletesChain client class may need to be refactored to allow for this exception to be held so it can notify the user where appropriate.</p>
<p>Ostensibly, with a NotAuthorized, the user will not have access to either the tail or head of the chain, so can't return the head or tail, depending on how access changes.</p>
Infrastructure - Bug #3246 (New): Metacat returns 500 instead of 404 in some caseshttps://redmine.dataone.org/issues/32462012-09-11T02:00:24ZDave Vieglaisdave.vieglais@gmail.com
<p>For example:</p>
<p><a href="https://knb.ecoinformatics.org/knb/d1/mn/v1/bogus">https://knb.ecoinformatics.org/knb/d1/mn/v1/bogus</a></p>
<p>should return a 404 NotFound error, but instead returns a 500, ServiceFailure. </p>
<p>This is not an urgent issue, but should probably be cleaned up.</p>
Java Client - Bug #3165 (New): Libclient caching does not respect accessPolicieshttps://redmine.dataone.org/issues/31652012-08-31T15:48:35ZRob Nahfrnahf@epscor.unm.edu
<p>Currently, libclient allows the get() method to specify the session/subject of the caller, but the underlying JCS cache does not associate the session/subject of the caller with the cache. Therefore, objects retrieved by one subject are available to any other subject using that MNode instance, even if otherwise a NotAuthorized would be returned if the object was not previously cached.</p>
Infrastructure - Task #3156 (New): Design Review: resource map indexing strategyhttps://redmine.dataone.org/issues/31562012-08-27T18:51:08ZSkye Roseboomsroseboo@dataone.unm.edu
<p>Mid to long term design review: </p>
<p>Current design is that resource maps are not indexed until all referenced objects are indexed or accounted for (archived/obsoleted).</p>
<p>This causes issues showing links to documents that are known - and could prevent resource maps from ever being indexed - if there are references to unknown ids. </p>
<p>The design works this way so that the data relationships are only introduced into the index when the entire resource map can be processed. An alternative would be to build/re-build the relationships (resourceMap, describes, describedBy) on each update of every document. Would entail querying the index for resource map referencing the current document and building the relationship links between the indexed documents for each event the index responds to. Would add a fair amount of re-work to the index parsing api controller logic (XPathDocumentParser) and a fair bit of new processing load on the CN.</p>
Infrastructure - Task #2286 (New): Change Exceptions.InvalidToken to Exceptions.InvalidSessionhttps://redmine.dataone.org/issues/22862012-02-03T02:57:36ZRoger Dahldahl@unm.eduInfrastructure - Task #2281 (New): Possibly update the Identity Management and Authenticated Sess...https://redmine.dataone.org/issues/22812012-02-01T05:10:33ZRoger Dahldahl@unm.edu
<p>I'm putting the link to some questions/comments I had about the Identity Management and Authenticated Session Management document in here, so that they don't get lost.</p>
<p><a href="http://epad.dataone.org/20120131-authn-authz-questions">http://epad.dataone.org/20120131-authn-authz-questions</a></p>
Infrastructure - Task #2147 (New): The Python stack does not support Unicode supplementary charac...https://redmine.dataone.org/issues/21472011-12-20T15:44:22ZRoger Dahldahl@unm.edu
<p>When given this identifier:</p>
<p>common-unicode-supplementary-escaped-</p>
Java Client - Task #1559 (New): Refactor d1_libclient_java echo tests https://redmine.dataone.org/issues/15592011-05-13T21:05:04ZRobert Waltz
<p>The d1_libclient_java tests in D1ClientUnitTest, D1RestClientEchoTest, and RestClientEchoTest have dependencies upon external network resources. We need to modify tests so that we can inject a HttpClient interface mock implementation that mimics the echo service on dev-testing and the nodeList on cn-dev rather than, as we are currently doing, testing the apache default HttpClient implementation that is a dependency of these classes. </p>
<p>We should also move the current tests into integration testing.</p>