DataONE Tasks: Issueshttps://redmine.dataone.org/https://redmine.dataone.org/favicon.ico2016-05-31T20:55:02ZDataONE Tasks
Redmine Python Libraries - Task #7821 (New): Verify Expect: 100-Continue header on POST or PUT requestshttps://redmine.dataone.org/issues/78212016-05-31T20:55:02ZRobert Waltz
<p>We may be adding support for the 100-Continue header in order to successfully upload content on some member node servers.</p>
<p>More description of the header's use from a Java client:</p>
<pre> 'Expect: 100-Continue' handshake for the entity enclosing methods.
The purpose of the Expect: 100-Continue handshake is to allow the client
that is sending a request message with a request body to determine if
the origin server is willing to accept the request (based on the request
headers) before the client sends the request body. The use of the
Expect: 100-continue handshake can result in a noticeable performance
improvement for entity enclosing requests (such as POST and PUT) that
require the target server's authentication.
https://hc.apache.org/httpcomponents-client-4.2.x/tutorial/html/fundamentals.html
</pre> Infrastructure - Story #7807 (New): cn.synchronize should support synchronization failure correct...https://redmine.dataone.org/issues/78072016-05-13T16:56:25ZRob Nahfrnahf@epscor.unm.edu
<p>cn.synchronize(session, identifier) works well for its original purpose (supporting MN-driven system metadata updates, and MN-driven push synchronization), but doesn't seem to work for manual synchronization failure workflows. The main problem is that the request can only be made by the MN itself (using the MN client certificate). </p>
<p>As we envision a centralized dashboard for monitoring failed synchronization items, how do we address this situation? </p>
<p>The synchronization processing queue needs both the pid and a nodeId from where to retrieve the object. the NodeId is not specified directly in the method call, but gleaned from the session by a reverse lookup from the certificate. (It uses the first node found in the NodeList where the Node.subject field matches the certificate subject).</p>
<p>Should we allow node.contactSubjects into the algorithm?<br>
Should we add nodeId as a parameter?</p>
Python GMN - Task #7162 (New): Member node does not check with coordinating node before replicatinghttps://redmine.dataone.org/issues/71622015-06-05T23:49:44ZMark Flynnflynnm@dataone.unm.edu
<p>Replication is supposed to follow a sequence:<br>
CN — MN.replicate( ) —> newReplicaMN<br>
newReplicatMN —- MN.getReplica( ) —> sourceMN<br>
sourceMN — CN.isNodeAuthorized() —> CN<br>
newReplicaMN — CN.setReplicationStatus( ) —> CN</p>
<p>However, CN.isNodeAuthorized is not called before sourceMN replicates to newReplicaMN</p>
Python GMN - Story #7095 (New): Support HTTP redirect capability for GMN within the Vendor Specif...https://redmine.dataone.org/issues/70952015-05-12T16:20:39ZMark Servillamark.servilla@gmail.com
<p>GMN provides proxy capabilities to integrate existing content residing in a back-end data repository through its Vendor Specific Extension model. Only minimal support exists within the GMN-VSE model for HTTP redirects. Although the use of HTTP redirects is more of an exception within the the GMN-VSE model, it can provide a flexible mechanism for MNs who dynamically manage data and metadata objects.</p>
Python Libraries - Story #5468 (New): Remove dead code from D1 Python stackhttps://redmine.dataone.org/issues/54682014-06-06T18:57:00ZRoger Dahldahl@unm.edu
<p><a href="https://pypi.python.org/pypi/vulture">https://pypi.python.org/pypi/vulture</a></p>
Infrastructure - Task #3763 (New): Visualize PyPI download statistics for Python componentshttps://redmine.dataone.org/issues/37632013-05-14T21:11:04ZRoger Dahldahl@unm.edu
<p>Create a tool that gets download statistics for DataONE software distributed on PyPI and generates graphs that show how number of downloads change over time.</p>
Java Client - Story #3666 (In Progress): D1Client.listUpdateHistory() needs to handle changing ac...https://redmine.dataone.org/issues/36662013-03-15T22:51:23ZRob Nahfrnahf@epscor.unm.edu
<p>the current D1Client.listUpdateHistory() method needs to gracefully handle the situation where a NotAuthorized request is returned. the ObsoletesChain client class may need to be refactored to allow for this exception to be held so it can notify the user where appropriate.</p>
<p>Ostensibly, with a NotAuthorized, the user will not have access to either the tail or head of the chain, so can't return the head or tail, depending on how access changes.</p>
Infrastructure - Task #3333 (New): Generalize mk_* scripts for host namehttps://redmine.dataone.org/issues/33332012-10-11T18:50:14ZDave Vieglaisdave.vieglais@gmail.com
<p>There is currently a dependency of "-1" in the hostname for the various custom check_mk custom plugins. </p>
<p>This should be generalized at some point.</p>
<p>This didn't work:</p>
<p>testhost=$(echo $thishost | sed s/-[a-z]*-([0-9])/-${host}-\1/)</p>
Infrastructure - Task #3156 (New): Design Review: resource map indexing strategyhttps://redmine.dataone.org/issues/31562012-08-27T18:51:08ZSkye Roseboomsroseboo@dataone.unm.edu
<p>Mid to long term design review: </p>
<p>Current design is that resource maps are not indexed until all referenced objects are indexed or accounted for (archived/obsoleted).</p>
<p>This causes issues showing links to documents that are known - and could prevent resource maps from ever being indexed - if there are references to unknown ids. </p>
<p>The design works this way so that the data relationships are only introduced into the index when the entire resource map can be processed. An alternative would be to build/re-build the relationships (resourceMap, describes, describedBy) on each update of every document. Would entail querying the index for resource map referencing the current document and building the relationship links between the indexed documents for each event the index responds to. Would add a fair amount of re-work to the index parsing api controller logic (XPathDocumentParser) and a fair bit of new processing load on the CN.</p>
Infrastructure - Task #2286 (New): Change Exceptions.InvalidToken to Exceptions.InvalidSessionhttps://redmine.dataone.org/issues/22862012-02-03T02:57:36ZRoger Dahldahl@unm.eduInfrastructure - Task #2281 (New): Possibly update the Identity Management and Authenticated Sess...https://redmine.dataone.org/issues/22812012-02-01T05:10:33ZRoger Dahldahl@unm.edu
<p>I'm putting the link to some questions/comments I had about the Identity Management and Authenticated Session Management document in here, so that they don't get lost.</p>
<p><a href="http://epad.dataone.org/20120131-authn-authz-questions">http://epad.dataone.org/20120131-authn-authz-questions</a></p>
Infrastructure - Task #2147 (New): The Python stack does not support Unicode supplementary charac...https://redmine.dataone.org/issues/21472011-12-20T15:44:22ZRoger Dahldahl@unm.edu
<p>When given this identifier:</p>
<p>common-unicode-supplementary-escaped-</p>
Infrastructure - Task #1585 (New): add exec-maven-plugin to trigger python integration tests at v...https://redmine.dataone.org/issues/15852011-05-23T22:34:17ZRob Nahfrnahf@epscor.unm.edu
<p>see:</p>
<p><a href="http://steveberczuk.blogspot.com/2009/12/continuous-integration-of-python-code.html">http://steveberczuk.blogspot.com/2009/12/continuous-integration-of-python-code.html</a><br>
and<br>
<a href="http://mojo.codehaus.org/exec-maven-plugin/examples/example-exec-using-plugin-dependencies.html">http://mojo.codehaus.org/exec-maven-plugin/examples/example-exec-using-plugin-dependencies.html</a></p>
Java Client - Task #1559 (New): Refactor d1_libclient_java echo tests https://redmine.dataone.org/issues/15592011-05-13T21:05:04ZRobert Waltz
<p>The d1_libclient_java tests in D1ClientUnitTest, D1RestClientEchoTest, and RestClientEchoTest have dependencies upon external network resources. We need to modify tests so that we can inject a HttpClient interface mock implementation that mimics the echo service on dev-testing and the nodeList on cn-dev rather than, as we are currently doing, testing the apache default HttpClient implementation that is a dependency of these classes. </p>
<p>We should also move the current tests into integration testing.</p>
Infrastructure - Task #991 (New): implement HEAD /resolve/<guid>https://redmine.dataone.org/issues/9912010-10-11T17:41:17ZRob Nahfrnahf@epscor.unm.edu
<p>The resolution service supports the HEAD method:<br>
HEAD Returns basic information resolve response document<br>
Last-Modified: Date the resolve information was last updated for that identifier. This is helpful to clients that may cache resolve responses.</p>