DataONE Tasks: Issueshttps://redmine.dataone.org/https://redmine.dataone.org/favicon.ico2017-02-17T22:02:56ZDataONE Tasks
Redmine Infrastructure - Task #8023 (Closed): Bug in log message for NotAuthorized CHANGE rights on seriesIdhttps://redmine.dataone.org/issues/80232017-02-17T22:02:56ZRoger Dahldahl@unm.edu
<p>cn-synchronization does not correctly format the following error message, which causes the Identifier memory address to be displayed instead of its value.</p>
<p>cn-synchronization.log.1:[ERROR] 2017-02-16 22:02:16,483 (V2TransferObjectTask:processTask:416) Task-urn:node:TDAR-doi:10.6067:XCV81G0P79_format=d1rem1483726160322 - NotAuthorized to claim the seriesId - NotAuthorized - Submitter does not have CHANGE rights on the SeriesId as determined by the current head of the Sid collection, whose pid is: org.dataone.service.types.v1.Identifier@67c144f0</p>
Infrastructure - Task #7968 (Closed): Change the file extension from zip to gz for gzip formatidhttps://redmine.dataone.org/issues/79682017-01-17T19:34:17ZJing Taotao@nceas.ucsb.edu
<p>Currently the default file extension is zip. However, the gz is more popular one. We should use it.</p>
Infrastructure - Task #7960 (Closed): Create format ids for R, MATLAB, Python and SAS codehttps://redmine.dataone.org/issues/79602017-01-04T21:12:36ZJing Taotao@nceas.ucsb.edu
<p>Here are format ids: </p>
<p>application/R<br><br>
R script file format<br>
DATA<br>
<br>
R<br>
</p>
<p>application/MATLAB<br><br>
MATLAB code file format<br>
DATA<br>
<br>
m<br>
</p>
<p>application/Python<br><br>
Python script file format<br>
DATA<br>
<br>
py<br>
</p>
<p>application/SAS<br><br>
SAS programming file format<br>
DATA<br>
<br>
sas<br>
</p>
<p>Please feel to free to modify them.</p>
Infrastructure - Bug #7957 (Closed): Incorrect or missing PID escaping when deleting records from...https://redmine.dataone.org/issues/79572017-01-03T19:26:58ZRoger Dahldahl@unm.edu
<p>The CN is not correctly escaping the PID before passing it to the indexer we use (Apache Solr) in delete calls.</p>
<p>Example:</p>
<p>(HTTPService:writeError:255) <?xml version="1.1" encoding="utf-8"?><br>
doi:10.6067:XCV843020_meta&v=1483015376289</p>
<p>(TemporalPeriodSolrField:getFields:79) Couldn't extract 'start' or 'end' date for pid<br>
doi:10.6067:XCV843020_meta&v=1483015376289. Temporal pattern of type period needs to contain at least one of these.<br>
Value was:</p>
Infrastructure - Task #7952 (Closed): GRIIDC icon not showing in search UIhttps://redmine.dataone.org/issues/79522016-12-16T15:02:22ZDave Vieglaisdave.vieglais@gmail.com
<p>The GRIIDC icon is not showing in search results.</p>
<p>The icon / logo is available at:</p>
<p><a href="https://raw.githubusercontent.com/DataONEorg/member-node-info/master/production/graphics/web/GRIIDC.png">https://raw.githubusercontent.com/DataONEorg/member-node-info/master/production/graphics/web/GRIIDC.png</a></p>
Infrastructure - Story #7951 (Closed): Allow CN to set NodeProperties in ldaphttps://redmine.dataone.org/issues/79512016-12-14T05:31:33ZRob Nahfrnahf@epscor.unm.edu
<p>The Node documents NodeProperties property can be used to store ancillary information about the Node. This is currently under the control of the MN. It would be useful for the CN to be able to set some properties for the search UI and node display, without worrying about them being overwritten upon cn.updateNodeCapabilities() called from the MN.</p>
<p>The proposal is to designate the prefix "CN_" for these CN-set properties, and modify the CN.updateNodeCapabilities implementation in the NodeRegistry to prevent the MN from adding or removing those prefixed key-value pairs.</p>
Infrastructure - Bug #7948 (Closed): An UnAuthorization exception happened when the CN synchroniz...https://redmine.dataone.org/issues/79482016-12-06T17:12:38ZJing Taotao@nceas.ucsb.edu
<p>Dave saw an UnAuthorization exception happened when the CN synchronized the objects with sid from tARD mn. We tracked down it caused by a method in V2TransferObjectTask. In that method, it will check the submitter in the given system metadata if has the change permission in the header of sid. We need the new code to check if the rights holder has the change permission when the submitter doesn't have the permission. It works.</p>
Infrastructure - Task #7947 (Closed): Calling cn.synchronize method asynchronously in mn.updatesy...https://redmine.dataone.org/issues/79472016-11-30T23:34:52ZJing Taotao@nceas.ucsb.edu
<p>The a client to the mn.updatesystemetadata on the Metacat mn, sometimes it waited for 30 seconds to finish the call. The problem is that the calling of cn.synchronize method somehow was hang, then returned a timeout exception.<br>
If we call the cn.synchronzie method in another thread, the client will not wait for so long.</p>
Infrastructure - Task #7945 (Closed): D1-index-processor should be shut down soon after stop givenhttps://redmine.dataone.org/issues/79452016-11-29T19:26:01ZJing Taotao@nceas.ucsb.edu
<p>Currently, the d1-index-processor will be shut down until current index-tasks queue be completed. It may take a long time. We should put those index tasks which haven't done back to the d1-index task table and finish the current running task , then shut down it.</p>
Infrastructure - Task #7942 (Closed): Dataone-cn-index installation wipe the d1-index-queue databasehttps://redmine.dataone.org/issues/79422016-11-29T18:58:41ZJing Taotao@nceas.ucsb.edu
<p>We shouldn't do this since the database contains index-tasks information.</p>
Infrastructure - Bug #7938 (Closed): Malformed system metadatahttps://redmine.dataone.org/issues/79382016-11-23T11:42:15ZDave Vieglaisdave.vieglais@gmail.com
<p>System metadata for the PID @doi:10.5063/AA/wolkovich.29.1@ is malformed:</p>
<p><?xml version="1.0" encoding="UTF-8" standalone="yes"?><br>
<br>
11<br>
doi:10.5063/AA/wolkovich.29.1<br>
text/csv<br>
171623<br>
1286d997ca68c198862a6f1d266cbc2b<br>
uid=wolkovich,o=NCEAS,dc=ecoinformatics,dc=org<br>
uid=wolkovich,o=NCEAS,dc=ecoinformatics,dc=org<br>
<br>
<br>
cn=esa-moderators,dc=ecoinformatics,dc=org<br>
read<br>
write<br>
changePermission<br>
<br>
<br>
public<br>
read<br>
<br>
<br>
cn=knb-prod,o=NCEAS,dc=ecoinformatics,dc=org</<?xml version="1.0" encoding="UTF-8"?><br>
<br>
</p>
<p>Copy of system metadata retrieved from the KNB MN:<br>
<br>
<?xml version="1.0" encoding="UTF-8"?><br>
<br>
11<br>
doi:10.5063/AA/wolkovich.29.1<br>
text/csv<br>
171623<br>
1286d997ca68c198862a6f1d266cbc2b<br>
uid=wolkovich,o=NCEAS,dc=ecoinformatics,dc=org<br>
uid=wolkovich,o=NCEAS,dc=ecoinformatics,dc=org<br>
<br>
<br>
public<br>
read<br>
<br>
<br>
uid=nceasadmin,o=NCEAS,dc=ecoinformatics,dc=org<br>
read<br>
write<br>
changePermission<br>
<br>
<br>
cn=knb-prod,o=NCEAS,dc=ecoinformatics,dc=org<br>
read<br>
write<br>
changePermission<br>
<br>
<br>
cn=esa-moderators,dc=ecoinformatics,dc=org<br>
read<br>
write<br>
changePermission<br>
<br>
<br>
uid=ewolkovich,o=unaffiliated,dc=ecoinformatics,dc=org<br>
read<br>
write<br>
<br>
<br>
<br>
<br>
<br>
<br>
false<br>
2012-02-23T00:00:00.000+00:00<br>
2014-12-14T04:25:32.024+00:00<br>
urn:node:KNB<br>
urn:node:KNB<br>
<br>
urn:node:mnUCSB1<br>
completed<br>
2014-12-14T04:25:16.028+00:00<br>
<br>
<br>
urn:node:mnUNM1<br>
completed<br>
2014-12-14T04:25:23.515+00:00<br>
<br>
<br>
urn:node:KNB<br>
completed<br>
2014-12-14T04:25:30.943+00:00<br>
<br>
</p>
Member Nodes - Task #7929 (In Progress): Archive content for SEADhttps://redmine.dataone.org/issues/79292016-11-09T17:11:19ZDave Vieglaisdave.vieglais@gmail.com
<p>Charitha has requested some content to be deleted and some to be archived for the production instance of SEAD.</p>
<p>The following entries are to be archived. The reason for archive is that the entries are from the prior installation of the SEAD MN and have been replaced by different content. The entries will remain available from the CN but are to be removed from the index:</p>
<p>seadva-HsuLeslie029090a9-11b8-4fc1-bf76-bb5a8153363f<br>
seadva-nonee903e476-9bdd-4332-823a-aabea162acd6<br>
seadva-EssawyBakinam066de0b8-a0c9-4724-913a-9060f82148f1<br>
seadva-EssawyBakinamc8e53366-8745-4009-bb38-786ee49cd6fe<br>
seadva-EssawyBakinam70c6e869-5518-4c75-8d09-6a808bb41fb3<br>
seadva-ZhouQuane9e0f510-1599-4311-a6ed-ecf803f3481f</p>
<p>The following entries were deleted using the cn.delete operation and the CN certificate for authentication. The reason for deletion is that these were test objects that should never of entered the production environment:</p>
<p>seadva-a75a8b4f-7d35-4c9a-b94a-6e0f8194e6f9<br>
seadva-080d1744-c0d3-455b-baad-6a78b8af3481<br>
seadva-a4f1f73e-a1ee-4246-8d18-ce373b4cbfaa<br>
seadva-ae11f4cc-76b2-4be5-8e03-b32d95f8bfc4<br>
seadva-0f3e936c-1129-44bd-a417-c700fe0cd1a2<br>
seadva-e056e535-da57-40c0-90c1-c2e55d2ec573</p>
Infrastructure - Bug #7927 (Closed): Archive operation not permitted for V1 readonly MNshttps://redmine.dataone.org/issues/79272016-11-09T12:24:53ZDave Vieglaisdave.vieglais@gmail.com
<p>While attempting to archive content for SEAD in the production environment using a CN certificate to authenticate:</p>
<p>d1_common.types.exceptions.ServiceFailure: name: ServiceFailure<br>
errorCode: 500<br>
detailCode: 4972<br>
description: Couldn't determine the authoritative member node storage version for the pid seadva-HsuLeslie029090a9-11b8-4fc1-bf76-bb5a8153363f</p>
<p>The request is authenticated OK, but fails when the CN attempts to determine the version of the Storage API provided by the MN.</p>
<p>In this case, the MN is a Tier 1 node using the V1 API. </p>
<p>The problem lies in: /edu/ucsb/nceas/metacat/dataone/CNodeService.java at around line 601. </p>
<p>If the returned version is null then the node does not implement the storage API. In this case, the CN should check the version of the read API. If that is version 1, then the archive request should proceed since the CN is authoritative for that sysmeta. If the read API is V2, then the request should fail because the MN is authoritative for the sysmeta.</p>
<p>PIDs to be archived include:</p>
<p>seadva-HsuLeslie029090a9-11b8-4fc1-bf76-bb5a8153363f<br>
seadva-nonee903e476-9bdd-4332-823a-aabea162acd6<br>
seadva-EssawyBakinam066de0b8-a0c9-4724-913a-9060f82148f1<br>
seadva-EssawyBakinamc8e53366-8745-4009-bb38-786ee49cd6fe<br>
seadva-EssawyBakinam70c6e869-5518-4c75-8d09-6a808bb41fb3<br>
seadva-ZhouQuane9e0f510-1599-4311-a6ed-ecf803f3481f</p>
Infrastructure - Bug #7917 (Closed): Fix the issue that the system data exists but the bytes does...https://redmine.dataone.org/issues/79172016-10-21T16:54:42ZJing Taotao@nceas.ucsb.edu
<p>We have an odd situation to correct in production where an object system metadata is present but the document is not present in /var/metacat/data on any CN. We should avoid this scenario.</p>
Infrastructure - Bug #2693 (Closed): Error -1205 "Client Certificate Rejected" by Safarihttps://redmine.dataone.org/issues/26932012-05-04T13:02:22ZDave Vieglaisdave.vieglais@gmail.com
<p>When accessing <a href="https://cn-stage.dataone.org">https://cn-stage.dataone.org</a> using Safari and the user has a client side certificate installed in their keychain, but not one trusted by DataONE, the Server correctly rejects the certificate. Safari <em>should</em> continue the secure connection as unauthenticated (like other browsers do), but instead reports an error condition to the user, preventing their access to the site.</p>
<p>This is a bug in Safari, but workarounds should be investigated so that users may continue to access the ONEMercury interface with that browser. Possible options include:</p>
<ul>
<li>disable client side certificates for the /onemercury URL</li>
<li>make /onemercury accessible over regular HTTP</li>
<li>Have the user retrieve and install a CILogon cert in their keychain (a bad option since then they are bound to using that cert which will be short lived, or long lived with potentially out of date information).</li>
</ul>