DataONE Tasks: Issueshttps://redmine.dataone.org/https://redmine.dataone.org/favicon.ico2019-08-12T19:16:39ZDataONE Tasks
Redmine Member Nodes - Story #8835 (New): Add ability for scanner to stop after a certain number of errorshttps://redmine.dataone.org/issues/88352019-08-12T19:16:39ZJohn Evans
<p>Right now the scanner will try to go thru the entire list of sitemap documents, regardless of whether they all fail or not. We should add the ability to abort further checks if a certain error threshold is crossed.</p>
Infrastructure - Bug #8822 (New): Account queries in STAGE-2 failing from web browserhttps://redmine.dataone.org/issues/88222019-06-19T01:44:19ZBryce Mecummecum@nceas.ucsb.edu
<p>Steps to reproduce:</p>
<ol>
<li>Visit <a href="https://search-stage-2.test.dataone.org/">https://search-stage-2.test.dataone.org/</a></li>
<li>Log in</li>
<li>Navigate to <a href="https://search-stage-2.test.dataone.org/data">https://search-stage-2.test.dataone.org/data</a></li>
<li>Observe an HTTP 500 in the Network pane of whichever browser you're using to <a href="https://search-stage-2.test.dataone.org/cn/v2/accounts/?query=%7BYOUR_DN%7D">https://search-stage-2.test.dataone.org/cn/v2/accounts/?query={YOUR_DN}</a></li>
</ol>
<p>Response body:</p>
<pre><?xml version="1.0" encoding="UTF-8"?>
<error detailCode="500" errorCode="500" name="ServiceFailure">
<description>Internal Server Error: The server encountered an unexpected condition which prevented it from fulfilling the request.</description>
</error>
</pre>
<p>Some notes:</p>
<ul>
<li>I notice this in multiple browsers</li>
<li>I notice this only when the request is issued from MetacatUI, not when I visit the URL in my browser or hit it with curl</li>
<li>I don't notice this error on search.dataone.org</li>
<li>MetacatUI on search.dataone.org doesn't even issue this request</li>
<li>MetacatUI on stage-2 is at v2.4.2 and on search is at 2.6.1</li>
</ul>
<p>It seems like a bug to me that we see a service failure but I'm not sure if this is a MetacatUI bug or an issue in the CN stack (i.e., Apache config or something) but I wanted to file it for someone to take a look.</p>
Member Nodes - MNDeployment #8254 (Planning): ABDS - Arctic Biodiversity Data Service (CAFF)https://redmine.dataone.org/issues/82542018-01-26T19:23:54ZAmy Forresteraforres4@utk.edu
<p>Conservation of Arctic Flora and Fauna (CAFF - <a href="http://www.caff.is" class="external">www.caff.is</a>) is the biodiversity working group of the <a href="https://www.arctic-council.org/en/about-us" class="external">Arctic Council</a>. CAFF has a focus on data management and its Arctic Biodiversity Data Service (ABDS - <a href="http://www.abds.is" class="external">www.abds.is</a>) serves as the Arctic node in GBIF, OBIS, is the ARctic Biodiversity Observation Network in GEOBON etc </p>
Infrastructure - Task #8236 (New): Acquire ORCID API key under KU membershiphttps://redmine.dataone.org/issues/82362018-01-09T02:02:31ZDave Vieglaisdave.vieglais@gmail.comDUG - Task #7800 (New): abstract reviews (https://docs.google.com/document/d/1iZXCN4AWqYi5Z7wqMKb...https://redmine.dataone.org/issues/78002016-05-10T15:18:24ZDave Vieglaisdave.vieglais@gmail.comLog Reporting - Task #7702 (New): abnormal strings in ipAddress field of solrhttps://redmine.dataone.org/issues/77022016-03-30T14:28:43ZRobert Waltz
<p>Several Membernodes have abnormal strings as Ip Addresses. These strings can be found on the MN when querying for their log entries. They are harvested and set in LogAggregation.</p>
<p>on cn-orc-1 I ran these commands:</p>
<p>curl --cert /etc/dataone/client/private/urn_node_CNORC1.pem "<a href="https://cn-orc-1.dataone.org/cn/v2/query/logsolr/?q=-ipAddress:/%5B0-9%5D%7B1,3%7D%5C.%5B0-9%5D%7B1,3%7D%5C.%5B0-9%5D%7B1,3%7D%5C.%5B0-9%5D%7B1,3%7D/&wt=xml&facet=true&facet.field=nodeId">https://cn-orc-1.dataone.org/cn/v2/query/logsolr/?q=-ipAddress:/%5B0-9%5D%7B1,3%7D\.%5B0-9%5D%7B1,3%7D\.%5B0-9%5D%7B1,3%7D\.%5B0-9%5D%7B1,3%7D/&wt=xml&facet=true&facet.field=nodeId</a>"</p>
<p>curl --cert /etc/dataone/client/private/urn_node_CNORC1.pem "<a href="https://cn-orc-1.dataone.org/cn/v2/query/logsolr/?q=-ipAddress:/%5B0-9%5D%7B1,3%7D%5C.%5B0-9%5D%7B1,3%7D%5C.%5B0-9%5D%7B1,3%7D%5C.%5B0-9%5D%7B1,3%7D/+AND+nodeId:*LTER&wt=xml&facet=true&facet.field=nodeId">https://cn-orc-1.dataone.org/cn/v2/query/logsolr/?q=-ipAddress:/%5B0-9%5D%7B1,3%7D\.%5B0-9%5D%7B1,3%7D\.%5B0-9%5D%7B1,3%7D\.%5B0-9%5D%7B1,3%7D/+AND+nodeId:*LTER&wt=xml&facet=true&facet.field=nodeId</a>"</p>
<p>etc.</p>
<p>and then I queried for the rows without facets turned on to retrieve the ipaddresses.</p>
<p>urn:node:LTER 27542 rows with 'systemMetadataChanged()'</p>
<p>urn:node:US_MPC 1065 rows with '[replica]'</p>
<p>urn:node:NMEPSCOR 671 rows with '[replica]', 'systemMetadataChanged()'</p>
<p>urn:node:NKN 410 rows with '[replica]', 'systemMetadataChanged()'</p>
<p>urn:node:IARC rows with 241 '[replica]'</p>
<p>urn:node:TFRI 4 rows with '2001:b020:0:71::2cf', '2601:281:8200:e555:19a3:7a0f:d0c5:a25', '2001:4898:80e0:ee43::3', '2001:4898:80e0:ee43::3'</p>
<p>urn:node:KNB 3 rows with 'null', 'coinformatics.'</p>
<p>urn:node:DRYAD 1 row with '160.74.1.163, 211.13.205.134'</p>
<p>urn:node:mnUNM1 1 row with '2.0.0beta6.dt'</p>
<p>Decide if the IpAddress field in solr should be updated to something like 'null' </p>
<p>Decide if LogAggregation should validate fields for correct formatting</p>
<p>Create Tickets for GMN and Metacat to look into the issues.</p>
MN Dashboard - Feature #7032 (New): Add anchor to the MN dashboard for "upcoming MNs"https://redmine.dataone.org/issues/70322015-04-09T17:52:45ZLaura Moyerslmoyers1@utk.edu
<p>To allow users to go directly to the "upcoming member nodes" section of the dashboard page, especially as the list of current MNs grows longer, please add an anchor at "upcoming", maybe "#upcomingMN".</p>
Infrastructure - Task #3978 (In Progress): Add a CN reporting script that summarizes spatial data...https://redmine.dataone.org/issues/39782013-09-13T16:12:08ZChris Jonescjones@nceas.ucsb.edu
<p>Spatial data in the CN Solr search index includes per-object bounding box data. For client side mapping purposes, these data are too numerous to add to a vector map. Create a spatial summarization script that reduces the total points to summarized counts at a given cell resolution. Allow for the resolution to be configurable. Export the result as a JSON object, compatible with mapping libraries like heatmapjs and D3js.</p>
Infrastructure - Task #3881 (New): 4.2.1.4 Definition of Verified User Lackinghttps://redmine.dataone.org/issues/38812013-08-02T17:05:47ZDave Vieglaisdave.vieglais@gmail.com
<p>The term “verified user” is found in the documentation but there is no definition of what this term really means. There does not seem to be an explanation of how one really becomes verified and who performs the verification.</p>
Infrastructure - Task #3880 (New): 4.2.1.3 CILogon Extension Not Documentedhttps://redmine.dataone.org/issues/38802013-08-02T17:04:27ZDave Vieglaisdave.vieglais@gmail.com
<p>One of the key interfaces in the system is the XML that is added to the CILogon<br>
certificate. This XML expresses the identities and privileges of the users and is intended to be consumed by CNs and MNs. The reviewers did not find a schema or definition for this structure in the current documentation. Currently, DataONE has written all the software that parses this extension, but if an MN needs to write software that does so, they will need documentation on its syntax and semantics.</p>
Infrastructure - Task #3879 (New): 4.2.1.2 Missing Policies and Expectationshttps://redmine.dataone.org/issues/38792013-08-02T16:33:03ZDave Vieglaisdave.vieglais@gmail.com
<p>The relationship between the Coordinating Nodes, Member Nodes and the DataONE user community involves trust and expectations that is presently implied. The following policies stand out as absent:</p>
<ul>
<li>An acceptable use policy (AUP) that DataONE users agree to abide by.</li>
<li>A privacy policy which states how DataONE will and will not collect, use and share data regarding its users.</li>
<li>A set of expectations stating how CNs and MNs behave with regard to IdM.</li>
</ul>
Infrastructure - Task #3878 (New): 4.2.1.1 Missing and Out-of-Date Documentationhttps://redmine.dataone.org/issues/38782013-08-02T16:29:36ZDave Vieglaisdave.vieglais@gmail.com
<p>Overall, DataONE’s IdM documentation is well done and in good order. However, during the review, it was noted that there were some issues with the documentation. There are several documentation areas marked with “TODO”. Also, some of the documentation no longer reflects the current functioning or design of the system.</p>
Infrastructure - Task #3768 (New): Add canonical DataONE description paper to citing DataONE web-...https://redmine.dataone.org/issues/37682013-05-16T22:20:56ZJohn Cobbjohnw.cobb+dataoneRM@gmail.com
<p>The page <a href="http://www.dataone.org/citing-dataone">http://www.dataone.org/citing-dataone</a> includes guidance for citations. There are two missing needs on this page (or perhaps they should be another page. </p>
<p>One: A citation need is to answer members of the DataONE community who want to acknowledge DataONE as a project and cyberinfrastructure. DataONE needs to provide a canonical preferred citation. I think this may be <a href="http://dx.doi.org/10.1016/j.ecoinf.2011.08.007">http://dx.doi.org/10.1016/j.ecoinf.2011.08.007</a>, ( can be found at <a href="http://www.sciencedirect.com/science/article/pii/S1574954111000768">http://www.sciencedirect.com/science/article/pii/S1574954111000768</a>)</p>
<p>Two: DataONE needs an acknowledgement block. Perhaps this exists but I am just not aware, What I am thinking of is something similar to<br>
<a href="https://www.olcf.ornl.gov/media-center/media-kit/">https://www.olcf.ornl.gov/media-center/media-kit/</a><br>
<a href="https://www.xsede.org/how-to-acknowledge-xsede">https://www.xsede.org/how-to-acknowledge-xsede</a></p>
Infrastructure - Task #2344 (New): Add category for Ben's style sheets in Redminehttps://redmine.dataone.org/issues/23442012-02-15T17:45:54ZRoger Dahldahl@unm.edu
<p>Check with Ben what the new product will be / has been called.</p>
Infrastructure - Task #1646 (New): Add addFormat() to the CNCore APIhttps://redmine.dataone.org/issues/16462011-06-15T21:43:55ZChris Jonescjones@nceas.ucsb.edu
<p>Once the object format policy has been established, modify CNCore to include addFormat(). This should require a Session object, an ObjectFormatIdentifier, and an ObjectFormat as arguments.</p>