https://redmine.dataone.org/https://redmine.dataone.org/favicon.ico2014-10-10T19:19:15ZDataONE TasksInfrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=225842014-10-10T19:19:15ZJing Taotao@nceas.ucsb.edu
<ul></ul><p>An email from Matt:</p>
<p>There are 4 production hosts in this list and 1 development machine that need to be handled separately from the others: </p>
<p>knbvm.nceas.ucsb.edu<br>
mn-ucsb-1.dataone.org<br>
mn-ucsb-2.dataone.org<br>
mn-ucsb-3.dataone.org<br>
dev.nceas.ucsb.edu</p>
<p>For all of the other dataone development machines in your list:<br>
1) Jing will do a backup on each host before you do the upgrade<br>
a) ensure that we don't lose our client certificates<br>
2) do an in-place, offline upgrade so we don't lose our existing services as configured, downtime is ok, but should be announced to the dataone developers so they know when each host is being upgraded. Jing can confirm that all services are working after the upgrade, and if not, get them fixed. Best to try this on one host first, and if it all works well, then proceed with the others.</p>
<p>For the KNB and dev.nceas.ucsb.edu:<br>
1) Minimize downtime to less than 15 minutes by:<br>
a) setting up duplicate VMs with postgres replication and rsync, where the new VMs have upgraded OS's<br>
b) prepare a script that turns off Tomcat on the live machine, then confirms a final postgres/file sync, then switches to the new host as the live VM</p>
<p>Jing will be developing a plan for this, and we plan to first do it on dev.nceas.ucsb.edu, and once that works well, then on the KNB. So both of these will need new virtual machines configured. I'll call you to talk about where those should go.</p>
<p>For the other production machines, longer downtime is less of an issue, so please just coordinate with Jing to upgrade these like we are the dev machines:<br>
1) backup, including keys<br>
2) shutdown tomcat and in-place upgrade</p>
Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=225872014-10-10T19:19:39ZJing Taotao@nceas.ucsb.edu
<ul><li><strong>Target version</strong> set to <i>Maintenance Backlog</i></li></ul> Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=234092015-01-13T15:58:11ZDave Vieglaisdave.vieglais@gmail.com
<ul><li><strong>Target version</strong> changed from <i>Maintenance Backlog</i> to <i>CCI-1.5.1</i></li></ul> Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=244652015-01-31T05:41:42ZJing Taotao@nceas.ucsb.edu
<ul></ul><p>The knbvm.nceas.ucsb.edu is done.</p>
Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=246502015-02-12T21:31:16ZJing Taotao@nceas.ucsb.edu
<ul></ul><p>The mn-ucsb-2.dataone.org (hosting ESA and GOA) has been done. </p>
<p>It took much longer than i anticipated. The reason is that Tomcat couldn't be up after the upgrading. It turned out the service of registering schema was stuck. In the xml_catalog table, there some records like:<br>
12 | Schema | | | eml://ecoinformatics.org/eml-2.0.1 | <a href="http://data.esa.org:80/esa/schema/eml-2.0.1/eml.xsd">http://data.esa.org:80/esa/schema/eml-2.0.1/eml.xsd</a><br>
Metacat tried to download the schema from data.esa.org/esa/schema/eml-2.0.1/eml.xsd. However the tomcat was not up so the url was not accessible. The service stopped there in a dead loop.</p>
<p>After i changed the system_id to /schema/eml-2.0.1/eml.xsd to indicate is a local file, it works.</p>
Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=246712015-02-21T00:56:52ZJing Taotao@nceas.ucsb.edu
<ul></ul><p>The mn-ucsb-1.dataone.org was done.</p>
Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=247522015-03-10T19:05:46ZRob Nahfrnahf@epscor.unm.edu
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li><li><strong>% Done</strong> changed from <i>0</i> to <i>30</i></li></ul> Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=247592015-03-10T19:34:37ZJing Taotao@nceas.ucsb.edu
<ul></ul><p>Only knb is left.</p>
Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=248092015-03-24T18:36:46ZJing Taotao@nceas.ucsb.edu
<ul></ul><p>KNB was done.</p>
<p>Please see: <a href="https://epad.dataone.org/pad/p/KNB_upgrade_2015">https://epad.dataone.org/pad/p/KNB_upgrade_2015</a></p>
Infrastructure - Task #6530: Upgrade the OS of the production member nodes operated by UCSBhttps://redmine.dataone.org/issues/6530?journal_id=248102015-03-24T18:37:00ZJing Taotao@nceas.ucsb.edu
<ul><li><strong>translation missing: en.field_remaining_hours</strong> set to <i>0.0</i></li><li><strong>% Done</strong> changed from <i>30</i> to <i>100</i></li><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Closed</i></li></ul>