D64 OpenAIRE Maintenance Report » History » Version 5
Claudio Atzori, 12/12/2016 04:58 PM
1 | 1 | Marek Horst | h1. D6.4 OpenAIRE Maintenance Report (v1, 9th of December 2016) |
---|---|---|---|
2 | |||
3 | {{toc}} |
||
4 | |||
5 | h2. Overview |
||
6 | |||
7 | This document contains information about the deployment, status of OpenAIRE2020 services and content, and the history of major modifications of the system hosted at ICM, Poland. |
||
8 | |||
9 | The official maintenance of the OpenAIRE2020 services began on January 1st, 2015 when the project started. |
||
10 | |||
11 | h2. Deployment |
||
12 | |||
13 | Because OpenAIRE2020 services are a continuation and incremental extension of the services already present that resulted from OpenAIRE+ project, so they are still hosted on that same machines. More details are available at "OpenAIRE+ WP5 Maintenance Report":http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/WP5%20Maintenance%20Report. |
||
14 | |||
15 | _@Paweł: are there any new services in maintenance since OpenAIRE+ project worth mentioning here?_ |
||
16 | |||
17 | h2. Documentation |
||
18 | |||
19 | DNet deployment is performed following the documentation described at: http://ivy.driver.research-infrastructures.eu/ci/dnet-openaire-doc/ |
||
20 | |||
21 | _@Claudio: is it up to date?_ |
||
22 | |||
23 | 3 | Marek Horst | Zenodo repository is deployed according to the process described at http://invenio-software.org/wiki/Project/OpenAIREplus/ReleaseProcess. |
24 | 1 | Marek Horst | |
25 | _@Lars: link does not work anymore, can you provide the proper one?_ |
||
26 | |||
27 | 4 | Marek Horst | "Information Inference Service":https://github.com/openaire/iis versioning and deployment is described on "IIS versioning and deployment":https://issue.openaire.research-infrastructures.eu/projects/openaire/wiki/IIS_versioning_and_deployment wiki page. |
28 | 1 | Marek Horst | |
29 | 5 | Claudio Atzori | h2. [[D-NET workflows]] |
30 | 3 | Marek Horst | |
31 | _@Claudio: could you fill that in?_ |
||
32 | |||
33 | 1 | Marek Horst | h2. Services status |
34 | |||
35 | h3. D-NET backend services |
||
36 | |||
37 | _@Claudio: could you fill that in? Probably you can rely on http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/WP5%20Maintenance%20Report_ |
||
38 | |||
39 | h3. Portal |
||
40 | |||
41 | _@Paweł: could you fill that in? You can do it in a similar way it was done in http://wiki.openaire.eu/xwiki/bin/view/Technical%20Specifications/Maintenance%20Report_ |
||
42 | |||
43 | 3 | Marek Horst | h3. Zenodo |
44 | 1 | Marek Horst | |
45 | 3 | Marek Horst | Zenodo repository employs an instance of the Invenio software, developed by CERN. |
46 | 2 | Marek Horst | |
47 | 1 | Marek Horst | _@Lars: could you fill that in? You can do it in a similar way it was done in http://wiki.openaire.eu/xwiki/bin/view/Technical%20Specifications/Maintenance%20Report_ |
48 | |||
49 | h3. DM hadoop cluster |
||
50 | |||
51 | CDH version: @cdh4.3.1@ |
||
52 | |||
53 | h3. IIS hadoop cluster |
||
54 | |||
55 | CDH version: @cdh4.3.1@, replaced with @cdh5.5.2@ on November 20, 2016, to be replaced with @cdh5.9.0@ |
||
56 | |||
57 | h3. Content status |
||
58 | |||
59 | |*data type*|*count*| |
||
60 | |publications|17460368| |
||
61 | |datasets|3226586| |
||
62 | |projects|653268| |
||
63 | |organizations|64591| |
||
64 | |authors|16188328| |
||
65 | |EuropePMC XML contents|1574358| |
||
66 | |PDF contents|2227458| |
||
67 | |||
68 | Based on IIS report generated on November 20, 2016. |
||
69 | |||
70 | h3. Change Log for servers administration operations |
||
71 | |||
72 | _@Paweł: could you fill that in? This could be similar to: http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/Change%20Log%20for%20servers%20administration%20operations_ |
||
73 | |||
74 | h2. Major modifications |
||
75 | |||
76 | h3. Introducing CDH5 IIS cluster hosted in OCEAN infrastructure |
||
77 | |||
78 | Slave node specification: |
||
79 | * Huawei RH1288 V3 |
||
80 | * CPU: 2x Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz (24 cores, 48 threads) |
||
81 | * RAM: 128GB |
||
82 | * HDD: 4x SATA 6TB 7.2K RPM (HDFS) |
||
83 | |||
84 | Cluster summary (16 slaves): |
||
85 | * CPU: 384 cores, 768 threads |
||
86 | * RAM: 2048GB |
||
87 | * HDD: 384TB (HDFS) |
||
88 | |||
89 | YARN available resources: |
||
90 | * vcores: 640 |
||
91 | * memory: 1.44TB |
||
92 | * HDFS: 344TB |
||
93 | |||
94 | h3. Incorporating resources from old CDH4 IIS cluster into existing DM CDH4 cluster |
||
95 | |||
96 | _@Paweł: are you aware of any other major modifications regarding other services such as new portal version etc?_ |
||
97 | |||
98 | h2. System downtimes |
||
99 | |||
100 | _@Paweł: could you fill that in? We could create dedicated with entry similar to: |
||
101 | http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/History%20of%20system%20outages |
||
102 | and link it here._ |