|
|
VAPOR is an EGI service provided by CCIN2P3, designed and developped by I3S and IN2P3. It is depending from CNRS and licensed under the Apache License. ![logo-vapor-black](/uploads/472ac0c05cfdf608f22c32f542aa77af/logo-vapor-black.png) |
|
|
\ No newline at end of file |
|
|
VAPOR is an EGI service provided by CCIN2P3, designed and developped by I3S and IN2P3. It is depending from CNRS and licensed under the Apache License. ![logo-vapor-black](/uploads/472ac0c05cfdf608f22c32f542aa77af/logo-vapor-black.png)
|
|
|
|
|
|
<br/>
|
|
|
VAPOR complies with the GLUE 2 schema specification. Information is aggregated from several top BDII objects and from the GOCDB.
|
|
|
|
|
|
The application is divided in 3 main parts :
|
|
|
|
|
|
* Resources (Overview & Explorer)
|
|
|
* Job Monitoring
|
|
|
* Data Management
|
|
|
|
|
|
![vapor-schema](/uploads/19d0cf7487e1d4a31eb4bde8674444d7/vapor-schema.jpg)
|
|
|
|
|
|
<br/>
|
|
|
**<h2>Resources Overview</h2>**
|
|
|
|
|
|
Overview Resources Pages provides several tools to see Glue2 information :
|
|
|
|
|
|
Map
|
|
|
Table
|
|
|
Distribution
|
|
|
Figures
|
|
|
Bdii browser
|
|
|
|
|
|
Currents permalinks with filters availables :
|
|
|
|
|
|
Resources by Operations Center/Sites with NGIfiler and Sitefilter (optional) :
|
|
|
add "?NGIfilter=" with the name of the NGI and (optional) "&Sitefilter=" with the name of the site
|
|
|
ex : http://operations-portal.egi.eu/vapor/resources/GL2ResNGISites?NGIfilter=NGI_France&Sitefilter=IN2P3-CC
|
|
|
Resources by VO with VOfilter :
|
|
|
add "?VOfilter=" with the name of the VO
|
|
|
ex : http://operations-portal.egi.eu/vapor/resources/GL2ResVO?VOfilter=biomed
|
|
|
Resources Table : add "?NGIfilter=" with the name of the NGI or "?VOfilter=" with the name of the VO
|
|
|
ex : http://operations-portal.egi.eu/vapor/resources/GL2Browser?VOfilter=biomed
|
|
|
ex : http://operations-portal.egi.eu/vapor/resources/GL2Browser?NGIfilter=NGI_FRANCE
|
|
|
|
|
|
**<h2>Resources Explorer</h2>**
|
|
|
|
|
|
Resources Explorer Pages provides detailed information about resources that support a site or a VO :
|
|
|
|
|
|
Computing Elements
|
|
|
Storage Elements
|
|
|
Faulty resources
|
|
|
Cloud resources
|
|
|
|
|
|
**<h2>Data Management</h2>**
|
|
|
|
|
|
SE Scan operations and reports :
|
|
|
identify heavily loaded Storage Elements
|
|
|
identify heavily users on those SE
|
|
|
Dark data and lost files history :
|
|
|
Track dark data, i.e. files stored on SEs but no longer registered in the file catalog. Optionally, the dark data files can be automatically deleted from the SE.
|
|
|
Track lost files, i.e. files registered in the file catalog but with no more physical replicate.
|
|
|
|
|
|
**<h2>Job Monitoring</h2>**
|
|
|
|
|
|
Job Monitoring Pages provides detailed information about :
|
|
|
|
|
|
Monitoring jobs (by Tab and Graph)
|
|
|
retrieve results of the monitoring jobs submitted by VAPOR to each CREAM CE queue 4 time(s) a day, during the period selected.
|
|
|
Running and Waiting Job Ratio
|
|
|
Reports the evolution of the number of running jobs (R) and waiting jobs (W), over the selected period of time, for the VO
|
|
|
List of CEs « working fine » at the moment
|
|
|
|
|
|
<br/><br/>
|
|
|
<hr/>
|
|
|
<br/><br/>
|
|
|
|
|
|
**<h2>Information extracted from BDII - GLUE2</h2>**
|
|
|
Ldap queries with different filters :
|
|
|
|
|
|
objectClass=GLUE2StorageShareCapacity<br/>
|
|
|
objectClass=GLUE2ComputingShare<br/>
|
|
|
ObjectClass=GLUE2StorageServiceCapacity<br/>
|
|
|
ObjectClass=GLUE2Location<br/>
|
|
|
[...]
|
|
|
|
|
|
Then results are stored in Lavoisier and aggregated per NGI, site, Countries, endpoints …<br/>
|
|
|
We remove inconsistencies and incoherencies<br/>
|
|
|
We add also corrections to bad publications (values published in the bad class, values published twice)
|
|
|
|
|
|
|
|
|
<br/><br/>
|
|
|
<hr/>
|
|
|
<br/><br/>
|
|
|
|
|
|
**<h2>Credits</h2>**
|
|
|
**Main developers**
|
|
|
|
|
|
* Cyril L'Orphelin
|
|
|
* Pierre Frébault
|
|
|
* Laure-Beya Souai
|
|
|
* Franck Michel
|
|
|
* Flavien Forestier
|
|
|
|
|
|
**Information and data sources**
|
|
|
|
|
|
* GOC Database
|
|
|
* JobMonitor application
|
|
|
* Bdii - GLUE2
|
|
|
* Lavoisier
|
|
|
* Dedicated scripts
|
|
|
|
|
|
**Partners**
|
|
|
|
|
|
* EGI-Engage
|
|
|
* IN2P3
|
|
|
* CNRS
|
|
|
* I3S |