Journal:A multi-service data management platform for scientific oceanographic products

From LIMSWiki
Revision as of 22:43, 25 April 2017 by Shawndouglas (talk | contribs) (Saving and adding more.)
Jump to navigationJump to search
Full article title A multi-service data management platform for scientific oceanographic products
Journal Natural Hazards and Earth System Sciences
Author(s) D'Anca, Alessandro; Conte, Laura; Nassisi, Paola; Palazzo, Cosimo; Lecci, Rita; Cretì, Sergio; Mancini, Marco;
Nuzzo, Alessandra; Mirto, Maria; Mannarini, Gianandrea; Coppini, Giovanni; Fiore, Sandro; Aloisio, Giovanni
Author affiliation(s) Centro Euro-Mediterraneo sui Cambiamenti Climatici (CMCC), University of Salento
Primary contact Email: alessandro dot danca at cmcc dot it
Year published 2017
Volume and issue 17(2)
Page(s) 171-184
DOI 10.5194/nhess-17-171-2017
ISSN 1684-9981
Distribution license Creative Commons Attribution 3.0
Website http://www.nat-hazards-earth-syst-sci.net/17/171/2017/nhess-17-171-2017.html
Download http://www.nat-hazards-earth-syst-sci.net/17/171/2017/nhess-17-171-2017.pdf (PDF)

Abstract

An efficient, secure and interoperable data platform solution has been developed in the TESSA project to provide fast navigation and access to the data stored in the data archive, as well as a standard-based metadata management support. The platform mainly targets scientific users and the situational sea awareness high-level services such as the decision support systems (DSS). These datasets are accessible through the following three main components: the Data Access Service (DAS), the Metadata Service and the Complex Data Analysis Module (CDAM). The DAS allows access to data stored in the archive by providing interfaces for different protocols and services for downloading, variable selection, data subsetting or map generation. Metadata Service is the heart of the information system of TESSA products and completes the overall infrastructure for data and metadata management. This component enables data search and discovery and addresses interoperability by exploiting widely adopted standards for geospatial data. Finally, the CDAM represents the back end of the TESSA DSS by performing on-demand complex data analysis tasks.

Introduction

TESSA (Development of TEchnology for Situational Sea Awareness) is a research project born from the collaboration between operational oceanography research and scientific computing groups in order to strengthen operational oceanography capabilities in Southern Italy for use by end users in the maritime, tourism and environmental protection sectors. This project has been very innovative as it has provided the integration of marine and ocean forecasts and analyses with advanced technological platforms. Specifically, an efficient, secure and interoperable data platform solution has been developed to provide fast navigation and access to the data stored in the data archive, as well as standard-based metadata management support.

This platform mainly targets scientific users and contains a set of high-level services such as the decision support systems (DSS) for supporting end users in managing emergency situations due to natural hazards in the Mediterranean Sea. For example, the DSS WITOIL[1][2] is crucial for oil spill accidents which could have severe impacts on the Mediterranean Basin and contribute effectively to the reduction of natural disaster risks. Moreover, the DSS Ocean-SAR[3] supports the search-and-rescue (SAR) operations following accidents, and EarlyWarning manages alerts in cases of extreme events by providing near-real-time information on weather and oceanographic conditions. Finally, VISIR[4][5] is able to compute the optimal ship route with the aim of increasing safety and efficiency of navigation. It relies on various forecast environmental fields which affect the vessel's stability in order to ensure that the computed route does not result in an exposure to dynamical hazards. In this context, the developed platform faces the lack of an efficient dissemination of marine environmental data in order to support situational sea awareness (SSA), which is strategically important for maritime safety and security.[6] In fact, an updated situation awareness requires an advanced technological system to make data available for decision makers, improving the capacity of intervention and avoiding potential damages.

In a "data-centric" perspective — in which different services, applications or users make use of the outputs of regional or global numerical models — the TESSA data platform meets the request of near-real-time access to heterogeneous data with different accuracy, resolution or degrees of aggregation. The design phase has been driven by multiple needs that the developed solution had to satisfy. First of all, nowadays each data management system should satisfy the FAIR guiding principles for scientific data management and stewardship[7]: they face the lack of a shared, comprehensive, broadly applicable and articulated guideline concerning the publication of scientific data. Specifically, they identify findability, accessibility, interoperability and reusability as the four principles which need to be addressed by data (and associated metadata) to be considered a good publication. As explained later, the employment of well-known standards concerning protocols, services and output formats satisfies these requirements. In addition, the need for a service that provides information about sea conditions 24/7 at high and very high spatial and temporal resolution has been addressed by exploiting high-performance and high-availability hardware and software solutions. The developed platform must be able to support the requests of intermediate and common users. To this end, data must be available in the native and standard format (NetCDF)[8][9] as output of the oceanographic models, through a simple and intuitive platform suitable for machine-based interactions, in order to feed user-friendly services for displaying clear maps and graphs. At the end, the system has to provide on-demand services to support decisions; the users must be able to interact with the datasets produced by the models in near-real time. As such, the platform has to provide services and datasets suitable for on-demand processing while minimizing the downloading time and the related input file size.

This paper is organized as follows: The next section presents a survey on related work, and in the following section "The data platform architecture" an architectural overview of the main data platform components is provided. The focus is on providing easier and unified access to the heterogeneous data produced in the framework of the TESSA project. The implemented data archive and the modules that make the datasets available to the entire set of services are presented in "The Data Access Service." In "The Metadata Service and the metadata profile," the Metadata Service features are detailed from a methodological and technical point-of-view. The module developed in order to serve remote DSS submission requests is described in "The Complex Data Analysis Module." Finally in the final section on operational activity, a few use cases are presented, highlighting the operational chains which exploit the data platform services.

Related work

The need for marine and oceanic data management supporting the SSA and the operational oceanography has led to the definition and development of various platforms that provide different types of data and services. In this context, the MyOcean project[10][11] can be mentioned, as this project implementation was in line with the best practices of the GMES/Copernicus framework.[12]

Specifically, regarding data access, MyOcean provides the scientific community with a unified interface designed to take into account various international standards (ISO 19115[13], ISO 19139[14] and INSPIRE[15][16]). Concerning data management, MyOcean relies on OPeNDAP/THREDDS for tasks like map subsetting and FTP for direct download. In addition, a valid solution is represented by the Earth System Grid Federation (ESGF)[17][18], a federated system used as metadata service with advanced features, that will be described later. EMODNET MEDSEA Checkpoint[19][20] is another solution supporting data collection and data search and discovery: it exploits a checkpoint browser and a checkpoint dashboard, which presents indicators automatically produced from information databases. SeaDataNet[21] represents a distributed marine data management infrastructure able to manage different large datasets related to in situ and remote observation of the seas and oceans. Through a distributed network approach, it provides an integrated overview and access to datasets provided by 90 national oceanographic and marine data centers. Finally, another efficient solution has been developed within the project CLIPC.[22] It provides access to climate information, including data from satellite and in situ observations, transformed data products and climate change impact indicators. Moreover, users can exploit the CLIPC toolbox to generate, compare, manipulate and combine indicators, create a user basket or launch new jobs for indices calculation.

These systems support a wide range of functionalities such as data access, classification, search and discovery and downloading by means of a distributed architecture. Graphs and maps production are also supported, and some of these propose tools to manipulate and combine datasets. The proposed architecture of the TESSA data platform should offer superior and fast data management functionalities, producing datasets suitable for serving different kinds of services in near-real time; access, search and discovery are just some of the features offered. The developed system, in fact, provides a common interface for submitting complex algorithms in a high-performance computing environment using standard approaches and formats exploiting a unified infrastructure for supporting different scenarios and applications.

The data platform architecture

As seen in Fig. 1, the TESSA data platform is composed of three main components: the Data Access Service (DAS), the Metadata Service and the Complex Data Analysis Module (CDAM).


Fig1 D'Anca NatHazEarth2017 17-2.png

Figure 1. The TESSA data platform

The DAS allows the access to the data archive, the storage of the data produced in the framework of the TESSA project. The main consumers of these services are the “intermediate users” (the scientific community) and the automatic procedures fed by produced datasets to perform the needed transformations. In this context, the DAS represents the single interface to access the data archive of TESSA; its design has been driven by the aim to satisfy requirements such as transparency, robustness, efficiency, fault tolerance, security, data delivery, subsetting and browsing. This implies that this component must necessarily be "data-centric" and "multi-service" in order to offer access to the data, often stored in a single instance on the data archive, through different protocols and, therefore, different levels of functionality.

In addition, the need of interoperability with other data management platforms has driven the design toward the inclusion of well-known services:

– "domain-oriented," able to provide specific functionalities for the climate change domain; and
– "general purpose," to satisfy general requirements exploiting common services and protocols.

The Metadata Service has been designed as the heart of the information system of the TESSA products, to support the activities of search and discovery and metadata management. Moreover, the Metadata Service addresses the requirements of interoperability, considered a key feature in order to provide to any potential user easier and unified access to the different types of data produced by the project. These requirements have been satisfied through the adoption of a metadata profile compliant to the ISO standards for geospatial data[23] and the implementation of an efficient information system relying on a specific ESGF data node

Finally, the CDAM supports the SSA high-level services by performing on-demand complex analysis on the datasets stored in the data archive. In particular, a number of intelligent decisions support systems for complex dynamical environments have been designed and developed, exploiting high-performance computing functionalities to execute their algorithms. One of the goals is to deploy an infrastructure where a DSS requires the execution of a complex task including (i) accessing data stored in the archive, (ii) executing one or more preliminary tasks for processing them and (iii) storing the results in a specific section of the data archive or publishing them on other sites. Each DSS request interacts with the platform involving a three-layer infrastructure: the user client (web or mobile platform), the SSA platform[24] and the CDAM. Each layer communicates with their linked tiers exchanging messages using well-known protocols, and it has been developed in order to implement a high separation of concerns.

The design and the main features of these modules will be detailed in the following sections.

The Data Access Service

As stated in the previous section, the DAS represents the single interface to access the data archive of TESSA; specifically, it has been designed with the aim to set up a multi-service platform to access and analyze scientific data. Among the exposed services, it is important to mention the THREDDS Data Server (TDS)[25], which represents a web server that provides metadata and data access for scientific datasets, using a variety of remote data access protocols. More in detail, it offers a set of services that allows users direct access to data produced in the context of the TESSA project, namely the output of the AFS (Adriatic Forecasting System)[26][27][28], AIFS[29][30] and SANIFS[31] sub-regional models. In particular, the THREDDS includes the WMS (Web Map Service)[32] for the dynamic generation of maps created from geographically referenced data and directly downloaded using the HTTP protocol. Furthermore, it includes the OPeNDAP[33] service, which is a framework that aims to simplify the sharing of scientific information on the web by making available local data from remote connections, providing also variable selection and spatial and temporal subsetting capabilities. To improve performance in terms of load balancing and increase the fault tolerance of the system, a multiplexed configuration for the THREDDS installation based on two different hosts has been used. In addition, a sub-component, the Data Transformation Service (DTS), represents a middleware responsible for applying different data transformations in order to make data compliant to the different protocols offered by the DAS and therefore available to the data consumers (users or services) in a transparent way.

The dataset repository: The TESSA data archive

The data archive represents the storage for all the data produced within the TESSA project. It has been designed and implemented in order to ease the data search-and-discovery phase exploiting their classification while, from an infrastructure point of view, data are stored on a GPFS[34] file system (in RAID 6 configuration), able to provide fast data access and a high level of fault tolerance. Figure 2 shows a high-level schema of the archive.


Fig2 D'Anca NatHazEarth2017 17-2.png

Figure 2. High-level representation of the data archive

The data can be subdivided into two categories:

– historical data, which are permanently stored into the archive, including observations and model reanalysis and best analysis; and
– rolling data, which are subjected to a rolling procedure, including model worst analysis, simulations and forecasts.

Considering the different kinds of data, the data archive has been created following a tree-based topology where the directory names reflect the data classification (historical as first level, model or observation as second level, atmospheric or oceanographic as third level, etc.). The directory tree includes also the institute providing the data, the name of the system that produced the data and the temporal resolution of the data. This kind of classification eases and speeds up the search and discovery of data by intermediate/scientific users and automatic procedures. Concerning the "historical" archive, data stored under "obs" include observations retrieved by different instruments (satellites, in situ buoys, vessels, etc.) and consider measurements of the main oceanographic variables (temperature, altimetry, salinity, chlorophyll concentration, etc.). The spatial and the temporal resolution and the temporal coverage are different depending on the data type.

Data stored under the "model" directory include the best data produced by the numerical models (atmospheric or oceanic) by different external providers. Typically, these data are produced assimilating observational data in order to improve the algorithm functionalities which drive the models. Spatial, temporal resolution and temporal coverage depend on the model considered.

The data stored under the "rolling" section exist no longer than 15 days, meaning that they are permanently removed from the archive after that time period since they are superseded by better quality data, e.g., updated forecasts. The "rolling" archive includes also data subjected to further processing operations saved under the proper directories: the processing could include an interpolation to a finer grid in order to increase the spatial resolution ("derived" data), a subsampling by time or by space ("generic" data) or a transformation in a new format for specific purposes ("dts" data). The access to the data archive is allowed only via the Data Access Service described below.

Implementation of the DAS-DTS modules

Figure 3 shows a high-level representation of the DAS and its strict interaction with the DTS and the data archive, as implemented in the framework of the TESSA project. It is composed by totally automatized cyclic workflows that execute a set of steps on a set of data.


Fig3 D'Anca NatHazEarth2017 17-2.png

Figure 3. Interactions between the DAS, the DTS and the data archive

This interchange system has been implemented through some high-parameterized software components which schedule and parallelize the different jobs in a high-performance computing environment. The software modules developed for this system are the Downloader module, the DTS_organizer module and the Uploader module. Schematically, these modules download source raw data from a set of external providers and, after a set of transformations, taking into account the appropriate data format, store them in the data archive and publish them through the set of services exposed. Finally the Rolling_cleaner module is used to delete obsolete files and directories in the rolling archive. With the aim to increase the performance and the robustness of the system, all the mentioned components work in a multi-threaded environment: each thread is responsible for managing distinct sets of files. To cope with erroneous input, a MD5 checksum is also used. It is worth noting that the whole process is performed in a transparent way with respect to the services that act as consumers of the produced datasets in order to provide data always updated to the latest versions.

The Metadata Service and the metadata profile

The analysis of geospatial metadata standards has been the starting point for the definition of a specific metadata profile suitable for the description of the datasets produced in the framework of the TESSA project. ISO 19115, Geographic information – Metadata," is a standard of the International Organization for Standardization. It is a constituent of the ISO series 19100 standards for spatial metadata and defines the schema required for describing geographic information. In particular, this standard provides information about the identification, the extent, the quality, the spatial and temporal schema, spatial reference and distribution of digital geographic data. ISO 19115 is applicable to the cataloguing of datasets and the full description of datasets, geographic datasets, dataset series and individual features and feature properties.

The ISO 19115 standard provides approximately 400 metadata elements, most of which are listed as "optional." However, it has also drawn up a "core metadata set for geographic dataset" for search, access, transfer and exchange of geographic data; metadata profiles compliant to this international standard shall include this core to ensure homogeneity and interoperability. All metadata profiles based on ISO 19115 should include this minimum set for conformance with this international standard.

The ISO 19115 metadata standard has been widely adopted by a large number of international oceanographic and marine projects, such as the International Hydrographic Organization[35] and SeaDataNet. For its characteristics, it has been considered a valid solution also for the TESSA project, as capable of satisfying requirements of simplicity and interoperability. Thus, a specific metadata profile has been designed for describing and cataloging TESSA products, according to the requirements of the international metadata standard ISO 19115 and its XML implementation ISO 19139.

A detailed analysis of TESSA datasets led to the definition of the key aspects about how, when and by whom a specific set of data was collected, how the data are accessed and managed, and which data formats are employed in order to obtain a general overview of data and metadata available. On the basis of this information, a minimum set of metadata has been defined as able to describe the datasets produced in the framework of the TESSA project. This schema includes all mandatory elements of the core metadata set for geographic datasets drawn up by the ISO 19115 standard for search, access, transfer and exchange of geographic data: dataset title, dataset reference date, abstract describing the dataset, dataset language, dataset topic category, metadata point of contact, metadata date stamp and online resource.

The ISO 19115 standard for metadata is being adopted internationally, as it provides a built-in mechanism to develop a "community profile" by extending the minimum set with additional metadata elements to suit the needs of a particular group of users.

Hence the generation of the specific TESSA metadata profile composed of the minimum set of metadata required to serve the full range of metadata applications (discovery and access) and another three optional elements that allow for a more extensive description and, at the same time, highlight the main features of TESSA products.

Another important step in the design of the TESSA Metadata Service has been the analysis of the information systems most widely adopted, at the international level, to support the activities of search and discovery.

In particular, the ESGF has been recognized and selected as the leading infrastructure for the management and access of large distributed data volumes for climate change research. It consists of a system of distributed and federated data nodes that interact dynamically through a peer-to-peer paradigm to handle climate science data, with multiple petabytes of disparate climate datasets from a lot of modeling efforts, such as CMIP5 and CORDEX. Internally, each ESGF node is composed of a set of services and applications for secure data/metadata publication and access and user management. Moreover, the search service offers an intuitive tool based on search categories or "facets" (e.g., "model" or "project"), through which users are enabled to constrain their search results.

For these features, ESGF has been selected as the most appropriate information system for TESSA data dissemination and, above all, its visibility in the climate community.

Implementation of the Metadata Service

In this phase, the metadata profiles for the description of datasets produced by TESSA models have been formalized; moreover, the installation of a dedicated ESGF data node has been performed, customized on the requirements and specificities of the TESSA project.

For its characteristics of simplicity and interoperability, the GeoNetwork metadata editor[36] has been chosen as the metadata editing tool for the description of datasets produced by TESSA models. In fact, GeoNetwork opensource is a multi-platform metadata catalogue application, designed to connect scientific communities and their data through the web environment. This software provides an easy-to-use web interface to search geospatial data across multiple catalogs, to publish geospatial data using the online metadata editing tools, to manage user and group accounts and to schedule metadata harvesting from other catalogs. In particular, GeoNetwork provides a powerful metadata editing tool that supports the ISO 19115 metadata profile and provides automatic metadata editing and management. Profiles can take the form of templates that are possible to fill in by using the metadata editor. Once the metadata profile has been compiled, it is also be possible to generate the related XML schema compliant with ISO 19139, to link data to related metadata description and to set the privileges to view metadata and to download the data.

As an example, Fig. 4 reports an extract of the metadata profile compiled for the description of AFS simulation dataset.


Fig4 D'Anca NatHazEarth2017 17-2.png

Figure 4. Metadata profile for an example of AFS dataset

References

  1. De Dominicis, M.; Pinardi, N.; Zodiatis, G.; Lardner, R. (2013). "MEDSLIK-II, a Lagrangian marine surface oil spill model for short-term forecasting – Part 1: Theory". Geoscientific Model Development 6 (6): 1851-1869. doi:10.5194/gmd-6-1851-2013. 
  2. De Dominicis, M.; Pinardi, N.; Zodiatis, G.; Archetti, R. (2013). "MEDSLIK-II, a Lagrangian marine surface oil spill model for short-term forecasting – Part 2: Numerical simulations and validations". Geoscientific Model Development 6 (6): 1871-1888. doi:10.5194/gmd-6-1871-2013. 
  3. Coppini, G.; Jansen, E.; Turrisi, G. et al. (2016). "A new search-and-rescue service in the Mediterranean Sea: A demonstration of the operational capability and an evaluation of its performance using real case scenarios". Natural Hazards and Earth System Sciences 16 (12): 2713-2727. doi:10.5194/nhess-16-2713-2016. 
  4. Mannarini, G.; Pinardi, N.; Cippini, G. et al. (2016). "VISIR-I: Small vessels – Least-time nautical routes using wave forecasts". Geoscientific Model Development 9 (4): 1597-1625. doi:10.5194/gmd-9-1597-2016. 
  5. Mannarini, G.; Turrisi, G.; D'Anca, A. et al. (2016). "VISIR: Technological infrastructure of an operational service for safe and efficient navigation in the Mediterranean Sea". Natural Hazards and Earth System Sciences 16 (8): 1791-1806. doi:10.5194/nhess-16-1791-2016. 
  6. Lecci, R.; Coppini, G.; Creti, S. et al. (2015). "SeaConditions: Present and future sea conditions for safer navigation". Proceedings from OCEANS 2015 - Genova 2015. doi:10.1109/OCEANS-Genova.2015.7271764. 
  7. Wilkinson, M.D.; Dumontier, M.; Aalbersberg, I.J. et al. (2016). "The FAIR Guiding Principles for scientific data management and stewardship". Scientific Data 3: 160018. doi:10.1038/sdata.2016.18. PMC PMC4792175. PMID 26978244. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4792175. 
  8. "OGC network Common Data Form (netCDF) standards suite". Open Geospatial Consortium. http://www.opengeospatial.org/standards/netcdf. Retrieved 30 January 2017. 
  9. "Network Common Data Form (NetCDF)". Unidata. University Corporation for Atmospheric Research. https://www.unidata.ucar.edu/software/netcdf/. Retrieved 30 January 2017. 
  10. "Copernicus Marine Environment Monitoring Service". European Commission. http://marine.copernicus.eu/. Retrieved 30 January 2017. 
  11. Bahurel, P.; Adragna, F.; Bell, M.J. et al. (2009). "Ocean Monitoring and Forecasting Core Services, the European MyOcean Example". Proceedings of OceanObs'09: Sustained Ocean Observations and Information for Society 2009. doi:10.5270/OceanObs09.pp.02. 
  12. "Copernicus". European Commission. http://www.copernicus.eu/. Retrieved 30 January 2017. 
  13. ISO/TC 211 Geographic information/Geomatics (May 2003). "ISO 19115:2003 Geographic information -- Metadata". International Organization for Standardization. https://www.iso.org/standard/26020.html. 
  14. ISO/TC 211 Geographic information/Geomatics (April 2007). "ISO/TS 19139:2007 Geographic information -- Metadata -- XML schema implementation". International Organization for Standardization. https://www.iso.org/standard/32557.html. 
  15. "INSPIRE: Infrastructure for Spatial Information in Europe". European Commission. http://inspire.ec.europa.eu/. Retrieved 30 January 2017. 
  16. European Parliament (2007). "Directive 2007/2/EC of the European Parliament and of the Council of 14 March 2007 establishing an Infrastructure for Spatial Information in the European Community (INSPIRE)". Official Journal of the European Union L108 (25.4.2007). http://data.europa.eu/eli/dir/2007/2/oj. 
  17. Cinquini, L.; Crichton, D.; Mattmann, C. et al. (2014). "The Earth System Grid Federation: An open infrastructure for access to distributed geospatial data". Future Generation Computer Systems 36 (July 2014): 400–417. doi:10.1016/j.future.2013.07.002. 
  18. "Earth System Grid Federation". ESGF Executive Committee. https://esgf.llnl.gov/. Retrieved 30 January 2017. 
  19. "EMODnet: European Marine Observation and Data Network". European Commission. http://www.emodnet-mediterranean.eu/. Retrieved 30 January 2017. 
  20. Moussat, E.; Pinardi, N.; Manzella, G. et al. (2016). "EMODnet MedSea Checkpoint for sustainable Blue Growth". Geophysical Research Abstracts 18: 9103. http://meetingorganizer.copernicus.org/EGU2016/EGU2016-9103.pdf. 
  21. "SeaDataNet: Pan-European Infrastructure for Ocean & Marine Data Management". European Commission. https://www.seadatanet.org/. Retrieved 30 January 2017. 
  22. "CLIPC: Climate Information Portal". European Commission. http://www.clipc.eu/home. Retrieved 30 January 2017. 
  23. "Standards Guide: ISO/TC 211 Geographic information/Geomatics" (PDF). International Organization for Standardization. 1 June 2009. http://www.isotc211.org/Outreach/ISO_TC_211_Standards_Guide.pdf. Retrieved 30 January 2017. 
  24. Scalas, M.; Palmalisa, M.; Tedesco, L. et al. (2017). "TESSA: Design and implementation of a platform for situational sea awareness". Natural Hazards and Earth System Sciences 17 (2): 185-196. doi:10.5194/nhess-17-185-2017. 
  25. "THREDDS Data Server (TDS)". Unidata. University Corporation for Atmospheric Research. http://www.unidata.ucar.edu/software/thredds/current/tds/. Retrieved 30 January 2017. 
  26. Guarnieri, A.; Oddo, P.; Pastore, M.; Pinardi, N. (2008). "The Adriatic Basin Forecasting System: New model and system development". Proceeding of 5th EuroGOOS Conference, Exeter 2008. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.584.9289&rep=rep1&type=pdf. 
  27. Oddo, P.; Pinardi, N.; Zavatarelli, M. (2005). "A numerical study of the interannual variability of the Adriatic Sea (2000–2002)". Science of The Total Environment 353 (1–3): 39–56. doi:10.1016/j.scitotenv.2005.09.061. PMID 16257438. 
  28. Oddo, P.; Pinardi, N.; Zavatarelli, M.; Coluccelli, A. (2006). "The Adriatic Basin forecasting system". Acta Adriatica 47 (Sup. 1): 169–184. http://hrcak.srce.hr/8550. 
  29. Madec, G. (2008). "NEMO Ocean General Circulation Model Reference Manual, Internal Report". LODYC/IPSL. http://www.nemo-ocean.eu/About-NEMO/Reference-manuals. 
  30. Oddo, P.; Adani, M.; Pinardi, N. et al. (2009). "A nested Atlantic-Mediterranean Sea general circulation model for operational forecasting". Ocean Science 5 (4): 461-473. doi:10.5194/os-5-461-2009. 
  31. Federico, I.; Pinardi, N.; Coppini, G. et al. (2017). "Coastal ocean forecasting with an unstructured grid model in the southern Adriatic and northern Ionian seas". Natural Hazards and Earth System Sciences 17 (1): 45–59. doi:10.5194/nhess-17-45-2017. 
  32. de la Beaujardiere, J., ed. (15 March 2006). "OpenGIS Web Map Server Implementation Specification". Open Geospatial Consortium, Inc. http://portal.opengeospatial.org/files/?artifact_id=14416. Retrieved 08 February 2017. 
  33. "About OPeNDAP". OPeNDAP. https://www.opendap.org/about. Retrieved 30 January 2017. 
  34. "GPFS: A Shared-Disk File System for Large Computing Clusters". Proceedings of the 1st USENIX Conference on File and Storage Technologies 2002: 19. 2002. http://dl.acm.org/citation.cfm?id=1083323.1083349. 
  35. "International Hydrographic Organization". International Hydrographic Organization. http://www.iho.int/srv1. Retrieved 30 January 2017. 
  36. "GeoNetwork opensource". Open Source Geospatial Foundation. http://geonetwork-opensource.org/. Retrieved 30 January 2017. 

Notes

This presentation is faithful to the original, with only a few minor changes to presentation. In some cases important information was missing from the references, and that information was added. References in the original work were alphabetical; this website organizes references in order of appearance, by design. Grammar was cleaned up in several places. A URL to Unidata's NetCDF page was originally incorrect and updated for this version. URLs were added to the ISO and other standards references for improved reference information.