EUROPE - BRAZIL COLLABORATION OF BIG DATA SCIENTIFIC RESEARCH THROUGH CLOUD-CENTRIC APPLICATIONS

EUROPE - BRAZIL COLLABORATION OF BIG DATA SCIENTIFIC RESEARCH THROUGH CLOUD-CENTRIC APPLICATIONS

Press [ esc ] or close+

Standards

 

EUBra-BIGSEA has naturally committed to adopt an interoperable-by-design approach for managing such a heterogeneous set of computing resources and smooth to integrate Big Data analytics services.

EUBra-BIGSEA addresses interoperability in the implementation of the components’ interfaces and data portability thanks to the adoption of standards and an open source model for the design and development of the cloud and Big Data services.

The goal is to avoid duplication of efforts by reusing consolidated implementations of standards while, at the same time, contributing to the global efforts around standardization. EUBra-BIGSEA has continuously monitored standards at international level, particularly those related to cloud infrastructure and appliance management, QoS for cloud infrastructure, data description and management, security and privacy.

In particular, EUBra-BIGSEA uses TOSCA standards, as well as standards at the level of the data services interfaces (e.g. OGC Web Processing Service), formats (e.g. NetCDF), metadata and conventions or the data being used. 

Under EUBra-BIGSEA, UPV has made active contributors to OpenStack TOSCA YAML parser.  POLIMI and UPV aligned the EUBra-BIGSEA work to TOSCA in a way that the deployment options considered within the project can support the automation of the deployment of applications and data packaging for the technologies considered within the project. TOSCA is a flexible standard, which unfortunately leads to multiple “dialects” and different interpretations that prevent from being absolutely interoperable. Some of the popular implementations (such as Cloudify) do not follow exactly the normative types, which produces some difficulties in the understanding of TOSCA documents by the runtimes which deploy the resources. The contribution of UPV has been framed in the TOSCA parser for OpenStack, to increase interoperability. The UPV has contributed with 41 commits to the official release in the frame of the project . The Infrastructure Manager can deploy TOSCA both on-premise and public clouds, not limited to OpenStack. UPV will continue contributing to the TOSCA parser and the TOSCA implementation by developing plugins to integrate other components, such as Alien4Cloud, to increase the portfolio of TOSCA types supported.

Together with the contribution to TOSCA Parser, the development of the proactive policies from UFCG also lead to several updates in OpenStack Monasca in the official distributions of OpenStack. OpenStack is the de facto standard for managing private cloud platforms. There have been 16 contributions since 2016, including from bug fixes to improvements in recipes for installation.