EUROPE - BRAZIL COLLABORATION OF BIG DATA SCIENTIFIC RESEARCH THROUGH CLOUD-CENTRIC APPLICATIONS

EUROPE - BRAZIL COLLABORATION OF BIG DATA SCIENTIFIC RESEARCH THROUGH CLOUD-CENTRIC APPLICATIONS

Press [ esc ] or close+

Programming models

The EUBra-BIGSEA enables applications to effectively scale across the infrastructure, providing also to the developers appropriate abstractions to specify QoS constraints and a unified programming interface that includes computing, data analytics, and security APIs.

EUBra-BIGSEA develops a programming layer for Big Data to transparently build applications composed of data operators mapped to different Big Data frameworks. The benefits of the QoS cloud infrastructure services are not limited to Big Data applications but support any heterogeneous workload.

The base of this programming layer is the COMPSs, a programming framework that aims to facilitate the parallelisation of existing applications. For that purpose, it offers a simple programming model based on sequential development in which the user is mainly responsible for (i) identifying the functions to be executed as asynchronous parallel tasks and (ii) annotating them with annotations or standard Python decorators.A runtime system is in charge of exploiting the inherent concurrency of the code, automatically detecting and enforcing the data dependencies between tasks and spawning these tasks to the available resources and provide scalability and elasticity features allowing the dynamic provision of resources.

LEMONADE, the Live Exploration and Mining Of a Non-trivial Amount of Data from Everywhere, it is a platform for visual creation and execution of data analysis workflows, which produces Spark and COMPSs code.

 

Learn more about the EUBra-BIGSEA programming layer components 

COMPSs - COMP Superscalar

LEMONADE