NEARDATA

Extreme Near-Data Processing Platform

Institution:

Institution

Research Group:

Data Centric Computing

Researcher/s:

Aaron Call

NEARDATA

Description:

The goal of NEARDATA is to create an extreme data infrastructure mediating data flows between Object Storage and Data Analytics platforms across the Compute Continuum.

Type of asset:

Service

Category:

Computer Sciences

Problem:

To create and standardize secured methods to move and process exa-scale health data from the edge to the cloud. This data is highly confidential (health data) thus ensuring confidential transfers is a must as well as challenging.

Solution:

Our novel XtremeDataHub platform is an intermediary data service that intercepts and optimises data flows (S3 API, stream APIs) with highperformance near-data connectors (Cloud/Edge). Finally, our unique Data Broker service will provide secure data access and orchestration of dispersed data sources thanks to TEEs and federated learning architectures.

Aplication areas:

To allow efficient distribution of health data to sequence the genome and better understand human DNA. Create generalised machine-learning models that can aid surgeons during surgery and allow video data to be analysed in real-time and with low latency. Expand the analysis of metabolomics raw data and boost external access and efficient re-use of open data.

Novelty:

Create a novel intermediary data service (XtremeDataHub) providing serverless data connectors that optimize data management operations (partitioning, filtering, transformation, aggregation) and interactive queries (search, discovery, matching, multi-object queries) to efficiently present data to analytics platforms. As a second novelty mechanisms to enable real-time streaming and processing of health data will be provided. Finally, a novel data broker service enabling trustworthy data sharing and confidential orchestration of data pipelines across the compute continuum will be created.

Protection:

Open-source licenses and open-data repositories.

Target market:

Universities, hospitals, health institutes, SME with expertise on security and confidentiality.

Keywords:

Extreme data, data analysis, data broker.

TRL: 3

CRL: N/A

BRL: N/A

IPRL: N/A

TmRL: N/A

FRL: N/A

More information

if you want to know more about this project do not hesitate to contact us

Contact us