Data Ingestion

The core platform requires the capability to ingest, move and store data.

Core Service Value

In order for the platform to work with data locally it will need to be described, uploaded and potentially clensed before use and its provenance data should be available for inspection and extension as necessary.

Implementation

The Kylo integrated data ingestion platform allows non-developers to import, validate and transform data from a wide range of sources, log its providence and repeat on a scheduled basis. It uses Apache NiFi which can be visually programmed as a key part of the toolset designed fgor business users. 

 


Example

The platform allows data sources to be defined, ingested, validated and stored. NiFi is used to implement many of these functions with the metadata and provenance of of the data being stored within the system for later review. 

View Kylo  »
View NiFi  »