OpenLineage proposes an open standard and API for lineage collection that data processing engines can implement to publish at run time details of the data sources that it is reading, the types of processing it is performing and the destination of the results.

OpenLineage is a sandbox-stage project of the LF AI & Data Foundation.

Contributed by: Datakin in May 2021

Key Links: