Lineage

Visualize column-level data lineage and dependency graphs across tables and pipelines.

Category: workflow

Description

## Overview The Lineage page renders an interactive graph that traces column-level data flow across all tables, views, and pipelines in the catalog. Data engineers, analysts, and governance officers use this page to understand how data moves from source to destination, identify which upstream columns feed a given metric, and assess the downstream impact of proposed schema changes. Lineage edges are extracted from pipeline SQL using AST-based analysis. The graph supports both table-level and column-level granularity, allowing users to toggle between a high-level overview of table dependencies and a detailed view of individual column transformations. ## Key Features - **Interactive lineage graph visualization.** Explore a directed acyclic graph rendered in the browser with pan, zoom, and node selection. Nodes represent tables or columns; edges represent data flow relationships derived from SQL transformations. - **Column-level data flow tracking.** Trace the full path of a specific column from its raw source through intermediate transformations to its final destination. Each edge displays the SQL expression or function that produces the derived column. - **Impact analysis.** Select a source table or column and highlight all downstream dependents that would be affected by a change to that object. This capability accelerates change management reviews and reduces the risk of unintended breakage. - **Upstream/downstream navigation.** Click any node to recenter the graph and reveal its upstream producers or downstream consumers. Navigate multiple hops through the dependency chain without losing the overall graph context. ## Workflow 1. Open the Lineage page from the Workflow sidebar. 2. Search for or select the target table or column to investigate. 3. Toggle between table-level and column-level granularity as needed. 4. Expand the graph upstream to identify source tables and raw columns. 5. Expand the graph downstream to see all dependent tables and pipelines. 6. Use impact analysis mode to highlight the blast radius of a proposed schema change. 7. Navigate to specific pipeline or table pages by clicking graph nodes for further detail.

See Also

Open in interactive docs →   DeltaForge home →