← All IntelClip / AI ToolsLLM synthesis destroys the paper trail
From Citation Needed: Provenance for LLM-Built Knowledge Graphs — Daniel Chalef, Zep AI · ≈0:13
Names the core failure of LLM-built knowledge stores: the output artifact never appears verbatim in the inputs, so lineage has to be engineered rather than inferred.
What’s in it
- Names the core failure of LLM-built knowledge stores: the output artifact never appears verbatim in the inputs, so lineage has to be engineered rather than inferred.
Clip transcript
So, LLMs are really great at pulling together data from many sources. Uh, but they do so non sorry, they do so non-deterministically. They interpret and synthesize data generating a summary, an extracted fact, uh a structured record. And this output artifact may not appear verbatim in the source inputs. Synthesis often destroys the paper trail of how these outputs were originated. And I'm going to be talking today about provenence, which is tracing how an artifact was built and why. Legal compliance often demands provenence, but it's also useful for debugging. Deciding which sources you trust and which artifacts to delete. And solving this at scale presents a real engineering challenge.
Comments
Sign in to comment.
Loading comments…