← All IntelClip / AI Tools50x cost savings running document extraction on CPU
From Structuring the Unstructured - Cedric Clyburn, Red Hat · ≈7:36
A published Hugging Face comparison on Common Crawl PDFs showing structured extraction is affordable without GPUs — the economic argument for local pipelines over VLM parsing.
What’s in it
- A published Hugging Face comparison on Common Crawl PDFs showing structured extraction is affordable without GPUs — the economic argument for local pipelines over VLM parsing.
Clip transcript
the project, I want to talk a little bit about scale and cost. As I just mentioned it there earlier, but there is a public use case I want to show you from Leandro at Hugging Face where he compared a source of common crawl PDFs and where he did a little bit of pre-work on them and actually extracted the structure using OCR and using DocLing in order to remove certain parts and clean this up for the fine PDFs export which is thousands of tokens from PDFs around the web that you could use for training a model etc. But the two comparisons he did using GPU and using CPU for DocLing allowed him to do this at 50 times of a cost savings compared to VLMs and OCR naively. And so this is what's really cool is that you can really scale this up and he did this on CPU and not needing GPU which is
Comments
Checking sign-in…
Loading comments…