Vibeleaderboard
Index / tool
Visit www.markdownee.com
Category
Developer Tools
Rank
No. 2283Tools index

Previous survey · No. 2078 ·

Pricing
Open Source
Type
TOOL
Use case
Data Processing
Interfaces
CLI
GitHub
2 stars
Date

About

Markdownee is a web scraper that crawls websites and saves their content as Markdown, plain text or HTML for LLMs, retrieval pipelines and research datasets. It removes boilerplate with Trafilatura Core, the team's own TypeScript and Python port of the Trafilatura extraction engine, and uses Crawlee with Playwright for crawling. It is available as an npm CLI and library, a Python library and a hosted Apify Actor.

At a glance

Markdownee turns website content into Markdown, HTML or plain text, with controls for which links to crawl and what to keep. It is worth trying when you need reusable text from several pages without carrying their navigation into a dataset.

Good fit

Developers building research collections or retrieval pipelines from a site they are allowed to crawl.

Consider something else when

Use the original pages when precise visual layout or interactive behavior is part of the evidence you need.

Start here

Preview one public page and inspect the headings, tables and links in the extracted text. Only then set a narrow path and page limit for a multi-page crawl.

Cost and requirements

Apache 2.0. A web playground previews one page. The project documents npm, Python and Apify options, with separate runtime or service requirements.

Limits to know

Main-content extraction can drop useful surrounding material. The README distinguishes plain fetching from JavaScript-rendered pages. Review the output before feeding it to a search index.

Tags

web-scrapingmarkdowncrawlerllmtrafilaturatypescript

Tech Stack

Node.jsTypeScript

Media

Markdownee

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.