
notcrawl
github.com/openclaw/notcrawl- Category
- Productivity
- Rank
- No. 1370Tools index
Previous survey · No. 1378 ·
- Pricing
- Open Source
- Type
- TOOL
- Builder
- openclaw
- GitHub
- 131 stars
- Latest release
- v0.6.0
- Date
About
OpenClaw's local-first Notion crawler — pulls your workspace into SQLite + normalized Markdown for offline search and backup.
What it does
notcrawl builds a browsable archive from three Notion sources: the Desktop cache, official API, and a targeted Codex connector. It preserves structured records, indexes page and comment text with FTS5, renders readable exports, and can publish compressed snapshots through Git for use on another machine.
Why it's ranked here
This is a serious archival tool, not merely a content exporter. Read-only Desktop ingestion, raw API payload retention, incomplete-content warnings, read-only SQL, maintenance commands, and merge-aware sharing show careful treatment of long-lived data. Its main reservation is coverage: the fastest source only sees locally cached content, while the connector remains experimental and targeted.
What's good
The source choices solve distinct problems without pretending they are equivalent. Desktop mode needs no token and snapshots the cache before reading. API mode captures shared pages, blocks, users, comments, databases, and rows. Missing Desktop blocks stay visible as warnings and repair candidates. Git snapshots exclude secrets and preserve local-only rows during normal merges.
Tradeoffs
Desktop coverage is opportunistic, so an uncached page body may remain incomplete until another source fills it. API discovery depends on integration sharing and token scope. The MCP route cannot enumerate a whole workspace, uses experimental gateway and credential-file contracts, and requires Codex configuration. Database row ingestion does not fetch each row's blocks or comments. Published support names macOS and Linux, not Windows.
How to use it well
Use it when engineers, researchers, or agents need repeatable local search, historical diffs, database exports, or credential-free archive sharing. Start with Desktop for speed, add the API for authoritative shared content, and reserve MCP for bounded repairs. It does not replace Notion editing, full connector enumeration, or guaranteed capture of uncached private material.
Technical notes+
go.mod defines a Go 1.26.5 module with Kong, modernc SQLite, and crawlkit. internal/store/store.go creates a WAL-mode schema with normalized entity tables, raw records, per-source state, revisions, tombstones, and separate FTS5 indexes for pages and comments. internal/notionapi/api.go paginates discovery, walks blocks, ingests comments and database rows, retains raw payloads, and avoids retiring prior blocks after partial walks. internal/markdown/export.go adds front matter, properties, comments, hierarchy-aware block rendering, and explicit cache-coverage warnings. internal/share/share.go exports validated gzip JSONL snapshots, rejects escaping or symlinked manifest paths during import, supports merge or restore behavior, then rebuilds FTS. The Makefile supplies tests, vet, dead-code analysis, vulnerability checks, smoke tests, release validation, and snapshot gates.
Observed
- License
- MIT
- Primary language
- Go
- Install surface
- Homebrew, macOS and Linux archives, Debian packages, and RPM packages
- Interfaces
- Command-line interface, three-pane terminal browser, JSON automation output, and read-only SQL
- Supported platforms
- macOS and Linux
- Storage
- SQLite with FTS5, normalized Markdown, and gzip-compressed JSONL Git snapshots
Read from README.md, go.mod, Makefile, internal/share/share.go, internal/store/query.go, internal/store/store.go, internal/store/types.go, internal/config/config.go, internal/notionapi/api.go, internal/report/report.go, internal/markdown/export.go, internal/notiontext/text.go.
What it can do
Crawl Notion workspace content
Notion workspace → Local copy of workspace data
Convert Notion content to SQLite database
Notion workspace data → SQLite database file
Convert Notion pages to normalized Markdown
Notion pages and content → Normalized Markdown files
Enable offline search of Notion content
Search queries and local SQLite database → Search results from Notion content
Create backup of Notion workspace
Notion workspace → Local backup files (SQLite + Markdown)
Tags
Tech Stack
Media
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.