Vibeleaderboard
Index / tool
Visit github.com
Category
Productivity
Rank
No. 1370Tools index

Previous survey · No. 1378 ·

Pricing
Open Source
Type
TOOL
Builder
openclaw
GitHub
131 stars
Latest release
v0.6.0
Date

About

OpenClaw's local-first Notion crawler — pulls your workspace into SQLite + normalized Markdown for offline search and backup.

What it does

notcrawl builds a browsable archive from three Notion sources: the Desktop cache, official API, and a targeted Codex connector. It preserves structured records, indexes page and comment text with FTS5, renders readable exports, and can publish compressed snapshots through Git for use on another machine.

Why it's ranked here

This is a serious archival tool, not merely a content exporter. Read-only Desktop ingestion, raw API payload retention, incomplete-content warnings, read-only SQL, maintenance commands, and merge-aware sharing show careful treatment of long-lived data. Its main reservation is coverage: the fastest source only sees locally cached content, while the connector remains experimental and targeted.

What's good

The source choices solve distinct problems without pretending they are equivalent. Desktop mode needs no token and snapshots the cache before reading. API mode captures shared pages, blocks, users, comments, databases, and rows. Missing Desktop blocks stay visible as warnings and repair candidates. Git snapshots exclude secrets and preserve local-only rows during normal merges.

Tradeoffs

Desktop coverage is opportunistic, so an uncached page body may remain incomplete until another source fills it. API discovery depends on integration sharing and token scope. The MCP route cannot enumerate a whole workspace, uses experimental gateway and credential-file contracts, and requires Codex configuration. Database row ingestion does not fetch each row's blocks or comments. Published support names macOS and Linux, not Windows.

How to use it well

Use it when engineers, researchers, or agents need repeatable local search, historical diffs, database exports, or credential-free archive sharing. Start with Desktop for speed, add the API for authoritative shared content, and reserve MCP for bounded repairs. It does not replace Notion editing, full connector enumeration, or guaranteed capture of uncached private material.

Technical notes+

go.mod defines a Go 1.26.5 module with Kong, modernc SQLite, and crawlkit. internal/store/store.go creates a WAL-mode schema with normalized entity tables, raw records, per-source state, revisions, tombstones, and separate FTS5 indexes for pages and comments. internal/notionapi/api.go paginates discovery, walks blocks, ingests comments and database rows, retains raw payloads, and avoids retiring prior blocks after partial walks. internal/markdown/export.go adds front matter, properties, comments, hierarchy-aware block rendering, and explicit cache-coverage warnings. internal/share/share.go exports validated gzip JSONL snapshots, rejects escaping or symlinked manifest paths during import, supports merge or restore behavior, then rebuilds FTS. The Makefile supplies tests, vet, dead-code analysis, vulnerability checks, smoke tests, release validation, and snapshot gates.

Observed

License
MIT
Primary language
Go
Install surface
Homebrew, macOS and Linux archives, Debian packages, and RPM packages
Interfaces
Command-line interface, three-pane terminal browser, JSON automation output, and read-only SQL
Supported platforms
macOS and Linux
Storage
SQLite with FTS5, normalized Markdown, and gzip-compressed JSONL Git snapshots

Read from README.md, go.mod, Makefile, internal/share/share.go, internal/store/query.go, internal/store/store.go, internal/store/types.go, internal/config/config.go, internal/notionapi/api.go, internal/report/report.go, internal/markdown/export.go, internal/notiontext/text.go.

What it can do

  • Crawl Notion workspace content

    Notion workspaceLocal copy of workspace data

  • Convert Notion content to SQLite database

    Notion workspace dataSQLite database file

  • Convert Notion pages to normalized Markdown

    Notion pages and contentNormalized Markdown files

  • Enable offline search of Notion content

    Search queries and local SQLite databaseSearch results from Notion content

  • Create backup of Notion workspace

    Notion workspaceLocal backup files (SQLite + Markdown)

Tags

notioncrawlersqliteopenclawarchive

Tech Stack

Go

Media

notcrawl

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.