Vibeleaderboard
Index / tool
Visit github.com
Category
Developer Tools
Rank
No. 1473Tools index

Previous survey · No. 1482 ·

Pricing
Open Source
Type
TOOL
Builder
openclaw
GitHub
31 stars
Latest release
v0.1.22
Date

About

CLI that uses Vercel's Chat SDK to test message channels against OpenClaw — replay conversations, fuzz routing, validate adapters.

What it does

The supplied repository describes Crabline, a deterministic local QA harness for OpenClaw messaging integrations. Configuration selects fixtures and provider profiles. Tests can send messages, await inbound replies, run agent round trips, inspect health, or watch traffic. Local provider-shaped servers let real OpenClaw plugins exercise selected native protocols without contacting live services.

Why it's ranked here

The repository supports a strong verdict for Crabline, but not for a tool named Multipass. Its package metadata, command name, documentation, and public library surface consistently identify Crabline. Judged on that evidence, it offers unusually concrete channel testing: deterministic fixtures, stable JSON output, protocol-shaped local servers, explicit failure categories, timeouts, retries, and recorder artifacts.

What's good

It separates lightweight fixture mocks from provider-shaped servers that exercise real plugin boundaries. Twelve built-in mock adapters share common test modes, while eight local servers cover selected native APIs. Nonces reduce accidental reply matches. Configuration receives schema validation, bounded input handling, and strict webhook rules. Credentials can enter server processes through environment variables or file descriptors instead of command arguments.

Tradeoffs

Local servers cover only selected provider behavior, not complete production platforms. The Discord server omits voice, interactions, attachments, compression, distributed permissions, and real rate limiting. Matrix coverage is unencrypted. Release testing still requires live providers and credentials. Script adapters execute configured commands and therefore require trusted manifests. The source checkout also needs the development command because it does not link its own executable locally.

How to use it well

Use it for repeatable CI checks around OpenClaw channel adapters, especially message delivery, inbound matching, authentication handling, timeouts, and protocol integration. Start with fixture mocks for fast scenarios, then use local provider servers when the real plugin boundary matters. Keep JSONL recorders as evidence and retain a separate live-provider release lane. Do not treat it as full platform emulation or proof of production credential flows.

Technical notes+

package.json defines the ESM package @openclaw/crabline, a crabline binary, Node 22 or newer, pnpm packaging, compiled JavaScript, and declaration output. src/index.ts exposes both server starters and OpenClaw integration types. src/servers/index.ts dispatches eight provider server implementations. src/core/run.ts implements fixture deadlines, abort draining, retries, nonce matching, and bounded script payloads. src/cli/program.ts uses Commander, rejects credential values on command arguments, and accepts bounded JSON through file descriptors. src/config/load.ts limits manifests to one MiB, validates UTF-8, rejects duplicate JSON keys, parses YAML or JSON, and applies the Zod schema from src/config/schema.ts. The supplied repository metadata consistently names Crabline rather than Multipass.

Observed

Repository identity
Package metadata, documentation, and executable consistently identify the project as Crabline, not Multipass.
License
MIT
Primary language
TypeScript, compiled to ECMAScript modules with declaration files.
Packaging
Published as the npm package @openclaw/crabline and built with pnpm.
Interfaces
Command-line application and importable JavaScript library.
Runtime
Node.js 22 or newer.
Mock coverage
Built-in fixture adapters cover twelve named messaging providers, plus a script adapter.
Server coverage
Local provider servers cover Discord, Mattermost, Matrix, Signal, Slack, Telegram, WhatsApp, and Zalo.

Read from README.md, package.json, src/index.ts, src/openclaw.ts, src/matrix-ids.ts, src/core/run.ts, src/cli/program.ts, src/config/load.ts, src/core/errors.ts, src/core/nonces.ts, src/bin/crabline.ts, src/core/matcher.ts, src/servers/index.ts, src/config/schema.ts, src/core/http-path.ts.

What it can do

  • Replay conversations against OpenClaw

    Conversation data/chat historyReplayed conversation results

  • Test message channels

    Message channel configurationsTest results and validation status

  • Fuzz routing logic

    Routing configurations and parametersFuzzing test results and error reports

  • Validate adapter functionality

    Adapter configurations and test casesValidation results and compatibility reports

  • Execute chat SDK operations via CLI

    CLI commands and parametersCommand execution results and status messages

Tags

testingvercelopenclawclichat

Tech Stack

Node.jsTypeScript

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.