Vibeleaderboard
Index / agent
Visit github.com
Category
AI Agents
Rank
No. 1970Tools index

Previous survey · No. 1928 ·

Pricing
Open Source
Type
AGENT
Builder
affaan-m
GitHub
399 stars
Date

About

Real-time agentic intelligence-gathering platform — autonomous OSINT and web scraping streamed via Meta Ray-Ban smart glasses.

What it does

JARVIS accepts photos or camera frames, detects and identifies faces, researches named people across search and social sources, then asks a language model to assemble the findings into a structured dossier. A web interface receives research updates incrementally, while optional storage keeps records synchronized and persistent.

Why it's ranked here

The project connects capture, identification, browser research, synthesis, storage, and live presentation into one coherent pipeline. Its service-aware fallbacks and typed API make the prototype unusually inspectable. However, the repository also describes major pipeline tasks as pending, so the implementation evidence conflicts with its own delivery checklist.

What's good

Each external service can fail or remain unconfigured without stopping the backend. Research can fall back to fast search, storage can fall back to memory, and synthesis can switch providers or return raw findings. Server-Sent Events expose progress as it arrives. Health and service endpoints make missing configuration visible instead of hiding partial operation.

Tradeoffs

Useful results depend heavily on third-party credentials for search, browser automation, identification, synthesis, persistence, and tracing. Running without them preserves the application shell but removes substantial capability. In-memory fallback loses persistence and cross-tab synchronization. The face identification and person-dossier workflow also handles sensitive personal data, while the supplied text describes no consent, access-control, or retention safeguards.

How to use it well

It best suits engineers prototyping a supervised person-research workflow where incremental results and inspectable service status matter. Start with manual image uploads and fast search, then add browser sessions, persistent storage, and synthesis providers deliberately. It does not replace identity verification, privacy governance, source validation, or a general-purpose research system for subjects without faces or names.

Technical notes+

The FastAPI control plane in backend/main.py constructs MediaPipeFaceDetector, ArcFaceEmbedder, FaceSearchManager, optional enrichment and synthesis clients, ConvexGateway or InMemoryDatabaseGateway, and CapturePipeline. backend/pipeline.py extracts frames, detects and crops faces, creates embeddings and person records, runs enrichment concurrently, and stores completion metadata. backend/config.py centralizes environment-backed service flags. backend/schemas.py defines typed health, capture, agent-session, frame, and identification models. frontend/playwright.config.ts runs Chromium end-to-end tests against the development server, while frontend/vitest.config.ts configures jsdom component tests. backend/tasks.py still labels the identification pipeline and agent swarm pending despite substantial corresponding code.

Observed

Primary languages
Python backend with a TypeScript Next.js frontend
Packaging and installation
Backend installs as an editable Python package; frontend installs through npm
HTTP interface
FastAPI exposes health, service status, capture, identification, dossier, task, and agent-session endpoints
Streaming interfaces
Research uses Server-Sent Events, and audio transcription uses WebSocket
Input surfaces
Manual uploads, image URLs, video frames, smart-glasses capture, and Telegram photo intake are described
Storage options
Convex provides persistence and real-time synchronization; an in-memory gateway is the fallback
Test surface
Backend pytest commands, frontend Vitest configuration, and Playwright end-to-end configuration are present

Read from README.md, backend/main.py, backend/demo.py, backend/tasks.py, backend/config.py, backend/schemas.py, backend/__init__.py, backend/pipeline.py, backend/env_check.py, frontend/next.config.ts, frontend/vitest.config.ts, frontend/eslint.config.mjs, frontend/postcss.config.mjs, frontend/playwright.config.ts, HumanDetection/human_detection.py.

What it can do

  • Gather intelligence from open sources

    Search queries or target informationReal-time intelligence reports

  • Scrape web data autonomously

    Target websites or domainsStructured data and content

  • Stream intelligence feeds to smart glasses

    Intelligence data and user preferencesVisual display on Ray-Ban smart glasses

  • Monitor websites for changes

    Website URLs and monitoring parametersChange alerts and notifications

  • Extract structured data from web pages

    Web pages and data extraction rulesOrganized datasets and information

  • Process real-time information feeds

    Live data streams and filtering criteriaFiltered and prioritized intelligence updates

Tags

agentsosintweb-scrapingsmart-glasseswearable

Tech Stack

CSSDockerfileJavaScriptPythonShellTypeScript

Comments (0)

No comments yet

Editorially curated, with community endorsements as a secondary signal. Corrections welcome.

JARVIS | VibeLeaderboard