- Category
- AI Agents
- Rank
- No. 1970Tools index
Previous survey · No. 1928 ·
- Pricing
- Open Source
- Type
- AGENT
- Builder
- affaan-m
- GitHub
- 399 stars
- Date
About
Real-time agentic intelligence-gathering platform — autonomous OSINT and web scraping streamed via Meta Ray-Ban smart glasses.
What it does
JARVIS accepts photos or camera frames, detects and identifies faces, researches named people across search and social sources, then asks a language model to assemble the findings into a structured dossier. A web interface receives research updates incrementally, while optional storage keeps records synchronized and persistent.
Why it's ranked here
The project connects capture, identification, browser research, synthesis, storage, and live presentation into one coherent pipeline. Its service-aware fallbacks and typed API make the prototype unusually inspectable. However, the repository also describes major pipeline tasks as pending, so the implementation evidence conflicts with its own delivery checklist.
What's good
Each external service can fail or remain unconfigured without stopping the backend. Research can fall back to fast search, storage can fall back to memory, and synthesis can switch providers or return raw findings. Server-Sent Events expose progress as it arrives. Health and service endpoints make missing configuration visible instead of hiding partial operation.
Tradeoffs
Useful results depend heavily on third-party credentials for search, browser automation, identification, synthesis, persistence, and tracing. Running without them preserves the application shell but removes substantial capability. In-memory fallback loses persistence and cross-tab synchronization. The face identification and person-dossier workflow also handles sensitive personal data, while the supplied text describes no consent, access-control, or retention safeguards.
How to use it well
It best suits engineers prototyping a supervised person-research workflow where incremental results and inspectable service status matter. Start with manual image uploads and fast search, then add browser sessions, persistent storage, and synthesis providers deliberately. It does not replace identity verification, privacy governance, source validation, or a general-purpose research system for subjects without faces or names.
Technical notes+
The FastAPI control plane in backend/main.py constructs MediaPipeFaceDetector, ArcFaceEmbedder, FaceSearchManager, optional enrichment and synthesis clients, ConvexGateway or InMemoryDatabaseGateway, and CapturePipeline. backend/pipeline.py extracts frames, detects and crops faces, creates embeddings and person records, runs enrichment concurrently, and stores completion metadata. backend/config.py centralizes environment-backed service flags. backend/schemas.py defines typed health, capture, agent-session, frame, and identification models. frontend/playwright.config.ts runs Chromium end-to-end tests against the development server, while frontend/vitest.config.ts configures jsdom component tests. backend/tasks.py still labels the identification pipeline and agent swarm pending despite substantial corresponding code.
Observed
- Primary languages
- Python backend with a TypeScript Next.js frontend
- Packaging and installation
- Backend installs as an editable Python package; frontend installs through npm
- HTTP interface
- FastAPI exposes health, service status, capture, identification, dossier, task, and agent-session endpoints
- Streaming interfaces
- Research uses Server-Sent Events, and audio transcription uses WebSocket
- Input surfaces
- Manual uploads, image URLs, video frames, smart-glasses capture, and Telegram photo intake are described
- Storage options
- Convex provides persistence and real-time synchronization; an in-memory gateway is the fallback
- Test surface
- Backend pytest commands, frontend Vitest configuration, and Playwright end-to-end configuration are present
Read from README.md, backend/main.py, backend/demo.py, backend/tasks.py, backend/config.py, backend/schemas.py, backend/__init__.py, backend/pipeline.py, backend/env_check.py, frontend/next.config.ts, frontend/vitest.config.ts, frontend/eslint.config.mjs, frontend/postcss.config.mjs, frontend/playwright.config.ts, HumanDetection/human_detection.py.
What it can do
Gather intelligence from open sources
Search queries or target information → Real-time intelligence reports
Scrape web data autonomously
Target websites or domains → Structured data and content
Stream intelligence feeds to smart glasses
Intelligence data and user preferences → Visual display on Ray-Ban smart glasses
Monitor websites for changes
Website URLs and monitoring parameters → Change alerts and notifications
Extract structured data from web pages
Web pages and data extraction rules → Organized datasets and information
Process real-time information feeds
Live data streams and filtering criteria → Filtered and prioritized intelligence updates
Tags
Tech Stack
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.
