Vibeleaderboard

Search

Searching the tools index
Filters

Type

Ready to use
Build with
Connect / Integrate
Extend
Operate
Reference

Topics

More topics

Source

Ranked under Top · All Time

  1. 2794

    WhichLLM

    Benchmarks local LLMs on your specific hardware and ranks which models run best on it.

    Utilitygithub.com/andyyyy64/whichllm

    andyyyy64 · Developer Tools

  2. 170

    LM Studio

    Desktop app for running local LLMs on llama.cpp and MLX, served over OpenAI-compatible local endpoints.

    Applicationlmstudio.aiFreemium

    @lmstudio · AI Tools

  3. 10

    llama.cpp

    C/C++ library for running LLM inference locally on CPUs and GPUs, with quantization options to cut memory use.

    Library / Frameworkgithub.com/ggml-org/llama.cppOpen Source

    ggml-org · AI Tools

  4. 711

    Llmfit

    Terminal tool that scores which local LLMs will actually run well on your CPU, GPU and RAM.

    Utilitygithub.com/alexsjones/llmfitOpen Source

    AI Tools

  5. 95

    AirLLM

    Layer-by-layer memory management lets a single 4GB GPU run inference on 70B-parameter models.

    Library / Frameworkgithub.com/lyogavin/airllm

    lyogavin · AI Tools

  6. 693

    LocalAI

    A self-hostable AI runtime that runs LLM, vision, voice, image, and video models on any hardware behind one API.

    Runtimehttps://github.com/mudler/LocalAIOpen Source

    Developer Tools

  7. 2980

    rllama

    Ruby FFI bindings for llama.cpp that run open models like GPT-OSS, Qwen, Gemma, and Llama 3 locally.

    Library / Frameworkhttps://github.com/docusealco/rllamaOpen Source

    docusealco · AI Tools

  8. 3488

    LLMxRay

    Local observability interface for Ollama covering chat, streaming, RAG, introspection and metrics

    Applicationgithub.com/lognebudo/llmxrayOpen Source

    Developer Tools

  9. 325

    omlx

    LLM inference server built for Apple Silicon, featuring continuous batching and SSD caching.

    Runtimegithub.com/jundot/omlx

    jundot · AI Tools

  10. 250

    vLLM

    An open-source LLM inference engine using PagedAttention and continuous batching to maximize GPU throughput.

    Runtimehttps://github.com/vllm-project/vllmOpen Source

    Developer Tools

  11. 3838

    llmrun: Local LLM Hardware Checker

    Detects your GPU or Mac in the browser and ranks open LLMs by fit, VRAM and speed.

    llmrun.dev

    AI Tools

  12. 744

    llamafile

    Packages an LLM's weights with llama.cpp into a single cross-platform executable that runs with no installation.

    Runtimehttps://github.com/mozilla-ai/llamafileOpen Source

    Developer Tools

  13. 2312

    Liquid Inference

    LLM inference marketplace with an auto-router that picks the cheapest provider within set quality and region rules

    Serviceliquidinference.ai

    Developer Tools

  14. 2425

    Local LLMs on Apple Devices Simulator

    Web simulator showing which local LLMs different Apple devices can run, with LLM-readable shared results.

    Applicationsimulkit.comFree

    AI Tools

  15. 2736

    p1

    Local-first code completion engine from the ggml team that runs small models for editor autocomplete.

    Utilityhttps://github.com/ggml-org/p1Open Source

    ggml-org · AI Tools

  16. 1806

    VernLLM

    Adds retries, fallback, rate limiting, and caching around LLM API calls without a gateway.

    Library / Frameworkvernllm.dev

    AI Tools

  17. 3415

    Midtry

    Reasoning harness that queries several LLM CLIs in parallel, each prompted from a different perspective.

    Utilityhttps://github.com/hmbown/midtryOpen Source

    Hmbown · AI Agents

  18. 187

    Llama

    Meta's open-weight language model family spanning 8B to 405B parameters for local and cloud inference.

    Modelllama.comOpen Source

    meta-llama · AI Tools

  19. 1599

    llm-bridge

    Universal adapter that translates LLM input formats between providers, with built-in observability and error handling.

    Library / Frameworkhttps://github.com/supermemoryai/llm-bridgeOpen Source

    supermemoryai · AI Tools

  20. 2045

    InferPilot

    Diagnoses vLLM bottlenecks from live Prometheus metrics and abstains when evidence is insufficient.

    Utilitygithub.com/poojithdevan4d/inferpilotOpen Source

    Developer Tools

  21. 3143

    rvLLM Serverless

    Lightweight vLLM replacement for RunPod serverless environments that cold-starts in seconds instead of minutes.

    Runtimegithub.com/instructkr/rvllm-serverlessOpen Source

    instructkr · AI Tools

  22. 3098

    Self-Adaptive LLMs

    Framework that lets language models adapt to unseen tasks in real time by composing expert modules on the fly.

    Library / Frameworkhttps://github.com/sakanaai/self-adaptive-llmsOpen Source

    sakanaai · AI Tools

  23. 2647

    TrackLLM

    Continuously monitors LLM API endpoints for undisclosed output changes over time, using logprobs.

    Servicewww.trackllm.net

    Developer Tools

  24. 1664

    llmbridge

    OpenAI-compatible LLM gateway in C++ with sub-millisecond translation overhead between providers.

    github.com/kottos-ai/llmbridgeOpen Source

    Developer Tools

  25. 456

    llama2.c

    Runs Llama 2 inference in a single file of pure C, serving as a minimalist reference for how LLM inference works.

    Template / Starterhttps://github.com/karpathy/llama2.cOpen Source

    karpathy · AI Tools

  26. 850

    Podman Desktop AI Lab

    Podman Desktop extension for running local LLMs in containers, from model discovery to inference and chat.

    Extensionhttps://github.com/containers/podman-desktop-extension-ai-labOpen Source

    containers · AI Tools

  27. 506

    Ollama JavaScript SDK

    JavaScript library for running, managing, and chatting with locally served Ollama models from Node or the browser.

    Library / Frameworkhttps://github.com/ollama/ollama-jsOpen Source

    ollama · Developer Tools

  28. 811

    TreeQuest

    Tree-search library from Sakana AI with a flexible API for scaling LLM compute at inference time.

    Library / Frameworkhttps://github.com/sakanaai/treequestOpen Source

    sakanaai · AI Tools

  29. 174

    LiteRT-LM

    Google framework for running large language models on phones, wearables, and IoT devices with GPU and NPU support.

    Library / Frameworkgithub.com/google-ai-edge/litert-lmOpen Source

    google-ai-edge · AI Tools

  30. 3125

    PostHog for OpenClaw

    Plugin that wires PostHog's LLM analytics into OpenClaw.

    Extensionhttps://github.com/posthog/posthog-openclawOpen Source

    PostHog · Developer Tools