Jinfer
qxotic.ai- Category
- Developer Tools
- Type
- TOOL
- Date
About
Jinfer is an inference engine built natively for the JVM that runs chat, vision, audio, embeddings, reranking, and text-to-speech models without requiring Python, ONNX, Docker, or a sidecar process. It includes its own pure-Java tokenizers, GGUF/safetensors model loaders, and quantized matrix kernels competitive with llama.cpp on CPU, plus integrations for Spring AI, LangChain4j, and GraalVM Native Image for low-overhead binaries.
Why it made the leaderboard
Jinfer lets JVM developers run chat, vision, audio, embeddings, and TTS inference natively, without a Python runtime, Docker, or IPC, and it ships with Spring AI and LangChain4j integrations.
Tags
javajvmllminferenceaigenai
Media
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.