Reflex

About

Reflex is a GGUF-native inference engine written in Rust and CUDA, built to minimize the time from process launch to first token on serverless GPU platforms. Its CUDA kernels are compiled ahead of time by nvcc and shipped in the binary rather than compiled at runtime, which avoids a multi-second startup delay on first use. It targets real-time agent decision loops rather than sustained server throughput.