voxium

Part one of a from-scratch C++ inference engine: train a small MNIST network with a non-trivial topology, export it to ONNX, then load, graph and execute it yourself — with a working explanation of how engines differ from inference servers and which optimizations pay.