Lattner discusses how Modular's open-sourced stack addresses portability across AI hardware, which bears on inferenceRunning a trained model to get answers — the phase where AI is actually used, as opposed to trained.Full definition → cost and vendor lock-in for teams running models.
Terms in this piece · Glossary
inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.