Multimodal pipeline design

A multimodal pipeline handles acquisition, decoding, normalization, sampling, transcription or vision analysis, context assembly, model inference, structured output, storage, and evaluation. Each modality has different size, latency, privacy, ordering, and failure semantics, so passing a file to a model is only one stage of the system.