Inference Providers: Best Way to Build with Open Source Models

Shows how to call many open-source models, including embeddings and multimodal ones, through one SDK in Python. That cuts integration work when comparing or swapping open models.

• inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
• embedding — A list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.
• multimodal — A model that works with more than text — reading images, audio, or video, and sometimes generating them too.

• videoTeaching Tiny Models to Prove Hard Theorems | Lewis Tunstall | HF ML Club India EP1
• videoRoPE: Understanding Rotary Positional Embeddings in transformers
• videoBenchmarking LLMs at the Game Of Science (Eleusis)
• videoHugging Face Journal Club: AI Research Preference Models

• videoServing 2 Million Models Without Melting: Scaling the Hugging Face Hub — Arek Borucki, Hugging FaceAI Engineer
• articleThe Open Source AI Stackwww.together.ai
• blogNVIDIA to Acquire Hugging FaceJensen Huang

Checking sign-in…

Loading comments…