Vibeleaderboard
← All Intel
Intel / video

Inference Providers: Best Way to Build with Open Source Models

Source
youtube.com
Author
Hugging Face
Date

Context

Hugging Face's Inference Providers walkthrough explains a way to use hosted models through a common interface. The model runs on a provider's infrastructure, while the developer accesses it through the shared client interface instead of setting up model-serving hardware.

The availability filter is a consequential part of that workflow: it narrows the model catalog to models that have a provider serving them. Choosing a model from a repository and having somewhere to execute it are separate requirements. The integration connects those steps while leaving model execution with the selected provider.

Terms in this piece · Glossary
  • inference — Running a trained model to get answers — the phase where AI is actually used, as opposed to trained.
  • embedding — A list of numbers representing a piece of text's meaning, so that similar meanings end up numerically close and can be searched.
Read the source www.youtube.com
More from Hugging Face
Recommended reads
Comments

Checking sign-in…

Loading comments…