Merve Noyan builds open-source machine-learning tools and educational material at Hugging Face. Her work includes compact vision-language models, multimodal agents and practical recipes for customizing computer vision systems.[1][2][3]
Start with smolagents can see →
Links
Machine Learning Engineer · Hugging Face
Career
Noyan’s work combines implementation with teaching. Hugging Face introduced her as a developer advocate building tools and content to make machine learning accessible. Her public projects focus on zero-shot vision, multimodality and optimization. Her smol-vision repository collects notebooks and recipes for shrinking, optimizing and customizing visual models, giving developers examples they can inspect and adapt.[1][4][6]
Contributions
Small models that can understand images
Noyan coauthored the SmolVLM introduction. The release presents a two-billion-parameter vision-language model family for smaller local setups, with base, synthetic-data-tuned and instruction variants. It publishes checkpoints, datasets, training recipes and fine-tuning tools. The design treats memory use and deployability as central constraints, so multimodal capabilities can be explored without assuming access to the largest machines.[2]
Let an agent use what it sees
Her coauthored guide to visual agents explains how smolagents can put images into an agent’s memory. A callback records a visual observation after a tool action, allowing the next model step to reason about the resulting state. The browser example combines navigation tools with screenshots. Its concrete loop connects the agent’s action to evidence of what happened, which is essential when a website’s state changes.[3]
Ideas
In her conference talk, Noyan presents a workflow in which vision-language models help label data and evaluate annotations before training a specialized detector. The system includes human review of prompts and generated labels. The distinction matters for deployment: a flexible general model can help build a task-specific computer-vision model whose runtime requirements suit the application.[5]
Tools, writing & talks
Writing, research & talks
Start here
smolagents can seehuggingface.coA code walkthrough for giving agents visual observations, including a browser example.
Read the action-and-observation loop, then follow the browser example. Basic Python is enough to understand where screenshots enter memory; familiarity with tool-using agents helps when running the code.
Coauthor[3]- Skill issue: stop deploying vision language models, use them with Skills — Merve Noyan, Hugging Faceyoutube.com
Hugging Face's Merve Noyan lays out a toolkit that has a coding agent label images with an open VLM, reconcile two smaller VLM judges, and train a small real-time detector for a few dollars per run, beating VLM inference speed on-device.
Catalog workOriginal source - SmolVLM: small yet mightyhuggingface.co
Introduces a compact, open vision-language model family and its training resources.
Coauthor[2] A demonstration of using general vision models to help build specialized detectors.
Speaker[5]
Tools
- smol-vision
github.comNotebooks and recipes for customizing and optimizing computer vision models.