Model ◆ Hidden gem

SmolVLM2-2.2B-Instruct

HuggingFaceTB/SmolVLM2-2.2B-Instruct · Apache-2.0

A vision-language model that fits on a laptop and reads video.

SmolVLM2 is a 2.2B VLM that handles images and short video clips with low VRAM, good for document Q&A, UI understanding and on-device perception.

11.1 / 100 · Score
♥ 336 Likes
117.2k Downloads
2.2B Params
4 GB GPU

Score

Trend 18
Activity 30
Quality 65
Community 16
Relevance 100

Setup at a glance

Modalityimage+video
Librarytransformers
GPU4 GB
Install
pip install transformers

Deep dive

SmolVLM2 is a 2.2B vision-language model that understands both images and short video on consumer hardware — small enough for a laptop GPU, capable enough for real document and image QA.

It is trained on a compact but strong mixture (the Cauldron, Docmatix, LLaVA-OneVision data) and exposes the standard transformers path: AutoProcessor plus AutoModelForImageTextToText.

The family ships with a demo space, a SmolVLM2 highlights space and the vision docs in the smollm repository, so getting from weights to a working app is short.

Use cases

Caption or index images on a weak GPU
Answer questions about a short clip
Power a local document-understanding agent

Good for / Not ideal for

Good for

Edge and laptop inference
Document / UI understanding tasks
Privacy-first vision apps

Not ideal for

Heavy long-video understanding
Frontier accuracy on hard benchmarks

Trend · 30d

Alternatives