Model ◆ Hidden gem

SmolLM2-1.7B-Instruct

HuggingFaceTB/SmolLM2-1.7B-Instruct · Apache-2.0

A 1.7B model good enough to be your default on-device LLM.

SmolLM2 is the small-language-model sweet spot: strong enough for summarisation, extraction and chat, yet light enough to run on a phone or a CPU-only server.

0 / 100 · Score
♥ 764 Likes
240.2k Downloads
1.7B Params
No GPU needed GPU

Score

Trend 28
Activity 19
Quality 65
Community 36
Relevance 43

Setup at a glance

Modalitytext
Librarytransformers
GPUNo GPU needed
Install
pip install transformers

Deep dive

SmolLM2-1.7B-Instruct is a 1.7B instruction-tuned language model that punches well above its weight — the mid-size in the SmolLM2 family, trained on a carefully filtered mixture including UltraFeedback and Argilla synthetic data.

The architecture is a standard transformer decoder with long-context support, and the model card documents the system and instruct prompt formats that work best with it.

Because it is small, it is a first-choice model for on-device experiments, fine-tuning practice and transformers.js browser demos — and the same weights serve as a teaching reference for the whole SmolLM2 family.

Use cases

Local summarisation and extraction
On-device chat in a privacy app
Cheap classification or routing

Good for / Not ideal for

Good for

On-device and edge deployments
Cost-sensitive production routing
Hobbyists without a GPU

Not ideal for

Hard reasoning or coding
Long-context agent loops

Trend · 30d

Alternatives