tinymodels
formats · tinymodels.co

Tiny gguf models

Every gguf model in the catalogue. gguf is a model format: the figures below are this hub's own measurements, and every download states its sha256.

Browse by task instead: see the catalogue for the task list.

modelparamssizelicence one fixed input (ms)
Qwen2.5-0.5B-Instruct-GGUF 494M 491 MB apache-2.0 255.4 Get

The millisecond figure is one fixed input per task type, measured on this hub's machine with one warm-up run then one timed run. How these numbers were taken; the whole run, every model, is the measured bench dataset.