Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,395

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 13 days ago • 99.4k • 441

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 18 days ago • 20.8k • 101

TeichAI/Qwen3.5-27B-Claude-Opus-4.6-Distill-GGUF

27B • Updated 3 days ago • 7.91k • 18

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated 5 days ago • 144 • 15

Ex0bit/Qwen3.5-122B-A10B-PRISM-LITE-GGUF

Image-Text-to-Text • 122B • Updated 7 days ago • 2.67k • 8

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF

4B • Updated 1 day ago • 1.61k • 8

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated Jan 16 • 52.3k • 66

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated 4 days ago • 2.45k • 5

Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated 3 days ago • 2.6k • 5

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 5 days ago • 152k • 12

marksverdhei/LCO-Embedding-Omni-7B-GGUF

Feature Extraction • 8B • Updated 3 days ago • 654 • 3

LiquidAI/LFM2-350M-GGUF

Text Generation • 0.4B • Updated Dec 5, 2025 • 40.2k • 56

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 55.5k • 139

LiquidAI/LFM2.5-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated 22 days ago • 137k • 66

TeichAI/Devstral-Small-2505-Deepseek-V3.2-Speciale-Distill-GGUF

24B • Updated about 1 month ago • 2.24k • 6

TeichAI/Qwen3-32B-Kimi-K2-Thinking-Distill-GGUF

33B • Updated about 1 month ago • 2.57k • 7

jinaai/jina-embeddings-v5-text-nano-retrieval

Sentence Similarity • 0.2B • Updated 8 days ago • 23.7k • 7

jinaai/jina-embeddings-v5-text-nano-clustering

Feature Extraction • 0.2B • Updated 8 days ago • 16.2k • 5

jinaai/jina-embeddings-v5-text-nano-text-matching

Sentence Similarity • 0.2B • Updated 8 days ago • 17.3k • 4

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated 7 days ago • 957 • 2

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled

5B • Updated 1 day ago • 416 • 2

marksverdhei/LCO-Embedding-Omni-3B-GGUF

Feature Extraction • 3B • Updated 3 days ago • 630 • 2

google/gemma-2b-it-GGUF

3B • Updated Jun 27, 2024 • 139 • 20

LiquidAI/LFM2-700M-GGUF

Text Generation • 0.7B • Updated Dec 5, 2025 • 34.7k • 46

LiquidAI/LFM2-2.6B-GGUF

Text Generation • 3B • Updated Dec 22, 2025 • 42.8k • 45

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 6 • 5

Vikhrmodels/Vistral-24B-Instruct-GGUF

24B • Updated Sep 30, 2025 • 821 • 12

LiquidAI/LFM2-Audio-1.5B-GGUF

0.3B • Updated Dec 5, 2025 • 1.2k • 29

LiquidAI/LFM2-8B-A1B-GGUF

Text Generation • 8B • Updated Dec 5, 2025 • 5.56k • 89

LiquidAI/LFM2-VL-3B-GGUF

Image-Text-to-Text • 3B • Updated Dec 5, 2025 • 74.8k • 34