Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,000

Full-text search

Active filters: GGUF

RuneXX/LTX-2-Workflows

Updated about 16 hours ago • 258

huihui-ai/Huihui-Kimi-K2.5-BF16-abliterated-GGUF

Image-Text-to-Text • 1T • Updated 3 days ago • 834 • 7

tensorblock/SakanaAI_Llama-3-8B-Instruct-Coding-Expert-GGUF

Text Generation • 8B • Updated about 1 month ago • 495 • 2

huihui-ai/Huihui-GLM-4.5-Air-abliterated-GGUF

Text Generation • 110B • Updated Dec 6, 2025 • 331 • 46

3ndetz/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated 23 days ago • 10.3k • 20

exdysa/MiniMax-M2.5-REAP-172B-A10B-GGUF-Q4_K_M

Text Generation • 173B • Updated 6 days ago • 403 • 2

mozilla-ai/llava-v1.5-7b-llamafile

7B • Updated Apr 1, 2025 • 3.91k • 182

MaziyarPanahi/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Feb 4, 2024 • 341 • 2

MaziyarPanahi/Hermes-2-Pro-Llama-3-13B-GGUF

Text Generation • 12B • Updated Jun 15, 2024 • 100 • 1

MaziyarPanahi/Meta-Llama-3.1-405B-Instruct-GGUF

Text Generation • 410B • Updated Jul 29, 2024 • 107k • 16

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • 22B • Updated Sep 13, 2024 • 107k • 28

tensorblock/gpt2-650k-stable-diffusion-prompt-generator-GGUF

Text Generation • 0.2B • Updated about 1 month ago • 159 • 3

tensorblock/aya-expanse-32b-ungated-GGUF

32B • Updated about 1 month ago • 39 • 1

tensorblock/CHEMLLM-2b-1_5-GGUF

Text Generation • 2B • Updated about 1 month ago • 23 • 1

tensorblock/mistral-7b-grok-GGUF

7B • Updated about 1 month ago • 451 • 5

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 108k • 6

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jun 23, 2025 • 109k • 9

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 111k • 16

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 180k • 10

steampunque/gemma-3-12b-it-MP-GGUF

12B • Updated 9 days ago • 28 • 1

tensorblock/Trendyol_Trendyol-LLM-8B-T1-GGUF

Text Generation • 8B • Updated about 1 month ago • 44 • 1

tensorblock/huihui-ai_Huihui-Qwen3-1.7B-abliterated-v2-GGUF

Text Generation • 2B • Updated about 1 month ago • 115 • 2

huihui-ai/Huihui-Qwen3-VL-235B-A22B-Instruct-abliterated-GGUF

Image-Text-to-Text • 235B • Updated Dec 6, 2025 • 891 • 22

steampunque/Qwen3-VL-8B-Instruct-MP-GGUF

8B • Updated 9 days ago • 45 • 2

steampunque/Qwen2.5-Coder-14B-Instruct-MP-GGUF

15B • Updated 9 days ago • 94 • 1

MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF

Text Generation • 21B • Updated Nov 28, 2025 • 56.9k • 2

steampunque/Qwen2.5-Coder-32B-Instruct-MP-GGUF

33B • Updated 9 days ago • 50 • 1

steampunque/Ministral-3-8B-Instruct-2512-MP-GGUF

8B • Updated 9 days ago • 29 • 1

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 58.1k • 3

mradermacher/Tema_Q-R4.2-i1-GGUF

9B • Updated Jan 14 • 557 • 3