LlamaEdge compatible quants for SmolVLM2 models.
AI & ML interests
Run open source LLMs across CPU and GPU without changing the binary in Rust and Wasm locally!
LlamaEdge compatible quants for Qwen3 models.
LlamaEdge compatible quants for EXAONE-3.5 models.
LlamaEdge compatible quants for Gemma-3-it models.
-
second-state/gemma-3-27b-it-GGUF
Image-Text-to-Text • 27B • Updated • 398 -
second-state/gemma-3-12b-it-GGUF
Image-Text-to-Text • 12B • Updated • 1.94k • 2 -
second-state/gemma-3-4b-it-GGUF
Image-Text-to-Text • 4B • Updated • 605 -
second-state/gemma-3-1b-it-GGUF
Text Generation • 1.0B • Updated • 452
-
second-state/stable-diffusion-v1-5-GGUF
Text-to-Image • 1B • Updated • 20.6k • 24 -
second-state/stable-diffusion-v-1-4-GGUF
Text-to-Image • 1B • Updated • 287 • 3 -
second-state/stable-diffusion-3.5-medium-GGUF
Text-to-Image • 0.7B • Updated • 4.64k • 10 -
second-state/stable-diffusion-3.5-large-GGUF
Text-to-Image • 0.7B • Updated • 11.3k • 11
LlamaEdge compatible quants for Qwen2-VL models.
LlamaEdge compatible quants for tool-use models.
-
second-state/Llama-3-Groq-8B-Tool-Use-GGUF
Text Generation • 8B • Updated • 902 • 2 -
second-state/Llama-3-Groq-70B-Tool-Use-GGUF
Text Generation • 71B • Updated • 244 • 2 -
second-state/Hermes-2-Pro-Llama-3-8B-GGUF
Text Generation • 8B • Updated • 254 • 2 -
second-state/Nemotron-Mini-4B-Instruct-GGUF
4B • Updated • 520 • 1
LlamaEdge compatible quants for Llama 3.2 3B and 1B Instruct models.
LlamaEdge compatible quants for Yi-1.5 chat models.
-
second-state/Yi-1.5-9B-Chat-16K-GGUF
Text Generation • 9B • Updated • 342 • 5 -
second-state/Yi-1.5-34B-Chat-16K-GGUF
Text Generation • 34B • Updated • 90 • 3 -
second-state/Yi-1.5-9B-Chat-GGUF
Text Generation • 9B • Updated • 227 • 8 -
second-state/Yi-1.5-6B-Chat-GGUF
Text Generation • 6B • Updated • 545 • 3
LlamaEdge compatible quants for Qwen2.5-VL models.
LlamaEdge compatible quants for Tessa-T1 models.
LlamaEdge compatible quants for EXAONE-Deep models.
LlamaEdge compatible quants for DeepSeek-R1 distilled models.
-
second-state/DeepSeek-R1-Distill-Qwen-1.5B-GGUF
Text Generation • 2B • Updated • 177 -
second-state/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation • 8B • Updated • 178 • 1 -
second-state/DeepSeek-R1-Distill-Qwen-14B-GGUF
Text Generation • 15B • Updated • 148 • 1 -
second-state/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation • 33B • Updated • 88
LlamaEdge compatible quants for Falcon3-Instruct models.
-
second-state/Falcon3-10B-Instruct-GGUF
Text Generation • 10B • Updated • 67 • 1 -
second-state/Falcon3-7B-Instruct-GGUF
Text Generation • 7B • Updated • 125 • 2 -
second-state/Falcon3-3B-Instruct-GGUF
Text Generation • 3B • Updated • 54 -
second-state/Falcon3-1B-Instruct-GGUF
Text Generation • 2B • Updated • 149
LlamaEdge compatible quants for Qwen2.5-Coder models.
-
second-state/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 148 • 1 -
second-state/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation • 3B • Updated • 240 -
second-state/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • 15B • Updated • 112 -
second-state/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • 33B • Updated • 155
LlamaEdge compatible quants for InternLM-2.5 models.
LlamaEdge compatible quants for Qwen 2.5 instruct and coder models.
-
second-state/Qwen2.5-72B-Instruct-GGUF
Text Generation • 73B • Updated • 355 • 1 -
second-state/Qwen2.5-32B-Instruct-GGUF
Text Generation • 33B • Updated • 141 -
second-state/Qwen2.5-14B-Instruct-GGUF
Text Generation • 15B • Updated • 580 -
second-state/Qwen2.5-7B-Instruct-GGUF
Text Generation • 8B • Updated • 162
LlamaEdge compatible quants for FLUX.1 models.
-
second-state/FLUX.1-schnell-GGUF
Text-to-Image • 83.8M • Updated • 1.19k • 15 -
second-state/FLUX.1-dev-GGUF
Text-to-Image • 0.1B • Updated • 1.29k • 12 -
second-state/FLUX.1-Redux-dev-GGUF
Text-to-Image • 64.5M • Updated • 259 • 13 -
second-state/FLUX.1-Canny-dev-GGUF
Text-to-Image • 12B • Updated • 157 • 13
LlamaEdge compatible quants for SmolVLM2 models.
LlamaEdge compatible quants for Qwen2.5-VL models.
LlamaEdge compatible quants for Qwen3 models.
LlamaEdge compatible quants for Tessa-T1 models.
LlamaEdge compatible quants for EXAONE-3.5 models.
LlamaEdge compatible quants for EXAONE-Deep models.
LlamaEdge compatible quants for Gemma-3-it models.
-
second-state/gemma-3-27b-it-GGUF
Image-Text-to-Text • 27B • Updated • 398 -
second-state/gemma-3-12b-it-GGUF
Image-Text-to-Text • 12B • Updated • 1.94k • 2 -
second-state/gemma-3-4b-it-GGUF
Image-Text-to-Text • 4B • Updated • 605 -
second-state/gemma-3-1b-it-GGUF
Text Generation • 1.0B • Updated • 452
LlamaEdge compatible quants for DeepSeek-R1 distilled models.
-
second-state/DeepSeek-R1-Distill-Qwen-1.5B-GGUF
Text Generation • 2B • Updated • 177 -
second-state/DeepSeek-R1-Distill-Qwen-7B-GGUF
Text Generation • 8B • Updated • 178 • 1 -
second-state/DeepSeek-R1-Distill-Qwen-14B-GGUF
Text Generation • 15B • Updated • 148 • 1 -
second-state/DeepSeek-R1-Distill-Qwen-32B-GGUF
Text Generation • 33B • Updated • 88
-
second-state/stable-diffusion-v1-5-GGUF
Text-to-Image • 1B • Updated • 20.6k • 24 -
second-state/stable-diffusion-v-1-4-GGUF
Text-to-Image • 1B • Updated • 287 • 3 -
second-state/stable-diffusion-3.5-medium-GGUF
Text-to-Image • 0.7B • Updated • 4.64k • 10 -
second-state/stable-diffusion-3.5-large-GGUF
Text-to-Image • 0.7B • Updated • 11.3k • 11
LlamaEdge compatible quants for Falcon3-Instruct models.
-
second-state/Falcon3-10B-Instruct-GGUF
Text Generation • 10B • Updated • 67 • 1 -
second-state/Falcon3-7B-Instruct-GGUF
Text Generation • 7B • Updated • 125 • 2 -
second-state/Falcon3-3B-Instruct-GGUF
Text Generation • 3B • Updated • 54 -
second-state/Falcon3-1B-Instruct-GGUF
Text Generation • 2B • Updated • 149
LlamaEdge compatible quants for Qwen2-VL models.
LlamaEdge compatible quants for Qwen2.5-Coder models.
-
second-state/Qwen2.5-Coder-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 148 • 1 -
second-state/Qwen2.5-Coder-3B-Instruct-GGUF
Text Generation • 3B • Updated • 240 -
second-state/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • 15B • Updated • 112 -
second-state/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • 33B • Updated • 155
LlamaEdge compatible quants for tool-use models.
-
second-state/Llama-3-Groq-8B-Tool-Use-GGUF
Text Generation • 8B • Updated • 902 • 2 -
second-state/Llama-3-Groq-70B-Tool-Use-GGUF
Text Generation • 71B • Updated • 244 • 2 -
second-state/Hermes-2-Pro-Llama-3-8B-GGUF
Text Generation • 8B • Updated • 254 • 2 -
second-state/Nemotron-Mini-4B-Instruct-GGUF
4B • Updated • 520 • 1
LlamaEdge compatible quants for InternLM-2.5 models.
LlamaEdge compatible quants for Llama 3.2 3B and 1B Instruct models.
LlamaEdge compatible quants for Qwen 2.5 instruct and coder models.
-
second-state/Qwen2.5-72B-Instruct-GGUF
Text Generation • 73B • Updated • 355 • 1 -
second-state/Qwen2.5-32B-Instruct-GGUF
Text Generation • 33B • Updated • 141 -
second-state/Qwen2.5-14B-Instruct-GGUF
Text Generation • 15B • Updated • 580 -
second-state/Qwen2.5-7B-Instruct-GGUF
Text Generation • 8B • Updated • 162
LlamaEdge compatible quants for Yi-1.5 chat models.
-
second-state/Yi-1.5-9B-Chat-16K-GGUF
Text Generation • 9B • Updated • 342 • 5 -
second-state/Yi-1.5-34B-Chat-16K-GGUF
Text Generation • 34B • Updated • 90 • 3 -
second-state/Yi-1.5-9B-Chat-GGUF
Text Generation • 9B • Updated • 227 • 8 -
second-state/Yi-1.5-6B-Chat-GGUF
Text Generation • 6B • Updated • 545 • 3
LlamaEdge compatible quants for FLUX.1 models.
-
second-state/FLUX.1-schnell-GGUF
Text-to-Image • 83.8M • Updated • 1.19k • 15 -
second-state/FLUX.1-dev-GGUF
Text-to-Image • 0.1B • Updated • 1.29k • 12 -
second-state/FLUX.1-Redux-dev-GGUF
Text-to-Image • 64.5M • Updated • 259 • 13 -
second-state/FLUX.1-Canny-dev-GGUF
Text-to-Image • 12B • Updated • 157 • 13