DEV Community

#gguf

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
GGUF Quantization: Which Level Should You Use?
mrsaynothing profile

GGUF Quantization: Which Level Should You Use?

#ai #gguf #quantization #localllm
Comments
5 min read
How to Import LM Studio Models into Ollama (No Re-Download!) 🚀
aravindagn profile

How to Import LM Studio Models into Ollama (No Re-Download!) 🚀

#ollama #lmstudio #gguf #modelfile
Comments
3 min read
GGUF vs GPTQ vs AWQ: Which Quantization Format Should You Actually Use?
quantizelab profile

GGUF vs GPTQ vs AWQ: Which Quantization Format Should You Actually Use?

#gguf #huggingface #ai #devops
Comments
4 min read
Unsloth Releases Inkling-GGUF: A Multimodal MoE Model for Developers
pneumetron profile

Unsloth Releases Inkling-GGUF: A Multimodal MoE Model for Developers

#aiml #multimodalmodels #mixtureofexperts #gguf
Comments
3 min read
GnLOLot Releases MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF for Enhanced Local AI Development
pneumetron profile

GnLOLot Releases MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF for Enhanced Local AI Development

#gguf #llamacpp #quantized #minicpm5
Comments
3 min read
Bonsai-27B: A 1-Bit LLM for On-Device Inference with Llama.cpp and MLX
pneumetron profile

Bonsai-27B: A 1-Bit LLM for On-Device Inference with Llama.cpp and MLX

#llm #quantization #1bit #gguf
Comments
3 min read
KAT-Coder V2.5 Local Setup Guide: GGUF, vLLM, SGLang
ai_made_tools profile

KAT-Coder V2.5 Local Setup Guide: GGUF, vLLM, SGLang

#katcoder #localai #coding #gguf
20
Comments
7 min read
llama-bench skipped FA on capable GPUs — b9437 corrects it
creeta profile