GLM-4.6-GGUF
2.5K
27
4.6B
Q4
ik_llama.cpp
by
ubergarm
Language Model
OTHER
4.6B params
New
2K downloads
Early-stage
Edge AI:
Mobile
Laptop
Server
11GB+ RAM
Mobile
Laptop
Server
Quick Summary
`ikllama.cpp` imatrix Quantizations of zai-org/GLM-4.6 This quant collection REQUIRES ikllama.cpp fork to support the ik's latest SOTA quants and optimizations!...
Device Compatibility
Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
5GB+ RAM
Deploy This Model
Production-ready deployment in minutes
Together.ai
Instant API access to this model
Production-ready inference API. Start free, scale to millions.
Try Free APIReplicate
One-click model deployment
Run models in the cloud with simple API. No DevOps required.
Deploy NowDisclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.