GLM-4.6-control-vectors

1.4K
5
4.6B
1 language
license:apache-2.0
by
gghfez
Language Model
OTHER
4.6B params
New
1K downloads
Early-stage
Try on Hugging FaceAdd to Compare
Edge AI:
Mobile
Laptop
Server
11GB+ RAM
Mobile
Laptop
Server
Quick Summary

Creative Writing control-vectors for zai-org/GLM-4.

Device Compatibility

Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
5GB+ RAM

Code Examples

Llama.cpp / IK_Llama.cpp Examplebash
llama-server --model GLM-4.6-UD-IQ2_XXS-00001-of-00003.gguf [your usual CLI arguments] \
    --control-vector-scaled glm-4.6_honesty_vs_machiavellianism__debias.gguf 1.0 \
    --control-vector-scaled glm-4.6_honesty_vs_machiavellianism__machiavellianism.gguf 1.0 \
bash
llama-server --model GLM-4.6-UD-IQ2_XXS-00001-of-00003.gguf [your usual CLI arguments] \
    --chat-template-kwargs '{"enable_thinking": false}' \
    --control-vector-scaled glm-4.6_honesty_vs_machiavellianism__debias.gguf 1.0 \
    --control-vector-scaled glm-4.6_honesty_vs_machiavellianism__machiavellianism.gguf 1.0 \
bash
llama-server --model GLM-4.6-IQ3_KS-00001-of-00004.gguf [your usual CLI arguments] \
    --control-vector-scaled  glm-4.6_communication__debias.gguf 1.0 \
    --control-vector-scaled  glm-4.6_communication__direct_communication.gguf 1.0 \

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.