GLM-4.5-Air-AWQ-FP16Mix
5.3K
13
—
by
QuantTrio
Language Model
OTHER
New
5K downloads
Early-stage
Edge AI:
Mobile
Laptop
Server
Unknown
Mobile
Laptop
Server
Quick Summary
AI model with specialized capabilities.
Code Examples
textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000textvllm
CONTEXT_LENGTH=32768
vllm serve \
QuantTrio/GLM-4.5-Air-AWQ-FP16Mix \
--served-model-name GLM-4.5-Air-AWQ-FP16Mix \
--enable-expert-parallel \
--swap-space 16 \
--max-num-seqs 512 \
--max-model-len $CONTEXT_LENGTH \
--max-seq-len-to-capture $CONTEXT_LENGTH \
--gpu-memory-utilization 0.9 \
--tensor-parallel-size 8 \
--trust-remote-code \
--disable-log-requests \
--host 0.0.0.0 \
--port 8000【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】text
2025-07-30
1. Initial commit【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")【Model Update Date】python
from huggingface_hub import snapshot_download
snapshot_download('QuantTrio/GLM-4.5-Air-AWQ-FP16Mix', cache_dir="your_local_path")Deploy This Model
Production-ready deployment in minutes
Together.ai
Instant API access to this model
Production-ready inference API. Start free, scale to millions.
Try Free APIReplicate
One-click model deployment
Run models in the cloud with simple API. No DevOps required.
Deploy NowDisclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.