SGLang-EAGLE3-Qwen3-235B-A22B-Instruct-2507-SpecForge-Meituan

24
llama
by
lmsys
Other
OTHER
235B params
New
24 downloads
Early-stage
Try on Hugging FaceAdd to Compare
Edge AI:
Mobile
Laptop
Server
526GB+ RAM
Mobile
Laptop
Server
Quick Summary

AI model with specialized capabilities.

Device Compatibility

Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
219GB+ RAM

Training Data Analysis

🔵 Good (6.0/10)

Researched training datasets used by SGLang-EAGLE3-Qwen3-235B-A22B-Instruct-2507-SpecForge-Meituan with quality assessment

Specialized For

general
multilingual

Training Datasets (1)

c4
🔵 6/10
general
multilingual
Key Strengths
  • •Scale and Accessibility: 750GB of publicly available, filtered text
  • •Systematic Filtering: Documented heuristics enable reproducibility
  • •Language Diversity: Despite English-only, captures diverse writing styles
Considerations
  • •English-Only: Limits multilingual applications
  • •Filtering Limitations: Offensive content and low-quality text remain despite filtering

Explore our comprehensive training dataset analysis

View All Datasets

Code Examples

Usagebash
export SGLANG_ALLOW_OVERWRITE_LONGER_CONTEXT_LEN=1

python3 -m sglang.launch_server \
    --model Qwen/Qwen3-235B-A22B-Instruct-2507 \
    --speculative-algorithm EAGLE3 \
    --speculative-draft-model-path lmsys/SGLang-EAGLE3-Qwen3-235B-A22B-Instruct-2507-perfect-blend-regenerated \
    --speculative-num-steps 3 \
    --speculative-eagle-topk 1 \
    --speculative-num-draft-tokens 4 \
    --tp 8
clone specforgebash
# clone specforge
git clone https://github.com/sgl-project/SpecForge.git
cd SpecForge/benchmarks

# run benchmarks
python bench_eagle3.py \
        --model Qwen/Qwen3-235B-A22B-Instruct-2507 \
        --speculative-algorithm EAGLE3 \
        --speculative-draft-model-path lmsys/SGLang-EAGLE3-Qwen3-235B-A22B-Instruct-2507-perfect-blend-regenerated \
        --port 30003 \
        --config-list 1,3,1,4 1,5,1,6 1,5,3,6 1,7,1,8 1,7,4,8 \
        --benchmark-list gsm8k math500 mtbench humaneval livecodebench financeqa gpqa  \
        --dtype bfloat16 \
        --tp 8 \
        --name qwen3-235b-a22b-spec-bundle

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.