Qwen3-Next-80B-A3B-Instruct-int4-AutoRound

curl -noproxy '*' http://localhost::8000/v1/chat/completions \
    -H "Content-Type: application/json" \
    -d '{
        "messages": [
        {"role": "user", "content": "Give me a short introduction to large language model."}
        ],
        "max_tokens": 1024
    }'

# "content":
#    "A large language model (LLM) is a type of artificial intelligence system trained on vast amounts of text data to understand, generate, and manipulate human language. These models use deep learning architectures—often based on the transformer network—to predict the next word in a sequence, enabling them to perform tasks like answering questions, writing essays, translating languages, and even coding. LLMs, such as GPT, Gemini, and Claude, learn patterns and relationships in language without explicit programming, allowing them to produce human-like responses across a wide range of topics. While powerful, they don’t “understand” language in the human sense and can sometimes generate plausible-sounding but incorrect or biased information.",