qwen3-1.7b-int4-ov-npu

Name: qwen3-1.7b-int4-ov-npu
Author: FluidInference

1.7B

1 language

license:apache-2.0

FluidInference

Other

OTHER

1.7B params

New

12 downloads

Early-stage

Try on Hugging Face Add to Compare

Edge AI:

Mobile

Laptop

Server

4GB+ RAM

Mobile

Laptop

Server

Quick Summary

Model converted specifically for NPU on Intel devices.

Device Compatibility

Mobile

4-6GB RAM

Laptop

16GB RAM

Server

GPU

Minimum Recommended

2GB+ RAM

Code Examples

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

text

pip install --pre openvino==2025.2.0rc2 openvino-tokenizers==2025.2.0.0rc2 openvino-genai==2025.2.0.0rc2 --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.