Solar-Open-100B-AWQ-4bit

### Basic Usage

### Transformers

Install the required dependencies:

Run inference with the following code:

#### Option 2: Installing from Source
For development, debugging, custom modifications or offline inference, Solar Open can also be run
using a source installation of vLLM. We recommend using **[uv](https://docs.astral.sh/uv/)** for environment
management and dependency resolution.

Create and activate a Python virtual environment

Install Solar Open's optimized vLLM

Start the vLLM server (For 8 GPUs)