xai-org

This repository contains the weights of Grok 2, a model trained and used at xAI in 2024. - Download the weights. You can replace `/local/grok-2` with any other folder name you prefer. You might encounter some errors during the download. Please retry until the download is successful. If the download succeeds, the folder should contain 42 files and be approximately 500 GB. Install the latest SGLang inference engine (>= v0.5.1) from https://github.com/sgl-project/sglang/ Use the command below to launch an inference server. This checkpoint is TP=8, so you will need 8 GPUs (each with > 40GB of memory). This is a post-trained model, so please use the correct chat template. You should be able to see the model output its name, Grok. The weights are licensed under the Grok 2 Community License Agreement.

This repository contains the weights of the Grok-1 open-weights model. You can find the code in the GitHub Repository. Download instruction Clone the repo & download the `int8` checkpoint to the `checkpoints` directory by executing this command in the repo root directory: You should be seeing output from the language model. Due to the large size of the model (314B parameters), a multi-GPU machine is required to test the model with the example code.