borealis-12b-instruct-preview-gguf

183
llama-cpp
by
NbAiLab
Image Model
OTHER
12B params
New
183 downloads
Early-stage
Try on Hugging FaceAdd to Compare
Edge AI:
Mobile
Laptop
Server
27GB+ RAM
Mobile
Laptop
Server
Quick Summary

AI model with specialized capabilities.

Device Compatibility

Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
12GB+ RAM

Code Examples

Usage Examplesbash
ollama run "hf.co/NbAiLab/borealis-12b-instruct-preview-gguf:Q4_K_M"
Usage Examplesbash
lms load "NbAiLab/borealis-12b-instruct-preview-gguf/borealis-12b-instruct-preview-Q4_K_M.gguf"
bash
llama-cli --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q4_K_M" -p "The meaning to life and the universe is"
bash
llama-server --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q4_K_M" -c 4096
Q8_0bash
ollama run "hf.co/NbAiLab/borealis-12b-instruct-preview-gguf:Q8_0"
Q8_0bash
lms load "NbAiLab/borealis-12b-instruct-preview-gguf/borealis-12b-instruct-preview-Q8_0.gguf"
bash
llama-cli --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q8_0" -p "The meaning to life and the universe is"
bash
llama-server --hf "NbAiLab/borealis-12b-instruct-preview-gguf:Q8_0" -c 4096
BF16bash
ollama run "hf.co/NbAiLab/borealis-12b-instruct-preview-gguf:BF16"
BF16bash
lms load "NbAiLab/borealis-12b-instruct-preview-gguf/borealis-12b-instruct-preview-BF16.gguf"
bash
llama-cli --hf "NbAiLab/borealis-12b-instruct-preview-gguf:BF16" -p "The meaning to life and the universe is"
bash
llama-server --hf "NbAiLab/borealis-12b-instruct-preview-gguf:BF16" -c 4096

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.