saiga_nemo_12b_gguf

3.4K
92
12.0B
license:apache-2.0
by
IlyaGusev
Other
OTHER
12B params
New
3K downloads
Early-stage
Try on Hugging FaceAdd to Compare
Edge AI:
Mobile
Laptop
Server
27GB+ RAM
Mobile
Laptop
Server
Quick Summary

Llama.cpp compatible versions of an original 12B model. Download one of the versions, for example `saiganemo12b.Q4KM.gguf`. System requirements: 15GB RAM for...

Device Compatibility

Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
12GB+ RAM

Code Examples

text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
wget https://huggingface.co/IlyaGusev/saiga_nemo_12b_gguf/resolve/main/saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf
text
pip install llama-cpp-python fire

python3 interact_llama3_llamacpp.py saiga_nemo_12b.Q4_K_M.gguf

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.