ALIA-40b-instruct-2601

1.9K
3
llama
by
BSC-LT
Language Model
OTHER
40B params
New
2K downloads
Early-stage
Edge AI:
Mobile
Laptop
Server
90GB+ RAM
Mobile
Laptop
Server
Quick Summary

AI model with specialized capabilities.

Device Compatibility

Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
38GB+ RAM

Code Examples

pip install openaipythonopenai
# pip install openai 

from openai import OpenAI 

client = OpenAI(
	base_url = YOUR_ENDPOINT_URL,
	api_key = YOUR_HF_TOKEN
)

chat_completion = client.chat.completions.create(
	model = "BSC-LT/ALIA-40b-instruct-2601",
	messages = [
		{
			"role": "user",
			"content": "What is deep learning?"
		}
	],
	stream = True,
    max_tokens = 1000,
    temperature=0.1
)

print(chat_completion.choices[0].message.content)

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.