audio-flamingo-3-hf

5.3K
125
1 language
—
by
nvidia
Audio Model
OTHER
New
5K downloads
Early-stage
Try on Hugging FaceAdd to Compare
Edge AI:
Mobile
Laptop
Server
Unknown
Mobile
Laptop
Server
Quick Summary

Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio-Language Models Description: Audio Flamingo 3 (AF3) is a fully open, state-of-the-ar...

Code Examples

Usagebash
pip install --upgrade pip
pip install --upgrade git+https://github.com/huggingface/transformers accelerate
Usagebash
pip install --upgrade pip
pip install --upgrade git+https://github.com/huggingface/transformers accelerate
Usagebash
pip install --upgrade pip
pip install --upgrade git+https://github.com/huggingface/transformers accelerate
Additional Speed & Memory Improvementsbash
pip install flash-attn --no-build-isolation
Additional Speed & Memory Improvementsbash
pip install flash-attn --no-build-isolation
Additional Speed & Memory Improvementsbash
pip install flash-attn --no-build-isolation
Flash Attention 2python
model = AudioFlamingo3ForConditionalGeneration.from_pretrained(
    model_id, torch_dtype=torch_dtype, low_cpu_mem_usage=True, attn_implementation="flash_attention_2"
).to(device)
Flash Attention 2python
model = AudioFlamingo3ForConditionalGeneration.from_pretrained(
    model_id, torch_dtype=torch_dtype, low_cpu_mem_usage=True, attn_implementation="flash_attention_2"
).to(device)
Flash Attention 2python
model = AudioFlamingo3ForConditionalGeneration.from_pretrained(
    model_id, torch_dtype=torch_dtype, low_cpu_mem_usage=True, attn_implementation="flash_attention_2"
).to(device)

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.