barkgpt

1
by
vvasylkovskyi
Other
OTHER
New
0 downloads
Early-stage
Edge AI:
Mobile
Laptop
Server
Unknown
Mobile
Laptop
Server
Quick Summary

AI model with specialized capabilities.

Code Examples

Building a FastAPI to serve the /generate endpointbash
uv add fastapi
uv add uvicorn
Dockerfiledocker
FROM python:3.12-slim

WORKDIR /app

RUN apt-get update && apt-get install -y \
    build-essential \
    git \
    curl \
    && rm -rf /var/lib/apt/lists/*

# Python deps
RUN pip install --no-cache-dir \
    fastapi \
    uvicorn \
    torch \
    transformers

# Create model directory
RUN mkdir -p /models

# Download BarkGPT model from Hugging Face
RUN curl -L -o /models/bark_model.pt \
    https://huggingface.co/vvasylkovskyi/barkgpt/resolve/main/bark_model.pt

# Expose model path
ENV MODEL_PATH=/models/bark_model.pt

# Copy app code
COPY . .

CMD ["uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "80"]
docker
FROM python:3.12-slim

WORKDIR /app

RUN apt-get update && apt-get install -y \
    git \
    curl \
    && rm -rf /var/lib/apt/lists/*

RUN pip install --no-cache-dir \
    fastapi \
    uvicorn \
    transformers \
    torch==2.9.1+cpu \
    --extra-index-url https://download.pytorch.org/whl/cpu

RUN mkdir -p /models

RUN curl -L -o /models/bark_model.pt \
    https://huggingface.co/vvasylkovskyi/barkgpt/resolve/main/bark_model.pt

ENV MODEL_PATH=/models/bark_model.pt

COPY . .

CMD ["uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "80"]
Add user to docker groupbash
#!/bin/bash
sudo apt-get update -y
sudo apt-get install -y docker.io
sudo systemctl start docker
sudo systemctl enable docker

# Add user to docker group
sudo usermod -aG docker $USERNAME

sudo docker run -d --name bark-gpt-api -p 80:80 <your-docker-username>/<your-image>:b69f40586b04da676a11f2fc2af676e403cf0b53 # My Image tag (read below on how to get it)

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.