barkgpt
1
—
by
vvasylkovskyi
Other
OTHER
New
0 downloads
Early-stage
Edge AI:
Mobile
Laptop
Server
Unknown
Mobile
Laptop
Server
Quick Summary
AI model with specialized capabilities.
Code Examples
Building a FastAPI to serve the /generate endpointbash
uv add fastapi
uv add uvicornDockerfiledocker
FROM python:3.12-slim
WORKDIR /app
RUN apt-get update && apt-get install -y \
build-essential \
git \
curl \
&& rm -rf /var/lib/apt/lists/*
# Python deps
RUN pip install --no-cache-dir \
fastapi \
uvicorn \
torch \
transformers
# Create model directory
RUN mkdir -p /models
# Download BarkGPT model from Hugging Face
RUN curl -L -o /models/bark_model.pt \
https://huggingface.co/vvasylkovskyi/barkgpt/resolve/main/bark_model.pt
# Expose model path
ENV MODEL_PATH=/models/bark_model.pt
# Copy app code
COPY . .
CMD ["uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "80"]docker
FROM python:3.12-slim
WORKDIR /app
RUN apt-get update && apt-get install -y \
git \
curl \
&& rm -rf /var/lib/apt/lists/*
RUN pip install --no-cache-dir \
fastapi \
uvicorn \
transformers \
torch==2.9.1+cpu \
--extra-index-url https://download.pytorch.org/whl/cpu
RUN mkdir -p /models
RUN curl -L -o /models/bark_model.pt \
https://huggingface.co/vvasylkovskyi/barkgpt/resolve/main/bark_model.pt
ENV MODEL_PATH=/models/bark_model.pt
COPY . .
CMD ["uvicorn", "app.main:app", "--host", "0.0.0.0", "--port", "80"]Add user to docker groupbash
#!/bin/bash
sudo apt-get update -y
sudo apt-get install -y docker.io
sudo systemctl start docker
sudo systemctl enable docker
# Add user to docker group
sudo usermod -aG docker $USERNAME
sudo docker run -d --name bark-gpt-api -p 80:80 <your-docker-username>/<your-image>:b69f40586b04da676a11f2fc2af676e403cf0b53 # My Image tag (read below on how to get it)Deploy This Model
Production-ready deployment in minutes
Together.ai
Instant API access to this model
Production-ready inference API. Start free, scale to millions.
Try Free APIReplicate
One-click model deployment
Run models in the cloud with simple API. No DevOps required.
Deploy NowDisclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.