granite-3.3-8b-rag-agent-lib
11
8.0B
1 language
license:apache-2.0
by
ibm-granite
Other
OTHER
8B params
New
0 downloads
Early-stage
Edge AI:
Mobile
Laptop
Server
18GB+ RAM
Mobile
Laptop
Server
Quick Summary
AI model with specialized capabilities.
Device Compatibility
Mobile
4-6GB RAM
Laptop
16GB RAM
Server
GPU
Minimum Recommended
8GB+ RAM
Code Examples
text
from huggingface_hub import HfApi, hf_hub_download
import os
from tqdm import tqdm
def download_intrinsic(
repo_id: str,
intrinsic: str,
local_dir: str,
token: str = None,
):
api = HfApi(token=token)
files = api.list_repo_files(repo_id=repo_id, token=token)
# Keep only files under your desired subfolder
files = [f for f in files if f.startswith(intrinsic.rstrip("/") + "/")]
os.makedirs(local_dir, exist_ok=True)
for file_path in tqdm(files, desc="Downloading files"):
rel_path = os.path.relpath(file_path, intrinsic)
dest_path = os.path.join(local_dir, rel_path)
os.makedirs(os.path.dirname(dest_path), exist_ok=True)
hf_hub_download(
repo_id=repo_id,
filename=file_path,
local_dir=local_dir,
token=token,
)
download_intrinsic(
repo_id="ibm-granite/granite-3.3-8b-rag-agent-lib",
intrinsic="hallucination_detection_lora",
local_dir="intrinsics/hallucination_detection",
token="YOUR_HUGGINGFACE_TOKEN", # omit if not needed
)Deploy This Model
Production-ready deployment in minutes
Together.ai
Instant API access to this model
Production-ready inference API. Start free, scale to millions.
Try Free APIReplicate
One-click model deployment
Run models in the cloud with simple API. No DevOps required.
Deploy NowDisclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.