NV-Embed-v2

198.2K
478
1 language
license:cc-by-nc-4.0
by
nvidia
Embedding Model
OTHER
Good
198K downloads
Production-ready
Try on Hugging FaceAdd to Compare
Edge AI:
Mobile
Laptop
Server
Unknown
Mobile
Laptop
Server
Quick Summary

--- tags: - mteb - sentence-transformers model-index: - name: NV-Embed-v2 results: - dataset: config: en name: MTEB AmazonCounterfactualClassification (en) revi...

Code Examples

2. Required Packagespython
pip uninstall -y transformer-engine
pip install torch==2.2.0
pip install transformers==4.42.4
pip install flash-attn==2.2.0
pip install sentence-transformers==2.7.0
Modify L353 in SentenceTransformer.py to **'extra_features["prompt_length"] = tokenized_prompt["inpupython
git clone https://github.com/UKPLab/sentence-transformers.git
cd sentence-transformers
git checkout v2.7-release
# Modify L353 in SentenceTransformer.py to **'extra_features["prompt_length"] = tokenized_prompt["input_ids"].shape[-1]'**.
pip install -e .

Deploy This Model

Production-ready deployment in minutes

Together.ai

Instant API access to this model

Fastest API

Production-ready inference API. Start free, scale to millions.

Try Free API

Replicate

One-click model deployment

Easiest Setup

Run models in the cloud with simple API. No DevOps required.

Deploy Now

Disclosure: We may earn a commission from these partners. This helps keep LLMYourWay free.