NVIDIA NIM Embeddings
Generate embeddings using NVIDIA NIM inference microservices
Overview
NVIDIA NIM provides optimized inference for embedding models with GPU acceleration.
Quick Start
from praisonaiagents import embedding
result = embedding(
input="Hello world",
model="nvidia_nim/NV-Embed-QA"
)
print(f"Dimensions: {len(result.embeddings[0])}")CLI Usage
praisonai embed "Hello world" --model nvidia_nim/NV-Embed-QASetup
export NVIDIA_NIM_API_KEY="your-nvidia-api-key"Available Models
| Model | Dimensions |
|---|---|
nvidia_nim/NV-Embed-QA | 1024 |
nvidia_nim/nvidia/nv-embedqa-e5-v5 | 1024 |