Serverless inference cloud for open-weight LLMs, image, video, TTS, transcription, embedding, and reranker models with an OpenAI-compatible API.
| Model |
|---|
Llama-3.1-Nemotron-70B-Instructnvidia/Llama-3.1-Nemotron-70B-Instruct |
Meta-Llama-3.1-70B-InstructOSSmeta-llama/Meta-Llama-3.1-70B-Instruct |
Meta-Llama-3.1-70B-Instruct-TurboOSSmeta-llama/Meta-Llama-3.1-70B-Instruct-Turbo |
Meta-Llama-3.1-8B-InstructOSSmeta-llama/Meta-Llama-3.1-8B-Instruct |
Meta-Llama-3.1-8B-Instruct-TurboOSSmeta-llama/Meta-Llama-3.1-8B-Instruct-Turbo |