Llama 3.3-70B Turbo is a highly optimized version of the Llama 3.3-70B model, utilizing FP8 quantization to deliver significantly faster inference speeds with a minor trade-off in accuracy. The model is designed to be helpful, safe, and flexible, with a focus on responsible deployment and mitigating potential risks such as bias, toxicity, and misinformation. It achieves state-of-the-art performance on various benchmarks, including conversational tasks, language translation, and text generation.
function_callinghttps://api.deepinfra.com/v1/openai/v1/chat/completions| Model | Context | Max out | Pricing |
|---|---|---|---|
| Llama-3.3-70B-Instruct-Turbo | 131K | — | $0.1$0.32 |
| Llama-3.3-Nemotron-Super-49B-v1.5 | 131K | — | $0.4$0.4 |
/v1/models/deepinfra/meta-llama/Llama-3.3-70B-Instruct-Turbo