Llama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries. This model reaches Arena Hard of 85.0, AlpacaEval 2 LC of 57.6 and GPT-4-Turbo MT-Bench of 8.98, which are known to be predictive of LMSys Chatbot Arena Elo. As of 16th Oct 2024, this model is #1 on all three automatic alignment benchmarks (verified tab for AlpacaEval 2 LC), edging out strong frontier models such as GPT-4o and Claude 3.5 Sonnet.
function_callinghttps://api.deepinfra.com/v1/openai/v1/chat/completions| Model | Context | Max out | Pricing |
|---|---|---|---|
| Meta-Llama-3.1-8B-Instruct-Turbo | 131K | — | $0.02$0.04 |
| Meta-Llama-3.1-8B-Instruct | 131K | — | $0.02$0.05 |
| Meta-Llama-3.1-70B-Instruct-Turbo | 131K | — | $0.4$0.4 |
| Meta-Llama-3.1-70B-Instruct | 131K | — | $0.4$0.4 |
| Llama-3.1-Nemotron-70B-Instruct | 131K | — | $1.2$1.2 |
/v1/models/deepinfra/nvidia/Llama-3.1-Nemotron-70B-InstructLlama-3.1-Nemotron-70B-Instruct is a large language model customized by NVIDIA to improve the helpfulness of LLM generated responses to user queries. This model reaches Arena Hard of 85.0, AlpacaEval 2 LC of 57.6 and GPT-4-Turbo MT-Bench of 8.98, which are known to be predictive of LMSys Chatbot Arena Elo. As of 16th Oct 2024, this model is #1 on all three automatic alignment benchmarks (verified tab for AlpacaEval 2 LC), edging out strong frontier models such as GPT-4o and Claude 3.5 Sonnet.