Llama-3.3-70B-Instruct-Turbo

llama

Llama 3.3-70B Turbo is a highly optimized version of the Llama 3.3-70B model, utilizing FP8 quantization to deliver significantly faster inference speeds with a minor trade-off in accuracy. The model is designed to be helpful, safe, and flexible, with a focus on responsible deployment and mitigating potential risks such as bias, toxicity, and misinformation. It achieves state-of-the-art performance on various benchmarks, including conversational tasks, language translation, and text generation.

Context
131K
Input price
$0.1/1M tokens
Output price
$0.32/1M tokens

Capabilities

Reasoning & Interaction
Tool Calling
Output Control
Structured Output
JSON Mode
Infrastructure
Streaming
Fine-tuning

Details

Model IDmeta-llama/Llama-3.3-70B-Instruct-Turbo
Provider DeepInfra
FamilyLlama-3.3
Licensellama
Statusactive
Typechat
Input modalitiestext
Output modalitiestext
Open weightYes
Parameters—
Architecture—
Context window131K tokens
Max input—
Max output—
Reasoning tokens—
Knowledge cutoff—
Release date—
Sourceofficial

Tools

Function Callingfunction_calling
Call external functions and APIs

Endpoints

Chat CompletionsPOST
Generate chat responses with messageshttps://api.deepinfra.com/v1/openai/v1/chat/completions

Pricing

Input
$0.1
Output
$0.32
Cache write
—
Cache read
—
Batch in
—
Batch out
—

Family Comparison: Llama-3.3

ModelContextMax outPricing
Llama-3.3-70B-Instruct-Turbo131K—$0.1$0.32
Llama-3.3-Nemotron-Super-49B-v1.5131K—$0.4$0.4

API

GET/v1/models/deepinfra/meta-llama/Llama-3.3-70B-Instruct-Turbo