Llama 3.1 8B Instruct

llama3.18B

Meta's latest class of models, Llama 3.1, launched with a variety of sizes and configurations.

Context
16K
Max output
16K
Input price
$0.02/1M tokens
Output price
$0.05/1M tokens

Capabilities

Reasoning & Interaction
Tool Calling
Output Control
Structured Output
JSON Mode
Infrastructure
Streaming
Fine-tuning

Details

Model IDmeta-llama/llama-3.1-8b-instruct
Provider Novita AI
Creator Meta Llama
Familyllama-3.1
Licensellama3.1
Statusactive
Typechat
Input modalitiestext
Output modalitiestext
Open weightYes
Parameters8B
Architecture—
Context window16K tokens
Max input—
Max output16K tokens
Reasoning tokens—
Knowledge cutoff
Release date
Sourceofficial

Endpoints

Chat CompletionsPOST
Generate chat responses with messageshttps://api.novita.ai/v3/openai/v1/chat/completions

Pricing

Input
$0.02
Output
$0.05
Cache write
—
Cache read
—
Batch in
—
Batch out
—

API

GET/v1/models/novita/meta-llama/llama-3.1-8b-instruct