Meta: Llama 3.1 8B Instruct

Name: Meta: Llama 3.1 8B Instruct
Author: OpenRouter

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors.

Context

131K

Max output

118K

Input price

$0.05/1M tokens

Output price

$0.08/1M tokens

Capabilities

Show unsupported (5)

Reasoning & Interaction

Tool Calling

Output Control

Structured Output

JSON Mode

Details

Model IDmeta-llama/llama-3.1-8b-instruct

ProviderOpenRouter

Creatormeta-llama

Familyllama-3.1

License—

Status—

Typechat

Input modalitiestext

Output modalitiestext

Open weight—

Parameters8B

Architecture—

Context window131K tokens

Max input—

Max output118K tokens

Reasoning tokens—

Knowledge cutoff—

Release date2024-07-23

Sourceofficial

Tools

Function Callingfunction_calling

Call external functions and APIs

Pricing

Input

$0.05

Output

$0.08

Cache write

—

Cache read

$0.03

Batch in

—

Batch out

—

Family Comparison: llama-3.1

Model	Caps	Perf	Speed	Context	Max out	Pricing
Meta: Llama 3.1 8B Instruct	TJJM	—	—	131K	118K	$0.05$0.08
Meta: Llama 3.1 70B Instruct	TJJM	—	—	131K	16K	$0.4$0.4
NVIDIA: Llama 3.1 Nemotron Ultra 253B v1	RJJM	—	—	131K	—	$0.6$1.8
NVIDIA: Llama 3.1 Nemotron 70B Instruct	TJJM	—	—	131K	16K	$1.2$1.2
Meta: Llama 3.1 405B (base)	S	—	—	33K	33K	$4$4

API

GET/v1/models/openrouter/meta-llama/llama-3.1-8b-instruct