Llama-3.1-70B-Instruct

Name: Llama-3.1-70B-Instruct
Author: Hugging Face

llama3.171B

Context

131K

Max output

131K

Capabilities

Show unsupported (5)

Reasoning & Interaction

Tool Calling

Infrastructure

Streaming

Fine-tuning

Model IDmeta-llama/Llama-3.1-70B-Instruct

Licensellama3.1

Status—

Typechat

Input modalitiestext

Output modalitiestext

Open weightYes

Parameters71B

Architecturetransformer

Context window131K tokens

Max input—

Max output131K tokens

Reasoning tokens—

Knowledge cutoff2023-12

Release date2024-07-16

Sourceofficial

Function Callingfunction_calling

Call external functions and APIs

Model	Caps	Perf	Speed	Context	Max out
Llama-3.1-8B-Instruct	TS	—	—	131K	—
Llama-3.1-70B-Instruct	TSF	—	—	131K	131K
Llama-3.1-8B-Instruct	TSF	—	—	131K	131K
Meta-Llama-3.1-8B-Instruct-abliterated	TSF	—	—	131K	—
Meta-Llama-3.1-70B-Instruct	TSF	—	—	131K	—
Meta-Llama-3.1-8B-Instruct	TSF	—	—	131K	—
Llama-3.1-8B-Instruct-FP8	TSF	—	—	131K	—
Llama-3.1-Nemotron-70B-Instruct-HF	TSF	—	—	131K	—
Llama-3.1-Swallow-8B-Instruct-v0.5	TSF	—	—	131K	—
Llama-3.1-8B-Instruct	TSF	—	—	131K	—
Meta-Llama-3.1-8B-Instruct	TSF	—	—	131K	—

GET/v1/models/huggingface/meta-llama/Llama-3.1-70B-Instruct