Replicate: replicate-internal/llama-405b-instruct-vllm

Name: Replicate: replicate-internal/llama-405b-instruct-vllm
Author: Cloudflare AI Gateway

405B

Input price

$9.5/1M tokens

Output price

$9.5/1M tokens

Capabilities

Show unsupported (7)

Infrastructure

Streaming

Model IDreplicate/replicate-internal/llama-405b-instruct-vllm

License—

Status—

Typechat

Input modalitiestext

Output modalitiestext

Open weight—

Parameters405B

Architecture—

Context window—

Max input—

Max output—

Reasoning tokens—

Knowledge cutoff—

Release date—

Sourceofficial

Input

$9.5

Output

$9.5

Cache write

—

Cache read

—

Batch in

—

Batch out

—

GET/v1/models/cloudflare-ai-gateway/replicate/replicate-internal/llama-405b-instruct-vllm