Meta-Llama-3-8B-Instruct-FP8-KV

Name: Meta-Llama-3-8B-Instruct-FP8-KV
Author: Hugging Face

Context

Capabilities

Show unsupported (6)

Reasoning & Interaction

Tool Calling

Infrastructure

Streaming

Details

Model IDRedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

ProviderHugging Face

Creatorredhatai

FamilyLlama-3

License—

Status—

Typechat

Input modalitiestext

Output modalitiestext

Open weight—

Parameters8B

Architecturetransformer

Context window8K tokens

Max input—

Max output—

Reasoning tokens—

Knowledge cutoff—

Release date2024-05-20

Sourceofficial

Tools

Function Callingfunction_calling

Call external functions and APIs

Family Comparison: Llama-3

Model	Caps	Perf	Speed	Context	Max out
Llama-3-8b-Ita	TSF	—	—	8K	—
Meta-Llama-3-8B-Instruct-abliterated-v3	TSF	—	—	8K	—
Llama-3-8B-Instruct-Gradient-1048k	TSF	—	—	1.0M	—
Llama-3-8B-Instruct-RR	TS	—	—	8K	—
Meta-Llama-3-70B-Instruct	TSF	—	—	8K	8K
Meta-Llama-3-8B-Instruct	TSF	—	—	8K	8K
Meta-Llama-3-70B-Instruct	TSF	—	—	8K	—
Meta-Llama-3-8B-Instruct	TSF	—	—	8K	—
Llama-3-Patronus-Lynx-8B-Instruct-v1.1	TSF	—	—	131K	—
Meta-Llama-3-8B-Instruct-FP8-KV	TS	—	—	8K	—
Llama-3-Swallow-8B-Instruct-v0.1	TSF	—	—	8K	—
Llama-3-SauerkrautLM-8b-Instruct	TSF	—	—	8K	—
Llama-3-Taiwan-8B-Instruct	TSF	—	—	8K	—

API

GET/v1/models/huggingface/RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Meta-Llama-3-8B-Instruct-FP8-KV

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Changes · 3 entries

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KVupdateb301ebeMar 23, 2026, 11:47 PM

modalitiesinput["text"]output["text"]

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KVupdate2b100acMar 23, 2026, 05:30 AM

capabilitiestool callyes

familyLlama-3

model_typechat

parameters8

page_urlhttps://huggingface.co/RedHatAI/Meta-Llama-3-8B-Instruct-...

release_date2024-05-20

context_window8192

architecturetransformer

tools["function_calling"]

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KVcreate7f5c66fMar 21, 2026, 05:16 AM