openchat-3.6-8b-20240522

Name: openchat-3.6-8b-20240522
Author: Hugging Face

llama38B

To use this model, we highly recommend installing the OpenChat package by following the installation guide in our repository and using the OpenChat OpenAI-compatible API server by running the serving command from the table below. The server is optimized for high-throughput deployment using vLLM and can run on a consumer GPU with 24GB RAM.

Context

Snapshotsopenchat/openchat-3.6-8b-20240522

Capabilities

Show unsupported (5)

Reasoning & Interaction

Tool Calling

Infrastructure

Streaming

Fine-tuning

Details

Model IDopenchat/openchat-3.6-8b

ProviderHugging Face

Creatoropenchat

Family—

Licensellama3

Status—

Type—

Input modalities—

Output modalities—

Open weightYes

Parameters8B

Architecturetransformer

Context window8K tokens

Max input—

Max output—

Reasoning tokens—

Knowledge cutoff—

Release date2024-05-07

Sourceofficial

Tools

Function Callingfunction_calling

Call external functions and APIs

API

GET/v1/models/huggingface/openchat/openchat-3.6-8b