We have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/drive/1Ys44kVvmeZtnICzWz0xgpRnrIOjZAuxp?usp=sharing
function_calling| Model | Context | Max out |
|---|---|---|
| Llama-3.1-8B-Instruct | 131K | — |
| Llama-3.1-70B-Instruct | 131K | 131K |
| Llama-3.1-8B-Instruct | 131K | 131K |
| Meta-Llama-3.1-8B-Instruct-abliterated | 131K | — |
| Meta-Llama-3.1-70B-Instruct | 131K | — |
| Meta-Llama-3.1-8B-Instruct | 131K | — |
| Llama-3.1-8B-Instruct-FP8 | 131K | — |
| Llama-3.1-Nemotron-70B-Instruct-HF | 131K | — |
| Llama-3.1-Swallow-8B-Instruct-v0.5 | 131K | — |
| Llama-3.1-8B-Instruct | 131K | — |
| Meta-Llama-3.1-8B-Instruct | 131K | — |
/v1/models/huggingface/unsloth/Meta-Llama-3.1-8B-InstructWe have a free Google Colab Tesla T4 notebook for Llama 3.1 (8B) here: https://colab.research.google.com/drive/1Ys44kVvmeZtnICzWz0xgpRnrIOjZAuxp?usp=sharing