Directly quantized 4bit model with `bitsandbytes`.
function_calling
/v1/models/huggingface/unsloth/llama-3-8b-Instruct