Llama 3.1 70B Instruct pricing

Llama 3.1 70B Instruct (meta/llama-3.1-70b) from meta on Zoo Gateway: $0.80 per million input tokens and $0.80 per million output tokens. Context window 128K. Prices are per million tokens through Zoo Gateway.

Llama 3.1 70B Instruct

meta/llama-3.1-70b

128K context

Input / 1M$0.80

Output / 1M$0.80

Cache / 1M—

Write / 1M—

125 t/s throughput

272ms TTFT