S

Sao10k

Llama 3.1 70B Hanami x1

This is [Sao10K](/sao10k)'s experiment over [Euryale v2.2](/sao10k/l3.1-euryale-70b).

Input / 1M tokens
$3.00
Output / 1M tokens
$3.00
Context window
16K tokens
Provider
Sao10k
Knowledge cutoff
2023-12-31

Performance

Median streaming throughput and first-token latency measured by Artificial Analysis.

Output tokens / sec
Time to first token