Prompt Caching & Batch ROI CalculatorsMeta
Meta: Llama 3.1 8B Instruct Prompt Caching Calculator
Base Input Rate$0.02/M
Cache Hit Read$0.020/M(-0%)
Cache Write SurchargeFree (Automatic)
Output Rate$0.04/M
Simulation Parameters
Monthly Requests100,000
Input Tokens / Req8,000
Prompt Cache Hit Rate75%
Output Tokens800
Gross Uncached Cost$19.20
Net Bill$19.20
Cache Savings$0.00 (-0%)