Prompt Caching & Batch ROI CalculatorsMeta
Meta: Llama 3.1 70B Instruct Prompt Caching Calculator
Base Input Rate$0.72/M
Cache Hit Read$0.720/M(-0%)
Cache Write SurchargeFree (Automatic)
Output Rate$0.72/M
Simulation Parameters
Monthly Requests100,000
Input Tokens / Req8,000
Prompt Cache Hit Rate75%
Output Tokens800
Gross Uncached Cost$633.60
Net Bill$633.60
Cache Savings$0.00 (-0%)