Prompt Caching 与 Batch 投资回报计算器NVIDIA
NVIDIA: Nemotron 3 Nano 30B A3B Prompt Caching Calculator
Base Input Rate$0.06/M
缓存命中读取价$0.012/M(-80%)
Cache Write SurchargeFree (Automatic)
Output Rate$0.24/M
Simulation Parameters
月度请求量 (Requests)100,000
单次输入 Tokens (Input)8,000
Prompt 缓存命中率 (Cache Hit)75%
单次输出 Tokens (Output)800
未优化原始成本$67.20
实际净账单$38.40
缓存节省金额$28.80 (-43%)