Better prompt caching for GPT-6
中文摘要
GPT-6 优化了提示词缓存,通过提高命中率和引入新控制功能,有效降低了延迟与成本。
English Summary
GPT-6 enhances prompt caching with higher hit rates and new controls to reduce latency and costs.
Original Excerpt
Learn how GPT-6 improves prompt caching with higher cache hit rates, new diagnostics, explicit breakpoints, and controls that reduce latency and costs.