Prompt Caching vs Context Window — and Why Most Devs Get This Wrong
中文摘要
缓存和上下文窗口是不同概念，多数开发者常混淆。
English Summary
Prompt caching and context windows are distinct, often confused by developers.
Original Excerpt
Okay so this is something I kept getting confused about when I started working more seriously with LLM APIs, and I see people mix these up… Continue reading on Medium »