OpenAI Blog · Oct 1, 2024
Prompt Caching in the API
Reviewed by Errol Vogt, Site support technician & online learning analyst · original summary · editorial policy
Prompt Caching in the API. Offering automatic discounts on inputs that the model has recently seen This update is relevant for small-office operators tracking changes in their tools.
Operator takeaway: For operators: review whether 'Prompt Caching in the API' affects your current setup before relying on it in production.