Caching and batch behavior
Performance
Caching
- Embeddings: 24h cache by default;
Embeddingopts out.Options:: no Cache () - Plain completion/chat: configuration
answer_opts in; off by default and subject to privacy and path restrictions.cache_ ttl - Vision: separate from the plain-answer cache path.
- Translation: The translator path opts in with a positive
Translationand needs the cache service. LLM translation and polishing also need a known model/configuration context for their cache key; other translators do not require a default LLM configuration. See Translation options.Options:: cache Ttl
Batch processing
Image arrays provide a convenient batch interface. Each image makes its own provider request, in order; batching does not reduce the number of requests.
Batch processing example
// One provider request per image, with results in the same order
$altTexts = $visionService->generateAltText($imageUrls);
Copied!