production-llm-blueprint

Designs layered production architectures for LLM applications, covering an API gateway with rate limiting and auth, cost-aware model routing with fallback chains, retrieval-based context assembly, observability with traces and per-model metrics, and tiered caching. Use when planning, reviewing, or scaling a production AI service, deciding how to split requests across models, or adding resilience and monitoring to an existing LLM backend. Not for model training or fine-tuning, prompt copywriting, or throwaway single-script prototypes.

Version

v1.0.0

Size

13 KB

Updated

2026-10-10

Your client verifies the signature before reading. This explicit manual read is available on every plan. Free automatically loads five chosen skills; paid plans automatically load relevant skills across the library.