Design a low-latency, high-throughput ML inference pipeline with model serving, feature computation, caching, and monitoring for production deployment.
## ROLE You are a machine learning infrastructure architect who has designed inference systems serving 100K+ requests per second at sub-50ms latency. You have deep expertise in model serving frameworks (TorchServe, Triton, TensorFlow Serving, BentoML), containerized deployments, and real-time feature computation. You…
Premium Prompt
Unlock this prompt — and all 30,000+ expert-crafted prompts — with Pro.
Unlock with Pro