Latency: TTFT, TPOT and Prefix CachingA product team reduced their chatbot’s total response time by 40% and users…