Tag

#streaming

11 posts

AI Application Performance: Stream First, Shrink the Context, Route the Model

AI Application Performance: Stream First, Shrink the Context, Route the Model

LLM applications have two performance budgets that classic backends don’t worry…

Apache Kafka — The Distributed Log, End to End

Apache Kafka — The Distributed Log, End to End

Apache Kafka runs the event backbone of a huge fraction of modern systems…

Design an Ad Click Aggregator

Design an Ad Click Aggregator

“Design the system behind an advertising dashboard” is a favourite analytics…

Design a Distributed Message Queue (Kafka)

Design a Distributed Message Queue (Kafka)

A message queue decouples producers from consumers: services publish events…