menu_bookGyanByte

Tag

mlops

2 posts

Open LLMs in Production — Serving, Quantization, Fine-Tuning and Cost

Open LLMs in Production — Serving, Quantization, Fine-Tuning and Cost

Open LLMs in Production — Serving, Quantization, Fine-Tuning and Cost

Open-weight language models have become genuinely good. Llama, Qwen, Mistral…

Scaling on Kubernetes

A team moved their working single-GPU LLM service onto Kubernetes for…