Open LLMs in Production — Serving, Quantization, Fine-Tuning and Cost
Open-weight language models have become genuinely good. Llama, Qwen, Mistral…
Tag
3 posts
Open-weight language models have become genuinely good. Llama, Qwen, Mistral…
A founder once told me, proudly, that self-hosting had cut their LLM costs by 8…
A fintech team I advised was about to sign a large annual contract with an LLM…