HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Tags litellm

Tag

litellm 1

Why I Kept My Own LLM Gateway over LiteLLM and 9Router Oct 6, 2026

Recently Updated

Why I Kept My Own LLM Gateway over LiteLLM and 9Router
Retry Storms: How Client Retries Turn a Short Dip into a Long Outage
The GIL Bottleneck Hiding in Self-Hosted LLM Serving
Open-weight LLMs are winning on cost, not benchmarks
The Transactional Outbox Pattern: Reliable Events Without Distributed Transactions

Trending Tags

go llm architecture inference kubernetes ci-cd cost-optimization data-structures databases json-schema

© 2026 Thuan Nguyen. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

go llm architecture inference kubernetes ci-cd cost-optimization data-structures databases json-schema

New content available