llama-swap 266

What's new in 266

This release includes security dependency updates and requested quality of life changes from users:
- the UI no longer expects to be run under a root path making it easier to serve llama-swap behind another proxy
- the max request size is configurable now. Users should be free to OOM as much as they want. llama-swap ain't your mom!
- allow manual override of values in /v1/audio/voices. This is a non-standard endpoint but makes working with upstream audio engines a bit nicer
Details below:
- PR #1224 cmd/kubeswap: attach DRA ResourceClaims and mount NFS volumes: add repeatable --resource-claim and NFS --volume support so Kubernetes backends can share a DRA GPU claim and mount models without a static PV and PVC for each export (#1222) by @gabrielcosi
- PR #1225 Add voices override for speech models: let local models configure capabilities.voices so /v1/audio/voices returns a reliable list without starting the model or querying the upstream server (#1207) by @mostlygeek
- PR #1228 ui,server: serve the UI under a reverse proxy base path: use relative asset, API and redirect paths so the UI works behind a prefix-stripping reverse proxy without routing its endpoints at the proxy root (#1227) by @mostlygeek
- PR #1249 internal/server: make the request body size limit configurable: add maxRequestBodyMB for model endpoints and Tailcat, replacing the fixed 250 MB cap while retaining 250 MB as the default (#1245) by @mostlygeek
- PR #1257 AGENTS.md, go.mod: use go 1.27.3, trim AGENT rules: raise the Go version to 1.27.3, update dependencies and simplify contributor instructions by @mostlygeek

Full release notes »