About Chaty
Chaty runs open large language models 100% locally. Chat with any GGUF model (llama.cpp, Vulkan GPU), use a local coding agent that can drive a real browser, ground answers in your own documents with a private knowledge base (RAG), generate cited Deep Research reports, and talk hands-free with offline voice. No account, no cloud, no telemetry.
What's new in 2.3.6
Long Code sessions keep their pace
An MLX model was given its whole trained context, whatever the
machine. Qwen3.6 35B-A3B on a 48 GB Mac got 262k tokens, and past
100k a Code session's cache outgrew the GPU's memory:decoding fell
from 26 to 3 tok/s and stayed there. The engine now measures what
the loaded model's cache costs per token and holds the context to
what memory can carry — 90k for that 35B, which ran at 24 to 29
tok/s up to the session's compaction. A long prompt is read in
chunks that fit, a step left with its tool call open no longer
makes the next one re-read the whole conversation (302 s at 86k
tokens), and a forward pass that breaks stops the reply instead of
writing noise.
Each conversation keeps its numbers
The context ring stays with its chat conversation or Code session —
after a switch, after a restart, and through a model change until
the next reply counts again — and chat's ring is now Code mode's,
the counts on hover. Deleting a conversation clears its numbers for
good, and chat shows how far a long prompt has been read, thinking
on or off.
Every source, in its own script
A web search is no longer held to six sources:every result on topic
goes in while it fits, folded into one line under the answer and
kept with it. Pages and files are read in their own character set —
GBK sites, Notepad's UTF-16, Big5 and Shift_JIS — instead of rows of
replacement characters.
Also:a model's README in the store reads as it does on Hugging
Face, and the store keeps its lists when Hugging Face cannot list
models; YuE2's instrumentals keep the voice out; a mouse wheel
glides on a Mac; a Code session exports as a full JSONL trace, and
Code's answers come set cleanly and without emoji.
<!-- Highlights go above this line, hand-written per release —
the release page is where people who found Chaty through a
model's name land, and a bare install table tells them
nothing about why this version exists. -->
Install
| Platform | File |
|---|---|
| Windows x64 | Chaty_*_x64-setup.exe — per-user installer, no admin |
| macOS (Apple Silicon) | Chaty_*_aarch64.dmg |
| Linux x64 (beta) | Chaty_*_amd64.AppImage — chmod +x and run |
macOS first launch — "Apple could not verify…" / "damaged"
Chaty is ad-hoc signed but not notarized (no paid Apple Developer
account), so Gatekeeper flags it on first launch. The app is safe —
everything runs locally. Clear the download quarantine once, in Terminal:
sh …
Full release notes »