Atomic Chat

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, on your machine.

Features:

Local models

• Run open-weight LLMs locally from HuggingFace — Llama, Gemma, Qwen, Mistral, Phi, and others
• Multi-Token Prediction (MTP) speculative decoding — 30–70% throughput boost on supported models, up to 3× on Gemma 4
• DFlash block-diffusion decoding — up to 6× faster on Qwen 3.6, Gemma 4, Kimi K2.5
• Flash Attention toggle (on / off / auto)
• Automatic reasoning-context tracking for chain-of-thought models
• Auto context-window expansion with overflow notifications
• EAGLE-3 speculative decoding for Gemma 4 on Apple Silicon (MLX)
• MTP on MLX for Qwen 3.5 / 3.6 and DeepSeek V4
• TurboQuant KV cache (turbo3 / turbo4) on llama.cpp — now on Windows & Linux too, not just macOS: up to ~4.3× smaller KV cache footprint, CPU and GPU (CUDA / Vulkan)
• TurboQuant KV cache on MLX-VLM — smaller memory footprint via RHT-correct fast paths

Cloud models

• Built-in providers: OpenAI, Anthropic, Mistral, Groq, MiniMax, Qwen, Moonshot
• Bring your own key, switch model per chat, mix local and cloud freely

Tools & integrations

• One-click agent launch — launch coding agents like Claude Code, Codex CLI, Cline, OpenCode, Droid, Goose, OpenHands, Copilot CLI, Kilo Code and Zed in one click from the Integrations tab
• Artifacts — live preview panel for HTML/CSS/JS code with copy, download and print
• Connect multiple MCP servers — bring your own tools, file access, web search
• Custom assistants with per-assistant system prompts
• Projects with conversation tree view in the sidebar

Local API

• OpenAI-compatible server at http://localhost:1337/v1 — drop-in replacement for the OpenAI SDK
• Works with any agent, CLI, or IDE plugin that speaks the OpenAI API
• Bound to 127.0.0.1 by default; set host: 0.0.0.0 to expose on LAN

Privacy

• Everything runs locally when you want it to — local server is loopback-only by default
• Your conversations and keys stay on your machine