Kiln AI

Kiln is a workbench for the full AI development loop: evals, optimization, prompts, RAG, fine-tuning, synthetic data, agents, and tools - all working together. The desktop app lets your whole team contribute (PMs, subject-experts, and QA can rate outputs and add data without writing code). The MIT-licensed Python library ships the same tasks to production. Runs locally - bring your own API keys, or go fully offline with Ollama.

Highlights:

Iterate, optimize, and collaborate

• Intuitive app - Easy-to-use apps for Mac, Windows, and Linux. One-click install.
• Eval Builder - Auto-generate evals (judge + synthetic eval dataset), and align to your preference in ~10 minutes.
• Auto-Optimize - Automatically find the best way to run your AI task, optimizing prompt, model selection, tools, skills, subagents, parameters, and more.
• AI Assistant - Your AI data-science partner. Kiln Assistant proposes improvements, optimizes prompts, runs experiments, creates evals, and more.
• Git-native collaboration - The app syncs to Git automatically — even for teammates who don't know what Git is.

Build & ship agents

• RAG - Drag-and-drop docs (PDF, image, video, audio) to create a RAG. Auto-generated RAG evals from your own documents.
• Subagents - Compose multi-agent hierarchies. Each runs in its own focused context window.
• Synthetic Data Generation - Generate data for evals or fine-tuning in minutes.
• Fine-Tuning - Zero-code fine-tuning across 60+ models (Qwen, Llama, GPT, Gemini, …) on Fireworks, Together, and Vertex. Serverless deployment included.
• Open Python library - Agents built in the app can be deployed to production. MIT open-source.
• …and more - Tools & MCP, Skills, structured outputs, reasoning models, model library (190+ tested).