Apps with 'Llama CPP' feature

All apps in Apps with 'Llama CPP' feature category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. llama.cpp icon
     10 likes

    The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Windows
    • Mac
    • Linux
    • Docker
    • Homebrew
    • Nix Package Manager
    • MacPorts
    • Self-Hosted
    • BG flagBulgaria
    • European Union flagEU
    Open and start using the WebUI in your browser
    Add multiple text files from disk or from the clipboard to the context of your conversation
    Attach one or multiple PDFs to your conversation. By default, the contents of the PDFs will be converted to RAW text, excluding any visuals.
    +10
    Optionally, the WebUI can process the PDFs as images when the AI model supports it.
    40 alternatives
  2. hax icon
     9 likes

    A minimalist, terminal-native coding agent. A single native C binary that uses a few MBs of RAM. Local models are first-class via llama.cpp and Ollama; also OpenAI, Anthropic, OpenRouter, and Codex.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Mac
    • Linux
    • BSD
    • FreeBSD
    • Homebrew
    • OpenBSD
    • UA flagUkraine
    hax screenshot 1
    12 alternatives
  3.  6 likes

    The Swiss Army Knife of offline AI. Chat, speak, and generate images. Privacy first, zero internet. Download an LLM and use it on your mobile device. No data ever leaves your phone.

    Cost / License

    • Freemium
    • Open Source (MIT)

    Platforms

    • Android
    • iPhone
    • Mac
    • Windows
    • IN flagIndia
    Off Grid AI screenshot 1
    Off Grid AI screenshot 1
    Off Grid AI screenshot 2
    +20
    Off Grid AI screenshot 3
    80 alternatives
  4. Twinny icon
     9 likes

    The most no-nonsense locally hosted (or API hosted) AI code completion plugin for Visual Studio Code, like GitHub Copilot but 100% free and 100% private.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Alerts

    • Discontinued

    Platforms

    • Windows
    • Mac
    • Linux
    • Visual Studio Code
    Twinny in action
    Twinny in action
    74 alternatives
  5. Atomic Chat icon
     4 likes

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • Android
    • iPhone
    • iPad
    • Android Tablet
    Atomic Chat screenshot 1
    Atomic Chat screenshot 2
    Atomic Chat screenshot 3
  6. SmolChat icon
     2 likes

    SmolChat allows you to download and run popular LLMs on your Android device, locally, without needing an internet connection. Customize the model used for each chat, tune settings like temperature and min-p, and pin your favourite chats on the home-screen with shortcuts.

    Cost / License

    Platforms

    • Android
    • IN flagIndia
    SmolChat screenshot 1
    SmolChat screenshot 2
    SmolChat screenshot 3
    50 alternatives
  7. AI Playground icon
     3 likes

    This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Windows
    • US flagUnited States
    AI Playground screenshot 1
    AI Playground screenshot 1
    24 alternatives
  8. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.

    Cost / License

    Platforms

    • Windows
    • Linux
    • Docker
    • Snapcraft
    • iPhone
    • iPad
    • Self-Hosted
    • Python
    • US flagUnited States
    Lemonade Server screenshot 1
    Lemonade Server screenshot 1
    Lemonade Server screenshot 2
    +1
    Lemonade Server screenshot 3
    17 alternatives
  9. LocalChat icon
     4 likes

    Chat with generative language models locally on your computer with zero setup. LocalChat is a simple, easy to set up local AI chat built on top of llama.cpp. It requires no technical knowledge and enables users to experience ChatGPT-like behavior on their own machines — fully...

    Cost / License

    Application type

    Platforms

    • Windows
    • Mac
    • Linux
    • DE flagGermany
    • European Union flagEU
    A first impression of the app interface, with a single model loaded, showing one output the model generated.
    5 alternatives
  10. Otis is an open-source personal AI agent with a native desktop app, an OpenTUI terminal interface, and a headless mode for scripts and CI. Use it for everyday work, from planning a trip and drafting an email to exploring a codebase and fixing a bug.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Linux
    • US flagUnited States
    Otis AI Agent screenshot 1
    37 alternatives
  11. Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
    node-llama-cpp screenshot 1
    21 alternatives
  12. Cortex.cpp icon
     1 like

    Cortex is the open-source brain for robots: vision, speech, language, tabular, and action -- the cloud is optional.

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    • SG flagSingapore
    Cortex.cpp screenshot 1
    Cortex.cpp screenshot 1
    10 alternatives
  13. Serge icon
     1 like

    Serge is a chat interface crafted with llama.cpp for running GGUF models. No API keys, entirely self-hosted!

    Cost / License

    Platforms

    • Online
    • Self-Hosted
    • Docker
    Serge screenshot 1
    3 alternatives
  14. Floneum icon
     1 like

    Floneum allows you to build workflows that use large language models with a simple drag and drop interface.

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    Floneum screenshot 1
  15. TranscrIA icon
     Like

    Self-hosted meeting transcription portal — speech-to-text, speaker diarization, LLM-corrected transcripts, structured summaries and Word minutes, on your own GPUs. Flask + PostgreSQL, GDPR audit trail, distributed GPU topologies, docker.

    Cost / License

    Platforms

    • Self-Hosted
    • Linux
    • Docker
    Overview
    Users Jobs
    system
    +11
    Shedule ressource
    10 alternatives
  16. AGiXT icon
     Like

    AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Self-Hosted
    • Docker
    • Mac
    • Windows
    • Linux
    • Python
    AGiXT screenshot 1
    AGiXT screenshot 1
    AGiXT screenshot 2
    13 alternatives
  17. Cogitae icon
     Like

    Cogitae is a native macOS AI workspace. It connects to your own accounts at Anthropic, OpenAI, Google, xAI, Mistral, DeepSeek, OpenRouter, or any OpenAI-compatible server, and runs local models through llama.cpp and MLX.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Mac
    • iPhone
    • iPad
    • US flagUnited States
    MCP server settings: add local (stdio) and remote (HTTP) servers without editing a config file, with live connection status and tool counts. Cogitae also runs its own MCP server so other clients can use its tools.
    A research agent answering a question with the DeepWiki MCP server. The agents panel shows each agent's model, cost and last tool call; the conversation graph is on the right.
     Census figures looked up on the web and shown as a bar chart. The conversation is branched, so the same prompt was asked for Canada and for Australia; switch branches from the popup or the graph.
    16 alternatives
  18. A free, open-source app to discover, run, and use AI models on your own computer, with hardware-aware recommendations, easy setup, and advanced controls when needed.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    Connect Harness Studio to your favorite AI applications and developer tools. Access OpenAI- and Anthropic-compatible API endpoints for chat, embeddings, and more, with easy integration and flexible connection options.
    Take full control of your AI models with advanced context and memory settings, automatic hardware-aware configuration, and real-time performance monitoring. Track GPU and RAM usage, inference speed, and server activity while accessing detailed logs and runtime controls in one place.
    Organize and manage all your AI models in one place. Browse models by type, including chat, vision, embeddings, speech, and image generation. View hardware compatibility, model sizes, and runtime status, find duplicates, and quickly load, switch, or manage models with an intuitive interface.
    +4
    Manage AI inference engines with ease. Harness Studio automatically detects your hardware, recommends compatible acceleration backends such as CUDA, Vulkan, or Metal, and helps you install and update runtimes. Advanced users can select custom binaries, manage versions, and roll back updates when needed.