llama.cpp Alternatives

Apps similar to llama.cpp include ChatGPT, which has a free version. Other options are Ollama, Jan.ai, GPT4ALL and AnythingLLM. Large Language Model (LLM) Tools like llama.cpp are a crowded field, with more than 25 alternatives for Windows, Mac, Linux, Android and iPhone.

Copy a direct link to this comment to your clipboard
Alternatives
llama.cpp alternatives page was last updated

Alternatives list

  1. Voelori icon
     Like

    A local-first Windows AI ecosystem: a multi-module workspace, a persistent AI agent, and a voice assistant. Runs offline. One-time purchase, no subscription.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Windows
    Good alternative?
     
  2. Thremark icon
     Like

    AI chat with real memory. Say something once — it knows forever. Every fact visible as a Mark you can edit or delete.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • iPhone
    • iPad
    • Online
    Good alternative?
     
  3. Janus is a single Go binary that runs .gguf models on your machine and exposes an OpenAI-compatible API. Point Cursor, Cline, or any local or cloud LLM, or AI tool with compatible OpenAI API endpoints at localhost — no Python, no Docker.

    9 Janus API Router alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Linux
    • Mac
    Good alternative?
     
  4. Parallely is a visual canvas for parallel AI exploration. Instead of a linear chat, you ask one question and Parallely "refracts" it into multiple parallel angles - definitions, applications, critiques, diagrams - streamed live onto an infinite canvas.

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Online
    Good alternative?
     
You are at page 4 of llama.cpp alternatives