llama.cpp Alternatives

llama.cpp is described as 'The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud' and is a large language model (llm) tool in the ai tools & services category. There are more than 25 alternatives to llama.cpp for a variety of platforms, including Windows, Mac, Linux, Android and iPhone apps. The best llama.cpp alternative is ChatGPT, which is free. Other great apps like llama.cpp are Ollama, Jan.ai, GPT4ALL and AnythingLLM.

Copy a direct link to this comment to your clipboard
llama.cpp alternatives page was last updated

Alternatives list

  1. Operit AI icon
     1 like

    📱 The first fully functional, standalone AI assistant for mobile devices with powerful tool-calling capabilities 📱

    70 Operit AI alternatives

    Cost / License

    • Free
    • Open Source

    Platforms

    • Android
     
  2. LLM Hub icon
     1 like

    LLM Hub is an open-source Android app for on-device LLM chat and image generation. It's optimized for mobile usage (CPU/GPU/NPU acceleration) and supports multiple model formats so you can run powerful models locally and privately.

    21 LLM Hub alternatives

    Cost / License

    • Free
    • Open Source

    Platforms

    • Android
    • Android Tablet
     
  3. Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
     
  4. Thremark icon
     Like

    AI chat with real memory. Say something once — it knows forever. Every fact visible as a Mark you can edit or delete.

    51 Thremark alternatives

    Cost / License

    • Freemium
    • Proprietary

    Application types

    Platforms

    • iPhone
    • iPad
    • Online
     
You are at page 3 of llama.cpp alternatives