llama.cpp Alternatives

Apps similar to llama.cpp include ChatGPT, which has a free version. Other options are Ollama, Jan.ai, GPT4ALL and AnythingLLM. Large Language Model (LLM) Tools like llama.cpp are a crowded field, with more than 25 alternatives for Windows, Mac, Linux, Android and iPhone.

Copy a direct link to this comment to your clipboard
Alternatives
llama.cpp alternatives page was last updated

Alternatives list

  1. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.

    Cost / License

    Platforms

    • Windows
    • Linux
    • Docker
    • Snapcraft
    • iPhone
    • iPad
    • Self-Hosted
    • Python
    Good alternative?
     
  2. Nexa Studio icon
     2 likes

    Nexa Studio: Offline, Private AI with Unlimited Use.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Android
    Good alternative?
     
  3. RWKV Runner icon
     2 likes

    This project aims to eliminate the barriers of using large language models by automating everything for you. All you need is a lightweight executable program of just a few megabytes. Additionally, this project provides an interface compatible with the OpenAI API, which means...

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
    • Self-Hosted
    • Python
    Good alternative?
     
  4. A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.

    16 vllm-playground alternatives

    Cost / License

    Platforms

    • Python
    • Mac
    • Linux
    • Self-Hosted
    • Kubernetes
    • OpenShift
    Good alternative?
     
  5. cs.AI icon
     5 likes

    An honest AI assistant that grounds answers in real knowledge and live search — no hallucinations, no API key required. Works offline. Open source.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Mac
    Good alternative?
     
  6. Aether AI icon
     1 like

    A stunning, localized, general-purpose AI Agent for Android.

    Cost / License

    Application type

    Platforms

    • Android
    • Android Tablet
    Good alternative?
     
  7. Operit AI icon
     1 like

    📱 The first fully functional, standalone AI assistant for mobile devices with powerful tool-calling capabilities 📱

    70 Operit AI alternatives

    Cost / License

    Platforms

    • Android
    Good alternative?
     
  8. Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    • Android
    Good alternative?
     
  9.  2 likes

    A decentralized AI inference network where anyone can use cloud-sized models with local-grade privacy, or contribute hardware and get paid to power it.

    Cost / License

    Application type

    Platforms

    • Online
    • Windows
    • Android
    • Mac
    • iPhone
    • Linux
    • Self-Hosted
    • Docker
    • iPad
    • Android Tablet
    • Google Chrome
    • Mozilla Firefox
    • Chrome OS
    Good alternative?
     
  10. oxproxion icon
     Like

    oxproxion is a versatile and user-centric Android chat application designed to interact with various Large Language Models (LLMs). It provides a seamless interface for managing conversations, customizing bot personas, and saving chat histories.

    51 oxproxion alternatives

    Cost / License

    Platforms

    • Android
    • OpenAPK
    • F-Droid
    Good alternative?
     
  11. An offline AI assistant that runs entirely from a USB drive on Windows and macOS, with no internet connection, account, or subscription.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Windows
    • Mac
    Good alternative?
     
  12. HanFlow AI Bot takes work in one conversation: writing, images, PDF, Word, Excel and PPT files, calendar events, email drafts and code. Give it a bigger task and it works through each step, reporting back along the way.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Windows
    Good alternative?
     
You are at page 3 of llama.cpp alternatives