MLC LLM Alternatives

MLC LLM is described as 'Machine learning compiler and high-performance deployment engine for large language models. The mission of this project is to enable everyone to develop, optimize, and deploy AI models natively on everyone’s platforms' and is a AI Chatbot in the ai tools & services category. There are more than 50 alternatives to MLC LLM for a variety of platforms, including Mac, Windows, iPhone, Android and Linux apps. The best MLC LLM alternative is Lumo by Proton, which is both free and Open Source. Other great apps like MLC LLM are ChatGPT, Ollama, Google Gemini and Claude.

Copy a direct link to this comment to your clipboard
Get a badge for your siteMLC LLM alternatives page was last updated

Alternatives list

  1. Poe icon
     76 likes

    Poe is a web-based AI platform that hosts multiple assistant bots—including Claude and various GPT and image/audio models—to provide conversational Q&A, image and audio generation, and automated AI workflows.

    401 Poe alternatives

    Cost / License

    • Freemium
    • Proprietary

    Platforms

    • Mac
    • Windows
    • Online
    • Android
    • iPhone
    • Android Tablet
    • iPad
     
  2. Maid (AI) icon
     17 likes

    Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
    • Android
    • Android Tablet
    • F-Droid
     
  3. Chatbox AI icon
     31 likes

    Unleash the power of artificial intelligence right at your fingertips with Chatbox, the versatile client application seamlessly integrated across all major platforms – Windows, Mac, Linux, Web, and iOS.

    126 Chatbox AI alternatives

    Cost / License

    Application types

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
    • Android
    • iPhone
    • Android Tablet
    • iPad
     
  4. llama.cpp icon
     8 likes

    The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.

    36 llama.cpp alternatives

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Windows
    • Mac
    • Linux
    • Docker
    • Homebrew
    • Nix Package Manager
    • MacPorts
    • Self-Hosted
     
  5. Apollo AI icon
     11 likes

    Customizable interface for private, on-device AI model chatting, open source and closed source LLM connections, OpenRouter support, custom backend support, and unified access to language models without reliance on a single provider, ensuring privacy and flexibility.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Mac
    • iPhone
    • iPad
    • Android
     
  6. Together Chat icon
     17 likes

    Together Chat is a next-generation consumer app designed to let you interact seamlessly with today's most popular open-source models, including free access to DeepSeek R1, securely hosted in the North America.

    166 Together Chat alternatives

    Cost / License

    • Free
    • Proprietary

    Application types

    Platforms

    • Online
    • Software as a Service (SaaS)
     
  7. fullmoon icon
     17 likes

    The simplest way to use private LLMs: Works fully offline and private when you don’t have internet. Runs models on-device optimized for Apple silicon.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • iPhone
    • iPad
    • visionOS
     
  8. nanochat icon
     12 likes

    Complete LLM chatbot implementation, offering tokenization, pretraining, finetuning, evaluation, inference, and a simple web UI. Runs on a single 8xH100 node, features a hackable codebase, dependency-lite design, and automates the full workflow via scripts.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
    • Self-Hosted
    • Python
     
You are at page 2 of MLC LLM alternatives