Local LLM, Agent and AI to run on your hardware with no Cloud involved

Darlene Sonalder
Darlene SonalderList by Darlene Sonalder, last updated 
Copy a direct link to this comment to your clipboard
  1. How to know what your machine is capable of running?

  2. llmfit icon
     Like

    Hundreds of models & providers. One command to find what runs on your hardware.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Windows
    • Mac
    • Linux
    llmfit screenshot 1
  3. AI-powered CLI that analyzes your hardware and recommends optimal LLM models you can run locally, with full Ollama integration.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Node.JS
    • Windows
    • Mac
    • Linux
    • JavaScript
    LLM Checker screenshot 1
  4. What models? Top selection

  5. A family of lightweight, state-of-the art open models built from the same research and technology that we used to create the Gemini models.

    Cost / License

    • Free Personal
    • Open Source

    Platforms

    • Windows
    Google Gemma screenshot 1
    Google Gemma screenshot 1
    Google Gemma screenshot 2
  6. As part of Meta’s commitment to open science, today we are publicly releasing Llama (Large Language Model Meta AI), a state-of-the-art foundational large language model designed to help researchers advance their work in this subfield of AI.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD
    • Self-Hosted
    Meta Llama screenshot 1
    Meta Llama screenshot 1
    Meta Llama screenshot 2
    +3
    Meta Llama screenshot 3
  7. What models? Worth trying

  8. GPT OSS icon
     Like

    Project referring to gpt-oss-120b and gpt-oss-20b, two open-source (weight) language models by OpenAI.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
    GPT OSS screenshot 1
  9. DeepSeek icon
     Like

    DeepSeek is a state-of-the-art AI assistant designed to provide intelligent, conversational support across diverse tasks. It leverages advanced natural language processing and machine learning to answer questions, generate creative content, solve complex problems, and offer...

    Cost / License

    • Freemium
    • Open Source

    Platforms

    • Online
    • Android
    • iPhone
    • Android Tablet
    • iPad
    DeepSeek screenshot 1
    DeepSeek screenshot 1
    DeepSeek screenshot 2
    +1
    DeepSeek screenshot 3
  10. Ensu icon
     Like

    Private offline on-device local LLM app by Ente, open source code, no accounts or tracking, and works cross-platform on mobile and desktop devices.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • Android
    • iPhone
    • Android Tablet
    • iPad
    Ensu screenshot 1
    Ensu screenshot 1
    Ensu screenshot 2
    +1
    Ensu screenshot 3
  11. Apertus icon
     Like

    As a fully open language model, Apertus allows researchers, professionals and enthusiasts to build upon the model and adapt it to their specific needs, as well as to inspect any part of the training process.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Online
    • Self-Hosted
    Apertus screenshot 1
    Apertus screenshot 1
    Apertus screenshot 2
    +1
    Apertus screenshot 3
  12. What tools to use?

  13. oMLX icon
     Like

    If you're on a mac hardware don't use ollama, use oMLX, this will improve the performance.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    oMLX screenshot 1
    oMLX screenshot 1
  14. opencode icon
     Like

    Pretty much a Claude Code alternative with somewhat different toolset

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    opencode screenshot 1
  15. The self-improving AI agent built by Nous Research. It's the only agent with a built-in learning loop — it creates skills from experience, improves them during use, nudges itself to persist knowledge, searches its own past conversations, and builds a deepening model of who...

    Cost / License

    • Free
    • Open Source

    Platforms

    • Self-Hosted
    • Docker
    • Linux
    • Mac
    • Termux
    • Windows
    • Android
    Hermes Agent screenshot 1
  16. Goose OSS icon
     Like

    An Open Source AI Agent (think Claude CoWork) that help you to automates engineering tasks seamlessly with local execution, customization, and autonomy, empowering developers with an extensible open-source platform.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    Goose OSS screenshot 1
    Goose OSS screenshot 1
    Goose OSS screenshot 2
  17. OpenClaw icon
     Like

    Be careful, this is a security nightmare

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    • Windows
    • Linux
    • Android
    • iPhone
    • Android Tablet
    • iPad
    • Self-Hosted
    • Docker
    • Node.JS
    • Cloudron
    OpenClaw screenshot 1
    OpenClaw screenshot 1
    OpenClaw screenshot 2
    +3
    OpenClaw screenshot 3
  18. For Android

    Cost / License

    • Free
    • Open Source

    Platforms

    • Android
    Off Grid Mobile screenshot 1
    Off Grid Mobile screenshot 1
No comments so far, maybe you want to be first?
Gu