Cost / License
- Free
- Proprietary
Application type
Platforms
- Online
- L
- +20
How to know what your machine is capable of running?
Cost / License
- Free
- Open Source
Application type
Platforms
- Windows
- Mac
- Linux
AI-powered CLI that analyzes your hardware and recommends optimal LLM models you can run locally, with full Ollama integration.
Cost / License
- Free
- Open Source
Application type
Platforms
- Node.JS
- Windows
- Mac
- Linux
- JavaScript
What models? Top selection
Qwen.com is an interface to chat with Alibaba Qwen's Qwen series of models which are renowned for their huge context windows, generous free usage limits, reliability, and their continued tradition of being open-source.
Cost / License
- Freemium
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Online
- Android
- Self-Hosted
+1
A family of lightweight, state-of-the art open models built from the same research and technology that we used to create the Gemini models.
Cost / License
- Free Personal
- Open Source
Application typeApplication types
Platforms
- Windows
As part of Meta’s commitment to open science, today we are publicly releasing Llama (Large Language Model Meta AI), a state-of-the-art foundational large language model designed to help researchers advance their work in this subfield of AI.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
- BSD
- Self-Hosted
+3
What models? Worth trying
Project referring to gpt-oss-120b and gpt-oss-20b, two open-source (weight) language models by OpenAI.
Cost / License
- Free
- Open Source
Application type
Platforms
- Mac
- Windows
- Linux
- Online
DeepSeek is a state-of-the-art AI assistant designed to provide intelligent, conversational support across diverse tasks. It leverages advanced natural language processing and machine learning to answer questions, generate creative content, solve complex problems, and offer...
Cost / License
- Freemium
- Open Source
Application typeApplication types
Platforms
- Online
- Android
- iPhone
- Android Tablet
- iPad
+1
Private offline on-device local LLM app by Ente, open source code, no accounts or tracking, and works cross-platform on mobile and desktop devices.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
- Android
- iPhone
- Android Tablet
- iPad
As a fully open language model, Apertus allows researchers, professionals and enthusiasts to build upon the model and adapt it to their specific needs, as well as to inspect any part of the training process.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Online
- Self-Hosted
+1
What tools to use?
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.
Cost / License
- Free
- Open Source
Application type
Platforms
- Mac
If you're on a mac hardware don't use ollama, use oMLX, this will improve the performance by a significant margin.
OpenCode is a free, open-source AI coding assistant that helps you build, understand, and improve software projects. It works in the terminal, as a desktop app, and through IDE integrations, so you can use it in the environment that best fits your workflow.
Cost / License
- Free
- Open Source
Application type
Platforms
- Mac
- Windows
- Linux
Pretty much a Claude Code alternative with somewhat different toolset
The self-improving AI agent built by Nous Research. It's the only agent with a built-in learning loop — it creates skills from experience, improves them during use, nudges itself to persist knowledge, searches its own past conversations, and builds a deepening model of who...
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
- Android
- Self-Hosted
- Cloudron
- Docker
- Termux
An Open Source AI Agent (think Claude CoWork) that help you to automates engineering tasks seamlessly with local execution, customization, and autonomy, empowering developers with an extensible open-source platform.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
Personal AI assistant operating locally, supporting popular chat apps, additional channels, multi-OS speech and listening, and a live user-managed Canvas.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
- Android
- iPhone
- Android Tablet
- iPad
- Self-Hosted
- Cloudron
- Docker
- Node.JS
+3
Be careful, this is a security nightmare
Local AI agents on your Mac. Private, offline, free. Open models run on Apple Silicon; add ChatGPT, Claude or Gemini only when you choose.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
For macOS users that want simplicity this is a great user friendly mac-optimized option
Open-source offline AI chat software supporting local LLMs, cloud model connections, custom assistant creation, OpenAI-compatible API, and broad hardware support.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
- Online
- Flathub
- Flatpak
+3
If you just need a chatbot this is great
Facilitates local deployment of Llama 3, Code Llama, and other language models, enabling customization and offline AI development. Perfect for creating personalized AI chatbots and writing tools.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
Not as good as it is used. Pretty slow but usable
Run large language models offline with a built-in chat UI, OpenAI-compatible server, HuggingFace integration, local discovery, private model management.
Cost / License
- Free
- Proprietary
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
- Flathub
Qwen Code is an AI-powered command-line workflow tool designed for developers, adapted from Gemini CLI and optimized for Qwen3-Coder models.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Mac
- Windows
- Linux
Self-hosted AI interface enabling chat, autonomous agents, tool integration, email, and research with local data privacy—no telemetry or remote servers.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Self-Hosted
- Docker
Haven't tried PewDiePie's open source toolsuite but looks interesting. Worth checking out I guess.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Android
- iPhone
- Android Tablet
- iPad
+3
For mobile
The Swiss Army Knife of offline AI. Chat, speak, and generate images. Privacy first, zero internet. Download an LLM and use it on your mobile device. No data ever leaves your phone.
Cost / License
- Freemium
- Open Source
Platforms
- Android
- iPhone
- Mac
- Windows
+20
For Android
Hermes Agent is a mobile-first AI agent app from Nous Research for running local models and practical Android workflows on your phone.
Cost / License
- Free
- Open Source
Application type
Platforms
- Android
- F-Droid
Haven't tried this Android port of Hermes Agent but interesting
Run LLMs on device or connect to various commercial or open source APIs. ChatterUI aims to provide a mobile-friendly interface with fine-grained control over chat structuring.
Cost / License
- Free
- Open Source
Application typeApplication types
Platforms
- Android
For Android
Gu
Comments
This a really good curated list, thank you ;)
LM Studio perhaps? Works for MacOS
Yeah I should add it even if it's proprietary and that I never tried it myself.
You can add pocket pal. Its available for android and iphone: https://github.com/a-ghorbani/pocketpal-ai