Ollama

I like Ollama because it integrates with Claude Code and never costs me tokens for minor bugs or feature additions. Cheers!

Ось короткий огляд у вашому стилі — від першої особи:

Ollama is one of the tools I recommend to anyone who wants to run AI models locally. I like how easy it is to download, switch between models, and keep everything on my own machine. If privacy, offline access, or experimenting with open-source LLMs matters to you, Ollama is an excellent place to start.

Ollama is one of the best ways to run AI models locally. I love the flexibility, privacy, and the ability to experiment with different models without relying on the cloud.

It works and it's free but honestly it is so slow I started to look to alternatives that offer better performances.

Installation of Ollama engine takes about 6gb on my system. I have it running with Phrase Express. Tray icon keeps disappearing, but CLI not needed after the setup. A lot of people think it runs slowly.. myself included, but they say it has to do with many factors.

Since it doesn't have a GUI, you need to get used to the command-line interface (the commands are similar in style to Git, if you're familiar with it). There are no customization options when loading models, and it only supports models in the GGUF format. However, even GGUF models don't work out of the box—you'll need to manually adjust or convert them before use, due to its custom model structure.

Because it's CLI-based, it can even be compiled and run on a phone using Termux or similar tools. That said, it lacks a 'Chat with Documents' feature, meaning it doesn’t include built-in tools for embedding your own documents or performing RAG-like operations. These have to be set up manually. So overall, it’s not very user-friendly, but it’s a minimal and lightweight choice for running LLM/AI models.