LocalAI  icon
LocalAI  icon

LocalAI

 13 likes

Drop-In OpenAI replacement, On-device, local-first, Generate text/image/speech/music/etc... Backend Agnostic: (llama.cpp, diffusers, bark.cpp, etc...), Optional Distributed Inference(P2P/Federated).

Home Page

Cost / License

  • Free
  • Open Source (MIT)

Application type

Since

  • Since 2023

Updated

  • Updated Nov 2026

Releases

  • 49 releases last year49 last year

Platforms

  • Online
  • Self-Hosted
  • Cloudron
13likes
0articles
Save

Features

Properties

Features

Highlights All activities

LocalAI News & Activities

Recent News

No news, maybe you know any news worth sharing?

Share a News Tip

Recent activities

LocalAI information

AlternativeTo Categories

AI Tools & Services, Photos & Graphics

GitHub repository

  •  50,369 Stars
  •  4,605 Forks
  •  171 Open Issues
  •   Updated  
View on GitHub

Our users have written 1 comment or review about LocalAI , and it has gotten 13 likes.

LocalAI was added to AlternativeTo by 78jmb6dk on and this page was last updated .

Comments and Reviews

   
thiscouldbeyourusername
1

looks promising. has nice webpage. uses 1000% of your CPU just launching or downloading gpt models. unable to download large models because for some reason not using any AI but downloading the model requires full load aswell.

all I am pointing out: this feels really beta and is not working well. gpt4all was much better.

Featured in Lists

Best Offline & Self-Hosted AI Document Search Tools for Confidential Offices

A curated list of offline-first, local-network tools that let offices, law practices, and clinics search internal documents and PDFs with AI without sending confidential files to public cloud APIs
By AWWAL DAYYABU5 appsUpdated

Official Links

What is LocalAI ?

Drop-in replacement for OpenAI API, local/on-prem inference with consumer grade hardware, supporting multiple model families and backends that are compatible with standard formats like GGUF.

In a nutshell:

  • Local, OpenAI drop-in alternative REST API. You own your data.

  • NO GPU Required & Local/On-Device Inference (Offline).

  • Optional, GPU/NPU Acceleration is available in llama.cpp-compatible LLMs. See also the build section.

  • Model Inference Pipeline/Backend Agnostic! (install inference backends through Gallery WebUI or via the CLI)

  • Task Type's Supported:

  • Text generation (with llama.cpp, transformers, vllm, exllama2, gpt4all.cpp... and more)

  • Text to Audio:

  • Sound/Music generation (transformers-musicgen)

  • Speech generation (whisper, bark, piper, bark.cpp)

  • Speech to Text (i.e: transcription, with whisper.cpp, etc...)

  • Image generation with diffusers/stable-diffusion.cpp (text-to-image, image-to-image, etc...)

  • Text Embedding (with sentencetransformers, transformers)

  • Text Re-Ranking (rerankers, sentencetransformers)

  • Once loaded the first time, it keep models loaded in memory for faster inference

  • Distributed Inference (Federated and P2P mode)

Additional Notes:

  • Performance/Throughput can vary by inference pipeline chosen, you can use C/C++ based pipelines like llama.cpp for a faster inference and better performance read the LocalAI docs for the most up-to-date information.