Apps tagged with 'inference-server'

All apps in Apps tagged with 'inference-server' category. Use the filters below to narrow down your search.

oMLX
2 likes
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.
Cost / License
Free
Open Source (Apache-2.0)
Application type
Large Language Model (LLM) Tool
Origin
South Korea
Platforms
Mac
Best alternatives are DeepSeekandOllama
51 alternatives