Apps tagged with 'inference-server'

All apps in Apps tagged with 'inference-server' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. oMLX icon

    oMLX

     Like

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar.

    Cost / License

    Platforms

    • Mac
    oMLX screenshot 1
    oMLX screenshot 1
    51 alternatives