Apps tagged with 'mac-llm'

All apps in Apps tagged with 'mac-llm' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. vMLX icon

    vMLX

     Like

    vMLX provides functions no other MLX inferencing app does, including LM Studio, from KV Cache Quantization (save 2-4x the RAM), Prefix Caching, and full VL support.

    Cost / License

    • Free
    • Proprietary

    Application type

    Platforms

    • Mac
    Chat
    Inferencing Settings + 5 layer cache
    10 alternatives