NPU-powered apps

Wake up the NPU on your device

bu
bugmenotList by bugmenot, last updated 
Copy a direct link to this comment to your clipboard
  1. Multiple

    Keywords: Copilot+, DireML, Windows AI APIs (Windows)

  2. Features like Studio Effects, Live Captions, Click to Do, etc.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Windows
    Windows 11 screenshot 1
    Windows 11 screenshot 1
    Windows 11 screenshot 2
    +2
    Windows 11 screenshot 3
  3. Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...

    Cost / License

    • Free
    • Open Source

    Platforms

    • Windows
    AI Dev Gallery screenshot 1
    AI Dev Gallery screenshot 1
    AI Dev Gallery screenshot 2
    +1
    AI Dev Gallery screenshot 3
  4. AMD

    Keywords: Ryzen AI, XDNA, GAIA, VitisAI

  5. Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Windows
    • Linux
    • Docker
    • Snapcraft
    • iPhone
    • iPad
    • Self-Hosted
    • Python
    Lemonade Server screenshot 1
    Lemonade Server screenshot 1
    Lemonade Server screenshot 2
    +1
    Lemonade Server screenshot 3
  6. Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.

    Cost / License

    • Free Personal
    • Open Source

    Platforms

    • Windows
    • Online
    • Self-Hosted
  7. AmuseAI icon
     Like

    Create AI art, with the latest Stable Diffusion models, on your own PC.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Windows
    AmuseAI screenshot 1
  8. Apple

    Keywords: Neural Engine (ANE), Core ML

    Neural Accelerators introduced in Apple10 architecture (A19 / M5) is related, but strictly speaking it's part of GPU, and it's called with MLX or Metal/MPS

  9. Generate images from text using Stable Diffusion 1.5. Simply describe the image you desire, and the app will generate it for you like magic!

    Cost / License

    • Free
    • Proprietary

    Application type

    Platforms

    • Mac
    • iPhone
    • iPad
    Amazing AI screenshot 1
  10. Diffusers icon
     Like

    Diffusers is a native Mac app to generate images from a text description of what you want. It uses state-of-the-art models contributed by the community to the Hugging Face Hub, optimized and converted to Core ML for maximum performance.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Mac
    Diffusers screenshot 1
    Diffusers screenshot 1
    Diffusers screenshot 2
    +1
    Diffusers screenshot 3
  11. This app uses Apple's Core ML Stable Diffusion implementation to achieve maximum performance and speed on Apple Silicon based Macs while reducing memory requirements.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Mac
    Mochi Diffusion screenshot 1
  12. Gauss icon
     Like

    A Stable Diffusion app for macOS built with SwiftUI and Apple's ml-stable-diffusion CoreML models.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Mac
    Gauss screenshot 1
  13. Intel

    Keywords: Core Ultra, Intel AI boost, OpenVINO

  14. This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...

    Cost / License

    • Free
    • Open Source

    Platforms

    • Windows
    AI Playground screenshot 1
    AI Playground screenshot 1
  15. Qualcomm

    Keywords: Hexagon, Qualcomm AI Engine Direct (QNN)

  16. Run Stable Diffusion on Android Devices with Snapdragon NPU acceleration. Also supports CPU/GPU inference.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Android
    Local Dream screenshot 1
    Local Dream screenshot 1
    Local Dream screenshot 2
    +1
    Local Dream screenshot 3
  17. LLM Hub icon
     Like

    LLM Hub is an open-source Android app for on-device LLM chat and image generation. It's optimized for mobile usage (CPU/GPU/NPU acceleration) and supports multiple model formats so you can run powerful models locally and privately.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Android
    • Android Tablet
    LLM Hub screenshot 1
    LLM Hub screenshot 1
    LLM Hub screenshot 2
    +7
    LLM Hub screenshot 3
Page 1 of 2

Focusing on NPUs integrated in SoCs, yet not including discrete NPUs like Google TPU, Huawei Ascend NPU, etc.

No comments so far, maybe you want to be first?
Gu