Wake up the NPU on your device
Keywords: Copilot+, DireML, Windows AI APIs (Windows)
The latest Windows update with a redesigned Start menu, Widgets integration, Xbox gaming features, and tighter security requirements, built with modern hardware in mind.
Features like Studio Effects, Live Captions, Click to Do, etc.
Learn how to add AI with local models and APIs to Windows apps. Discover AI scenarios and models such as Phi, Mistral, Stable Diffusion, Whisper, and many more to delight your users. The AI Dev Gallery is an open-source app designed to help Windows developers integrate AI...
Run AI models locally on your device. Foundry Local provides on-device inference with complete data privacy, no Azure subscription required.
AMD, Intel, Qualcomm: https://learn.microsoft.com/en-us/azure/foundry-local/get-started#prerequisites
Search past activities with text recognition and visual analysis via timeline scrolling and deep links, secured by local processing and encryption.
Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.
Experience the power of RWKV models directly on your device. Completely offline, privacy-first, and efficient. No internet required.
Apple, MediaTek, Qualcomm: https://github.com/MollySophia/rwkv-mobile#supported-or-planned-backends
The Swiss Army Knife of offline AI. Chat, speak, and generate images. Privacy first, zero internet. Download an LLM and use it on your mobile device. No data ever leaves your phone.
SuperImage is a neural network based image upscaling application for Android built with the MNN deep learning framework and Real-ESRGAN.
MediaTek & Qualcomm: https://superimage.io/compatibility
Start a stream or record your next video in a few taps – hone your scenes, connect a camera, and start creating with ease.
Free video editor with multi-track timeline, trimming, advanced filters, stickers, licensed music, auto-captions, export in 4K 60fps, and seamless platform sharing.
AMD, Intel & Qualcomm: https://www.capcutpro.net/2025/12/capcut-pc-version-review-2026.html
RAW photo editor with AI tools like GenErase and GenExpand, supports focus stacking, HDR merging, and is compatible with top editing software.
Keywords: Ryzen AI, XDNA, GAIA, VitisAI
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.
Run LLMs on AMD Ryzen™ AI NPUs in minutes. Just like Ollama - but purpose-built and deeply optimized for the AMD NPUs.
Keywords: Neural Engine (ANE), Core ML
Neural Accelerators introduced in Apple10 architecture (A19 / M5) is related, but strictly speaking it's part of GPU, and it's called with MLX or Metal/MPS
https://github.com/cactus-compute/cactus#roadmap
Coming to more NPUs
Draw Things provides a comprehensive but still easy-to-use, mobile and desktop solution for AI-based art generation. It packs all the power of Stable Diffusion into a sleek, iOS and Mac app that lets you create, upscale and edit AI art, totally offline, free and privacy safe.
https://engineering.drawthings.ai/p/integrating-metal-flashattention-accelerating-the-heart-of-image-generation-in-the-apple-ecosystem-16a86142eb18 https://docs.drawthings.ai/documentation/documentation/7.coreml
Also support latest tech like Metal FlashAttention 2.5 w/ Neural Accelerators: https://releases.drawthings.ai/p/metal-flashattention-v25-w-neural
Generate images from text using Stable Diffusion 1.5. Simply describe the image you desire, and the app will generate it for you like magic!
Diffusers is a native Mac app to generate images from a text description of what you want. It uses state-of-the-art models contributed by the community to the Hugging Face Hub, optimized and converted to Core ML for maximum performance.
This app uses Apple's Core ML Stable Diffusion implementation to achieve maximum performance and speed on Apple Silicon based Macs while reducing memory requirements.
A Stable Diffusion app for macOS built with SwiftUI and Apple's ml-stable-diffusion CoreML models.
Transcribes speech instantly with local AI for near-perfect accuracy and privacy, featuring real-time native macOS support and user-provided AI enhancements.
A versatile studio for live streaming and recording, supporting all major platforms with features like scene presets and simultaneous multi-output streaming.
Real-time voice dictation for Mac with instant transcription, customizable shortcuts, advanced voice recognition, no data collection, and broad compatibility.
Work faster with an AI tool that allows you to work with text or code, use task-specific AI assistants, learn, create content faster, and more. With its streamlined chat interface and rich prompt library, BoltAI makes your AI experience smooth and streamlined.
Offline speech-to-text tool for macOS focused on privacy, optimized for Apple Silicon, lightweight with less than 200MB RAM, no subscription, and compatible with all apps.
Transforms speech into text instantly with local processing for privacy, zero delay, no internet required, fully open-source code, and AI post-processing.
Powerful photo editing and organizing with cloud backup, available on multiple devices including mobile, web, and desktop.
Desktop-based photo editing software with advanced controls, offering tools for enhancing, organizing, and sharing photos. Includes new masking tools and Content-Aware Remove.
Keywords: Core Ultra, Intel AI boost, OpenVINO
This application provides a full suite of generative AI features for chat, code assistance, document search, image analysis, image and video generation. All features run offline and are powered by your PC’s Intel® Core™ Ultra with built-in Intel Arc GPU or Intel Arc™ dGPU...
FastSD CPU is a faster version of Stable Diffusion on CPU. Based on Latent Consistency Models and Adversarial Diffusion Distillation.
Nonlinear video editor with customizable timeline, multi-format import, and accelerated rendering for fast editing performance.
Free open-source multi-track audio editor and recorder with 32-bit float processing. Supports many formats and plugins for Windows, macOS, Linux.
Free open-source 3D software for modeling, texturing, rigging, animation, rendering, compositing, video editing, and simulation.
AI-powered tool for screen recording, editing, and exporting in MP4/GIF with features like zoom effects, voice enhancement, and auto captions.
Free open-source suite with advanced photo retouching, composition, batch processing, plugin extensibility, custom scripting, and wide file format compatibility.
Keywords: Hexagon, Qualcomm AI Engine Direct (QNN)
The main goal of llama.cpp is to enable LLM inference with minimal setup and state-of-the-art performance on a wide range of hardware - locally and in the cloud.
Privacy-focused open-source chatbot enables unlimited document uploads, multi-user support, vector database integration, and intelligent chat from existing files.
Run Stable Diffusion on Android Devices with Snapdragon NPU acceleration. Also supports CPU/GPU inference.
LLM Hub is an open-source Android app for on-device LLM chat and image generation. It's optimized for mobile usage (CPU/GPU/NPU acceleration) and supports multiple model formats so you can run powerful models locally and privately.
Introducing Layla, the groundbreaking personal AI that resides directly on your phone or device. No internet connection required, no censorship, complete privacy. No information leaves your device.
An Android application for super-resolution & interpolation. Contains RealSR-NCNN, SRMD-NCNN, RealCUGAN-NCNN, Real-ESRGAN-NCNN, Waifu2x-NCNN, Anime4kcpp, nearest, bilinear, bicubic, AVIR...
Get the #1 DJ app, seamlessly integrated with Apple Music, and available on all major platforms - iOS, Mac, Windows, Android, Vision Pro, and Meta Quest. Download for free on mobile and desktop to unlock pro-level DJ tools, perfect for beginners learning to mix music and...
Advanced video editing and color correction with integrated visual effects, motion graphics, and audio post-production tools, used by professionals.
Utilizes AI tech for creative video production. Advanced audio editing with SOUND FORGE Pro. Enables mobile video upload and cloud collaboration.
Focusing on NPUs integrated in SoCs, yet not including discrete NPUs like Google TPU, Huawei Ascend NPU, etc.
No comments so far, maybe you want to be first?
