Dev48
Language
  • About
  • Services
  • Industries
  • Technologies
  • Articles
  • Contacts
Book a call
    Home/Articles/Amd x unsloth unlocking the worlds first npu for unsloth desktop
Dev48
info@dev48.org+375 29 320-40-96WhatsApp@isky_by

© 2026 · All rights reserved.

AMD x Unsloth: Unlocking the World's First NPU for Unsloth Desktop

Source: AMD•November 20, 2026 at 12:04 AM

AMD x Unsloth: Unlocking the World's First NPU for Unsloth Desktop

AMD XDNA™ 2 brings the world’s first NPU support to Unsloth Desktop. Unlock 100+ agentic apps with local AI inference powered by Lemonade and FLM.

AI agents are becoming part of how people work. Bringing them onto the PC demands more than capable models. It takes hardware and software built to work together.

AMD and Unsloth have collaborated to bring NPU support to Unsloth Desktop, making AMD XDNA™ 2 architecture NPUs the world’s first NPUs supported by the application. Enabled through integration with Lemonade and FastFlowLM (FLM), this collaboration connects Unsloth’s user ecosystem with dedicated NPU acceleration.

It’s a new way to put the NPU to work: running agent inference locally, efficiently, and through familiar applications.

One AMD NPU. 100+ Agentic Apps

The impact reaches beyond a single application. Through the Unsloth Desktop API, which offers an OpenAI compliant endpoint for compatible apps, the integration opens the door to more than 100 agentic applications and workflows.

Tools including Hermes Agent, OpenClaw, Open WebUI, Cline, OMP, and VS Code illustrate the breadth of that ecosystem, from coding assistance to connected agent workflows. Applications access local model inference through the Unsloth Desktop API, while Lemonade and FLM handle the serving and inference path to AMD XDNA™ 2 NPUs.

Together, AMD and Unsloth are expanding where developers can deploy agent workloads and how users can experience local AI.

Unplug your Agents

As agents take on more work, power efficient execution becomes increasingly important.

AMD XDNA™ 2 NPUs are designed for power-efficient AI inference. Offloading supported inference workloads to this dedicated engine can help preserve battery life and leave CPU and GPU resources available for other applications (memory permitting).

For users, that means a foundation for agent experiences that fit the way they use their PCs, including when working unplugged and getting more out of their battery. For developers, it creates another execution option for bringing local AI into everyday workflows - enabling low power, persistent agents.

How to run Unsloth Desktop on the AMD XDNA™ 2 NPU

1. On an AMD device with an XDNA™ 2 NPU, download Unsloth Desktop for Windows and install.

2. Go to the model hub page, click on the filter sign, select the NPU from the drown down list.

3. Click on Enable NPU

4. Download the NPU model you want to run. Note: different models have different memory requirements. For example the Qwen 3.6 35B A3B model with full context requires around 28GB of memory available to the NPU. Using windows default 50% shared allocation - this means your system needs to have 64GB of system ram.

5. Wait for the download to complete (if it seems stuck - it is not) then go back to New Chat, and from the drop down menu, scroll till you find the "NPU" section, load the model with the context you want and you are now inferencing on the NPU!

Realtime Demo: 35B MoE on the AMD XDNA™ 2 NPU

The demo shows this integration in action: a Qwen3.6 mixture-of-experts model with 35 billion total parameters running local inference through Unsloth Desktop and FLM on the AMD NPU.

It brings the collaboration into focus: Unsloth’s accessible software experience connected to AMD NPU.

By working across hardware, inference software, and the application ecosystem, AMD and Unsloth are making NPU acceleration useful to more developers and users.

More applications. Efficient local inference. New possibilities for agentic AI on the PC.

← All articles

What this article says

More in Hardware & Electronics

All →
Nokia powers CMC Networks’ EMEA-R corridor, connecting key hubs across Europe, the Middle East and Africa
Nokia

Nokia powers CMC Networks’ EMEA-R corridor, connecting key hubs across Europe, the Middle East and Africa

Lumentum CEO defends Marvell deal after stock plunge: 'We've got work to do' with shareholdersПресса
Marvell

Lumentum CEO defends Marvell deal after stock plunge: 'We've got work to do' with shareholders

Meta’s new Muse Charm device may cost $300Пресса
Meta

Meta’s new Muse Charm device may cost $300

AOCL 6.0 Tuned for AMD EPYC CPUs
AMD

AOCL 6.0 Tuned for AMD EPYC CPUs

The Best Aesthetic Tech Gifts for Trendsetters
Logitech

The Best Aesthetic Tech Gifts for Trendsetters

Patching at the speed of discovery: full-fleet Network OS upgrades in days, not months
Cisco

Patching at the speed of discovery: full-fleet Network OS upgrades in days, not months

More from AMD

AOCL 6.0 Tuned for AMD EPYC CPUs
AMD

AOCL 6.0 Tuned for AMD EPYC CPUs

Building the Classical Foundation for Fault-Tolerant Quantum Computing
AMD

Building the Classical Foundation for Fault-Tolerant Quantum Computing

Accelerating Quantum Error Correction Research with Pelagos and AMD
AMD

Accelerating Quantum Error Correction Research with Pelagos and AMD

AMD Brings Agentic AI to Supercomputing with Open-Source AMD HPC Assistant, Debuting on LUMI and Frontier
AMD

AMD Brings Agentic AI to Supercomputing with Open-Source AMD HPC Assistant, Debuting on LUMI and Frontier

More AI. More Control. AMD Instinct MI350P Comes to Windows Server.
AMD

More AI. More Control. AMD Instinct MI350P Comes to Windows Server.

AMD AI NIC Technology: AMD AI NICs Now Support HPC to Accelerate AI for Science
AMD

AMD AI NIC Technology: AMD AI NICs Now Support HPC to Accelerate AI for Science