Dev48
Language
  • About
  • Services
  • Industries
  • Technologies
  • Articles
  • Contacts
Book a call
    Home/Articles/Cerebras launches disaggregated inference
Dev48
info@dev48.org+375 29 320-40-96WhatsApp@isky_by

© 2026 · All rights reserved.

Cerebras Launches Disaggregated Inference

Source: Cerebras•November 17, 2026 at 07:36 PM

Cerebras Launches Disaggregated Inference

Cerebras pairs AMD GPUs for prefill with wafer-scale decode to deliver 5× more tokens per megawatt without reducing token generation speed.

We’ve deployed Cerebras Wafer Scale Engines with GPUs to deliver lightning-fast tokens at scale

The world is hungry for ultrafast tokens. In 2026, Cerebras saw an insatiable demand for fast inference, both on our inference cloud and via our partners. To meet demand, we began developing disaggregated inference: GPUs handle prompt processing (prefill) and Cerebras systems handle output generation (decode).

This solution is now in production and delivers five times more tokens per megawatt at the same ultrafast Cerebras speeds.

We can now serve more ultrafast tokens via Cerebras Inference Cloud to meet market demand. Infrastructure partners can also leverage the Cerebras disaggregated solution to achieve more ultrafast tokens in their own datacenters.

Alongside our recently announced CS4, our dramatically scaled manufacturing, and our planned 700MW of data center capacity, disaggregated inference will enable Cerebras and partners to serve many more ultrafast tokens in 2027 and beyond.

In this blog we cover:

  • The need for more ultrafast inference capacity
  • Why Cerebras is advantaged for decode
  • Cerebras disaggregated inference production results
  • Cerebras disaggregated inference for infrastructure partners

The need for more fast inference capacity

Agentic applications like Muse, Copilot, and Codex are scaling rapidly and require highly interactive inference to keep users engaged. To meet the growing demand of these applications in a power-constrained environment, our industry must deliver significantly more inference capacity per megawatt, at response speeds that make these applications useful.

Sources: Goldman Sachs Research, “AI Agents Forecast to Boost Tech Cash Flow as Usage Soars,” May 20, 2026; Goldman Sachs data center capacity estimates, as reported by Investing.com, November 6, 2026.

That is why Cerebras invested in disaggregation. Pairing a prefill accelerator for prompt processing with the Cerebras System for response generation increases token throughput per megawatt while preserving Cerebras’ ultrafast generation speeds. For inference providers, that means more capacity to serve customers and greater revenue potential from the same power budget.

Why Cerebras is advantaged for decode

An inference request has two main stages. Prompt processing, known as prefill, processes the input and produces intermediate model state. Response generation, known as decode, uses that state to generate output tokens. There are many ways to split the inference workload, including draft–target and attention–FFN among others, but separating prefill from decode is uniquely advantageous when the goal is highly interactive inference.

Decode is autoregressive. That means the model generates one token at a time, using each generated token as an input to generate the next. Each step means reading model data from memory again, so memory bandwidth matters a lot. In the ultrafast inference domain, SRAM-centric chips have an advantage because they can keep that data on-chip and read it much more quickly. Cerebras takes this to wafer scale, with tens of gigabytes of SRAM and tens of petabytes per second of memory bandwidth on a single chip—350× the SRAM capacity and 5,400× the memory bandwidth of a typical GB300 GPU. This allows the Cerebras System to fit more concurrent requests and model layers directly on the chip, enabling the CS-3, CS-4, and CS-5 to achieve ultrafast speeds at an attractive throughput.

Cerebras disaggregated inference production results

Pairing Cerebras systems, which are optimized for ultrafast decode, with accelerators well-suited to the compute needs of prefill, such as AMD Instinct GPUs, allows the delivery of an immense amount of ultrafast inference at scale. In a production deployment on the Cerebras Inference Cloud, AMD Instinct GPUs process prompts, and Cerebras CS-3 systems generate responses. Moving prompt processing to GPUs allows Cerebras systems to devote their serving capacity to response generation. In our measured production deployment, this combination delivered 5X the throughput per megawatt of a CS-3-only configuration, with no loss in token generation speed.

We plan to deploy disaggregated inference broadly across hundreds of megawatts in the Cerebras Inference Cloud and in partner deployments by the end of 2027. Our aim is to increase the ultrafast inference capacity available for our customers.

Cerebras disaggregated inference for infrastructure partners

The Cerebras disaggregated inference solution was also built for our partners to adopt. Infrastructure partners can deploy disaggregated inference clusters based on Cerebras-provided reference architecture, co-locating their chosen prefill accelerators and Cerebras systems within a unified network. For software integration, partners can either integrate with the Cerebras end-to-end disaggregated software stack or a decode-only SDK.

The end-to-end disaggregated software stack is best suited for partners optimizing time-to-market. It consists of:

  • A disaggregated inference framework to route requests between prefill and decode pools and manage replica capacity and health.
  • A prefill engine to process prompts using open-source inference engines like vLLM or SGLang.
  • A Cerebras decode engine for response generation on Cerebras systems.
  • KV Portal software, an interface to transfer intermediate model state, including key-value caches, between prefill and decode engines over RDMA.

The decode-only SDK is best suited for partners optimizing for control. With the decode-only SDK, partners can bring their own inference framework and prefill engine to the Cerebras decode engine and KV Portal software. In addition, the decode-only SDK provides development aids such as a mock Cerebras decode replica and a reference integration to an open-source disaggregated inference framework and prefill engine.

Early-access partners, including Amazon Web Services, Fireworks AI, Gimlet Labs, and General Compute, already have access to the Cerebras disaggregation solution for their deployments. We are now expanding access to additional partners looking to bring ultrafast inference to their customers at scale.

To discuss the results, solutions, or deployment opportunities in more detail, contact us here.

← All articles

What this article says

More in AI & Machine Learning

All →
H2O.ai Appoints Steven Vattuone as Chief Financial Officer
H2O.ai

H2O.ai Appoints Steven Vattuone as Chief Financial Officer

Does a Code-Tuned Embedding Model Pay Off? papr-embed-code-1 in Qdrant
Qdrant

Does a Code-Tuned Embedding Model Pay Off? papr-embed-code-1 in Qdrant

Ai2 and Taylor Geospatial partner to make geospatial AI easier to compare, run, and build on
AI2 (Allen Institute for AI)

Ai2 and Taylor Geospatial partner to make geospatial AI easier to compare, run, and build on

LangSmith for Coding Agents: Now track spend by outcome
LangChain

LangSmith for Coding Agents: Now track spend by outcome

Time-Series Models in the Streamhouse: A New Frontier and Use Cases
Hugging Face

Time-Series Models in the Streamhouse: A New Frontier and Use Cases

Rumble-2-Flash: an open 0.5B speech model for 40+ languages
Hugging Face

Rumble-2-Flash: an open 0.5B speech model for 40+ languages

More from Cerebras

What It Took to Build Wafer-Scale, and Why It Lasts
Cerebras

What It Took to Build Wafer-Scale, and Why It Lasts

How Cerebras Deploys Trillion-Parameter AI Models
Cerebras

How Cerebras Deploys Trillion-Parameter AI Models

A Smarter Model Won’t Save Your Bad Harness
Cerebras

A Smarter Model Won’t Save Your Bad Harness

Cerebras CEO pushes back on AI doomsday warningsПресса
Cerebras

Cerebras CEO pushes back on AI doomsday warnings

Cerebras CEO says we’re nearing a future where everyone has a personal AI assistant at homeПресса
Cerebras

Cerebras CEO says we’re nearing a future where everyone has a personal AI assistant at home

Cerebras stock pops 9% after Sam Altman calls the chipmaker a 'close partner'Пресса
Cerebras

Cerebras stock pops 9% after Sam Altman calls the chipmaker a 'close partner'