Dev48
Language
  • About
  • Services
  • Industries
  • Technologies
  • Articles
  • Contacts
Book a call
    Home/Articles/Typesafe ai scales jev to trillions of tokens in three days on modal
Dev48
info@dev48.org+375 29 320-40-96WhatsApp@isky_by

© 2026 · All rights reserved.

TypeSafe AI scales Jev to trillions of tokens in three days on Modal

Source: Modal•October 7, 2026 at 01:22 AM

TypeSafe AI scales Jev to trillions of tokens in three days on Modal

TypeSafe AI launched Jev, a new class of AI model built for automation, and scaled to trillions of tokens over a weekend on Modal.

TypeSafe AI’s manifesto is contrarian for an AI lab: “Build Prod, Not God.” Their first model, Jev, delivers fast, structured decisions with frontier intelligence. In the course of a launch week, demand for Jev went stratospheric.

Modal helped TypeSafe train and deploy a new class of frontier model, then scale to over one trillion tokens in three days while meeting their requirements for ultra-low-latency inference without managing their own infrastructure.

A new class of frontier model

Jev isn’t a large language model. It’s a System One Model–as in fast, intuitive thinking. Jev achieves similar levels of intelligence on System One tasks when compared to frontier LLMs, but focuses on decisions rather than generalized intelligence.

To bring Jev to life, TypeSafe built a custom stack entirely focused on automation: with a new model architecture, parallel sampler for maximum efficiency, and training method they call Reinforcement Learning for Calibrated Decisions (RLCD).

Unlike LLMs, Jev isn’t autoregressive and it doesn’t generate text. Instead, it takes state and questions as input, and outputs typed, structured values with probabilities. For example, take a customer support ticket as input:

The user defines the choice primitive, which directs Jev to choose an option from a list. Given the options sales, technical, or billing , Jev returns outputs and probabilities:

Jev doesn’t generate outputs sequentially, but in parallel–producing intelligent, low-latency responses suitable for workloads like large-scale automation, fast browser use, and generative user interfaces.

Scaling exponentially over a weekend

Jev launched publicly on a Thursday. One week later, it topped the leaderboard on OpenRouter for contexts between 1K-10K tokens, handling 15.1% of requests. This is just a slice of the demand being handled by the TypeSafe team, which they now measure “in the trillions” of tokens.

To scale their systems while serving Jev at the price-performance frontier, the TypeSafe team needed full control of their stack–from networking and routing to autoscaling for unpredictable load. Most importantly, they needed that control without the headache of managing their own infrastructure.

After all, inference is a (very) big thing, but it’s not everything.

Building on Modal

Modal’s infrastructure is uniquely suited for model launches like Jev: bursty, high-concurrency workloads where every millisecond counts. Instead of guessing at capacity needs or overpaying for a compute reservation, AI labs can use Modal’s serverless platform to train, serve, and scale any type of model: LLMs, System One Models, world models, and more.

“Modal served 1 trillion tokens for Jev within three days of launch. Their team was proactive and responsive as we scaled to meet unprecedented demand, and we could stay focused on shipping instead of managing infrastructure.”

Jev's launch is one example of what the Modal platform was built for. Bring any model, any serving code, and scale to trillions of tokens per day.

← All articles

What this article says

More in AI & Machine Learning

All →
Data Processing Incidents on Inference Providers
OpenRouter

Data Processing Incidents on Inference Providers

Orchestrator: One API for frontier and open-weight models
Perplexity

Orchestrator: One API for frontier and open-weight models

Gemini 4 Hydrogen: What xhigh Buys for 6x the Bill
OrcaRouter

Gemini 4 Hydrogen: What xhigh Buys for 6x the Bill

Gemini 4 Neon Video: An Artifact Export, Not a Generation
OrcaRouter

Gemini 4 Neon Video: An Artifact Export, Not a Generation

Security event: Prompt leakage for requests in June and July of 2026
Together AI

Security event: Prompt leakage for requests in June and July of 2026

Qwen4 Max is live on Together AI
Together AI

Qwen4 Max is live on Together AI

More from Modal

How Abundant designed efficient rollout architecture with Modal Sandboxes
Modal

How Abundant designed efficient rollout architecture with Modal Sandboxes

Building new research tools for Maya epigraphy on Modal
Modal

Building new research tools for Maya epigraphy on Modal

Scaling Intelligence: A landmark commission and exhibition
Modal

Scaling Intelligence: A landmark commission and exhibition

Sandbox resourcing: burst, don't reserve
Modal

Sandbox resourcing: burst, don't reserve

Modal becomes a gVisor maintainer
Modal

Modal becomes a gVisor maintainer

How Snorkel runs realistic agent simulations with Modal
Modal

How Snorkel runs realistic agent simulations with Modal