Watch free
interview prep for software engineers

Crack the AI infra system design interview.

Full mock interviews, free to watch. Your backend skills carry over; we show what's new.

Watch a full interview →

problems reported from OpenAI · Anthropic · Perplexity

Watch a full interview. No sign-up.

Design ChatGPT · 11:26
MeiArjun
Mei, the interviewer, asks:

A worker freezes. Another takes over. Then the first one wakes up. What now?

What carries over, and what's new.

AI infra is distributed systems with a model in the middle

what you knowwhat it becomes in AI infra
Load balancingrouting to GPU replicas
Queues and backpressurecontinuous batching
Cachingthe KV cache
Rate limitingtoken budgets
Leases and idempotent writesfencing a frozen GPU worker

new to learn: tokens · KV cache · GPU memory · batching · evals

Costs less than one hour with a coach.

expense it → or watch one first →

Questions

Who is it for?

Software engineers (backend, infra, platform, full-stack) going after AI engineer and AI infrastructure roles, from mid to staff. Each interview is broken down for every level.

Do I need an ML background?

No. AI infra rounds are distributed systems with a model in the middle, so most of what you know carries over: load balancing, queues, caching, rate limits, streaming, idempotency. What's new is a short list: tokens and context windows, the KV cache and GPU memory, batching, retrieval and evals. The interviews teach those as they come up, on top of what you already know.

Who are Mei and Arjun?

Our interviewer and candidate. Every interview is written by us from candidate reports, reviewed, and produced with AI voices, which is how we ship new problems and every level of each.

Does it renew automatically?

Monthly renews until you cancel. Yearly renews once a year, and we email you 7 days before it does. If you subscribed during an offer, you keep that price for as long as you stay subscribed. Either plan: full refund within 30 days of your first payment, no questions asked; just reply to your receipt.

How long is the offer on?

Yearly is $79 for a limited time; the bar at the top shows exactly how long you have. When it ends, it's $119/year for you, and it doesn't come back. Get Pro before then and you keep your price for as long as you stay subscribed. Monthly is always $39.

Can my company pay?

If your employer reimburses professional development, use "expense it" under the plans: it opens a short note to your manager with the price and the refund terms.

Watch a full interview