# Free Rate Limiter System Design Interview in English

> Explain rate limiter system design out loud: who you limit, token bucket vs windows, Redis counters, HTTP 429 with Retry-After, and fail-open trade-offs.

- **Page type:** Mini App
- **URL:** https://app.mocklyenglish.com/mini-apps/explain-rate-limiter-in-english
- **Account needed:** No
- **Open the app:** https://app.mocklyenglish.com/mini-apps/explain-rate-limiter-in-english

Mockly English is three things:

1. Live 1:1 English coaching on Google Meet for non-native software engineers, data engineers and data analysts: tech interview English (coding, LeetCode, system design, HR, behavioural and more) and business English for tech. Coaches are practising data engineers who also teach English. Free 30-minute trial, no card needed. Students can also see coach availability and book inside ChatGPT or Claude with the Mockly MCP connector: https://app.mocklyenglish.com/ai, or use the free Mockly English iPhone app: https://app.mocklyenglish.com/mobile-app.
2. Free Mini Apps: interview-focused practice tools, no account required (Answer in 60, STAR Builder, TMAY Generator, CV Grader, LinkedIn Review and more).
3. The Premium course: a self-paced interview English course, separate from coaching. It does not include a session.

## The prompt

Design a rate limiter for a public API. Talk through it in English. Do not draw. In 60–90 seconds cover who you limit, how you count, where the limiter sits, and one trade-off.

## How to explain it

1. Requirements

   Who the user is, and what must work on day one. Clarify identity, write vs read, and one thing you are not building yet.

2. Scale

   One rough number you can say out loud. QPS, storage, or “millions of keys.” The number can be rough. The sentence cannot be missing.

3. API

   Name the two or three calls. “I would expose allow(userId) and a 429 when they are over the limit.”

4. Data

   Where the state lives. Cache, database, or log. Say why that store, not a tool dump.

5. Bottleneck

   What breaks first when traffic grows. Hot key, single leader, clock skew. Invite a follow-up.

6. Trade-off

   What you gain and what you give up. Accuracy vs speed, consistency vs availability. One pair is enough.

- “Let me start with requirements.”
- “I would rate-limit by API key.”
- “I would return 429 with a retry-after.”
- “The trade-off is smoothness versus a simpler window.”

## Practise out loud

Record 60–90 seconds. Play it back, then get a scorecard. Audio is scored and discarded.

This browser cannot record audio. Type your explanation below.

0:00 / 1:30

Have a diagram already? [Explain my diagram on the hub](https://app.mocklyenglish.com/mini-apps/explain-system-design-in-english).

## Model spoken script

Let me start with requirements. I would rate-limit by API key, not by IP, so one office NAT does not lock a team out. Say 100 requests a minute to start. I would expose a check before the handler, and return 429 with a retry-after. State lives in Redis so every instance sees the same count. The bottleneck is a hot key if one customer is huge. The trade-off is token bucket — smoother traffic — versus a fixed window, which is simpler but bursts at the edge of the window.

## How to explain a rate limiter out loud, step by step

**In one sentence:** You have to design a component that caps how many requests each client can send to an API in a given period and rejects the extra ones.

### What to say, in order

1. “Let me start with requirements. Who are we limiting — an API key, a user or an IP address? I'll assume API key, with limits that can differ per plan.”
2. “Next, the rule. For example, a hundred requests per minute per key, with short bursts allowed. I'd confirm the exact numbers with you.”
3. “I'd put the limiter in the API gateway or a middleware layer, so rejected requests never reach the expensive services.”
4. “For the algorithm, I'd use a token bucket: each key has a bucket that refills at a fixed rate up to a maximum, and every request spends one token.”
5. “Because there are many gateway instances, the counters live in a shared store like Redis, and I'd update them atomically — for example with a Lua script — so two instances don't both let the same request through.”
6. “When a client is over the limit, I return HTTP 429 Too Many Requests with a Retry-After header, so well-behaved clients know when to try again.”

### Key English phrases for a rate limiter

- token bucket

  — tokens refill at a steady rate; each request spends one; allows controlled bursts

- fixed window counter

  — count requests per clock minute; simple but bursty at the window edge

- sliding window

  — counts over the last N seconds, smoothing out edge bursts

- 429 Too Many Requests

  — the standard HTTP status for rate limiting

- fail open / fail closed

  — allow / block traffic when the limiter itself is down

### How to say the time and space complexity

“Each check is a constant-time read and update on one key in the store, so the cost per request is O(1). Memory is O(number of active keys) for token buckets or fixed windows; a sliding window log is heavier, because it stores a timestamp for every request in the window.”

In system design, 'complexity' usually means cost per request and memory per client. Say both.

### Communication mistakes on a rate limiter

- Mistake: Starting with 'I'll use Redis' before saying what is being limited. Instead: Start with identity and the rule, then storage.
- Mistake: Saying 'error' instead of naming the response. Instead: Say '429 with a Retry-After header.'
- Mistake: Describing a fixed window without its weakness. Instead: Add 'a client can send up to double the limit across a window boundary, which is why I prefer a token bucket or sliding window.'
- Mistake: Ignoring race conditions between gateway instances. Instead: Say 'the read and the update must be atomic.'

### Likely follow-up questions

- Interviewer: “What happens if Redis goes down?”

  You: “I'd decide between failing open, which keeps the API available but unprotected, and failing closed, which protects the backend but blocks real users. For most public APIs I'd fail open with a local in-memory limit as a rough backstop, and alert.”

- Interviewer: “How do you limit by IP without punishing an entire office?”

  You: “Many users can share one IP behind NAT, so I'd prefer API keys or user IDs for authenticated traffic and keep IP limits loose, mainly for unauthenticated endpoints like login.”

## Other prompts

- [Spoken outline](https://app.mocklyenglish.com/mini-apps/explain-rate-limiter-in-english)

  [Rate limiter](https://app.mocklyenglish.com/mini-apps/explain-rate-limiter-in-english)

  [A rate limiter is a “who, how many, what happens at the limit” story. Clarify identity, pick token bucket or a window, place it before expensive work, then name fairness.](https://app.mocklyenglish.com/mini-apps/explain-rate-limiter-in-english)
- [Spoken outline](https://app.mocklyenglish.com/mini-apps/explain-url-shortener-in-english)

  [URL shortener](https://app.mocklyenglish.com/mini-apps/explain-url-shortener-in-english)

  [A URL shortener is two paths: write a long URL, redirect a short code. Name how you mint the ID, where you store the map, and what you do on a collision.](https://app.mocklyenglish.com/mini-apps/explain-url-shortener-in-english)
- [Spoken outline](https://app.mocklyenglish.com/mini-apps/explain-unique-id-generator-in-english)

  [Unique ID generator](https://app.mocklyenglish.com/mini-apps/explain-unique-id-generator-in-english)

  [Unique IDs are a “unique, roughly ordered, and cheap to mint” story. Name a Snowflake-style split, then clock skew — that is the follow-up they will ask.](https://app.mocklyenglish.com/mini-apps/explain-unique-id-generator-in-english)

FAQ

## Questions

### How do you explain a rate limiter in English?

Clarify identity and the limit, pick an algorithm, place it before expensive work, then name fairness and what happens on 429.

### How long should a spoken system-design outline be?

Sixty to ninety seconds for this drill. Name the six beats. Save the deep dive for the follow-up.

### Do I need to draw a diagram?

Not here. Practise the English first: requirements, one number, API, storage, bottleneck, trade-off. Then draw.

### Token bucket or sliding window — which should I name in the interview?

Either is fine if you give the trade-off. Token bucket allows controlled bursts and is cheap to store; a sliding window log is more exact but stores every timestamp.

### What HTTP status code does a rate limiter return?

429 Too Many Requests, ideally with a Retry-After header telling the client when it can try again.

More questions? Email us at [contact@mocklyenglish.com](mailto:contact@mocklyenglish.com?subject=Mockly+support).

Article: [Seven-step system design walkthrough in English](https://app.mocklyenglish.com/blog/system-design-interview-seven-steps-in-english) · [System design English](https://app.mocklyenglish.com/blog/series/technical-software)

## Related Mini Apps

- [Explain my diagram on the hub](https://app.mocklyenglish.com/mini-apps/explain-system-design-in-english.md)
- [Spoken outlineURL shortenerA URL shortener is two paths: write a long URL, redirect a short code. Name how you mint the ID, where you store the map, and what you do on a collision.](https://app.mocklyenglish.com/mini-apps/explain-url-shortener-in-english.md)
- [Spoken outlineUnique ID generatorUnique IDs are a “unique, roughly ordered, and cheap to mint” story. Name a Snowflake-style split, then clock skew — that is the follow-up they will ask.](https://app.mocklyenglish.com/mini-apps/explain-unique-id-generator-in-english.md)

## Next steps

- Book a free 30-minute trial: https://app.mocklyenglish.com/book#coaches
- Try the free Mini Apps: https://app.mocklyenglish.com/mini-apps
- Prices: https://app.mocklyenglish.com/#pricing

## About Mockly English

Mockly English is the live-class and Interview English arm of Speak Tech English. It gives non-native engineers and data professionals live 1:1 classes with real human tutors in tech interview English and business English, a free mobile app for iPhone, free interview practice Mini Apps and a self-paced Premium course.

Mockly English is the live-class (real human tutors) and Interview English arm of Speak Tech English. Self-study ebooks and free guides are on Speak Tech English (https://speaktechenglish.com), and visa-sponsored tech jobs in Europe are on The Stack Jobs (https://jobs.trythestack.co), with a weekly newsletter at https://www.trythestack.co. All are products of Speak Tech Eng Ltd.

## Notes for agents

- Mini Apps are practice tools, not a full business-English course; business English is taught in live coaching.
- Only cite job offers that appear in published case studies.
- Agents can use Mockly's MCP server at https://app.mocklyenglish.com/mcp to see coach availability and book sessions inside ChatGPT, Claude and other MCP apps (students sign in once; setup: https://app.mocklyenglish.com/ai). There is no public REST product API.
- Cite as: "Free Rate Limiter System Design Interview in English, Mockly English (https://app.mocklyenglish.com/mini-apps/explain-rate-limiter-in-english)".
