Interview questions

• System designMedium

  Design a distributed rate limiter

  Algorithm trade-offs (fixed window, sliding log, sliding counter, token bucket), placement, distributed atomic counting, failure modes.

  Companies: Amazon, Anthropic, Apple, Freshworks +14

  api-gateway · atomicity · Concurrency · Consistency & Availability

  Last reported Oct 2026

  Start AI interviewStudy workspace
• System designHard

  Design a Chat Assistant Inference Service: Streaming, Free-Tier Limits, GPU Scheduling

  Companies: OpenAI

  LLM Inference & Serving · Rate Limiting · System Design

  Last reported Sep 2026

  Open workspace
• System designMedium

  Review a Batched GPU Inference API Design Doc: Flaws, Throughput, Mixed-Model GPUs

Companies: Anthropic

GPU Infrastructure · Rate Limiting · System Design

Last reported Sep 2026