# Design a credit risk scoring system: system design interview question

> Loan default estimates with delayed outcomes, borrower selection bias, calibrated probabilities, group fairness, and traceable reasons.

Source: https://sysround.com/questions/design-credit-risk-scoring-system
Updated: 2026-11-05


Difficulty: hard. Levels: Senior, Staff+.

## How the interviewer opens it

"Design a machine learning system that estimates a borrower's probability of default for a lending decision. The lender needs reliable scores and clear reasons for each score."

## What to clarify first

- Prediction target
- Scale
- Read and write mix
- Outcome delay and coverage
- Inputs and freshness
- Latency and availability
- Consistency and durability
- Fairness and legal review
- Model updates
- Decision ownership and exclusions

## Scope of a strong answer

Core requirements:

- Score a loan application for a stated loan offer
- Train and test models with delayed loan outcomes
- Check probability calibration and fairness across borrower groups
- Return and retain score reasons for decision review

Usually out of scope:

- Set loan prices or approval thresholds
- Build a credit bureau
- Collect overdue payments
- Generate final legal decision notices

## What interviewers probe

### Borrower outcomes

Defaults appear months after the score. Monthly status snapshots can miss defaults before a cure. Only funded loans reveal the target outcome.

### Score meaning over time

A useful borrower rank does not guarantee accurate probabilities. Long outcome delays hide current calibration errors and make economic changes hard to assess.

### Fairness across borrower groups

Group metrics depend on the fairness goal and the loans with observed outcomes. Different group default rates can create conflicts between fairness goals.

### Reasons for a loan decision

The lender must explain individual decisions. Correlated inputs and policy rules can make a model explanation incomplete or misleading.

## Common mistakes

- Treat recent loans without reported defaults as negative examples
- Use monthly current status alone for a target that includes intervening defaults
- Train on information that arrived after the original score
- Claim accuracy for all applicants from funded loans alone
- Use ranking metrics without checking probability calibration
- Treat the absence of protected traits as proof of fairness

## The bar by level

- **Senior:** Prevents temporal leakage and handles incomplete reports. Identifies selection bias. Separates calibration from ranking and model reasons from policy reasons. Designs reproducible scores and group audits.
- **Staff+:** Defines what the available outcomes cannot establish. Sets report contracts and correction controls. Resolves fairness goals with legal and risk owners. Sets release gates and safe responses to economic change.

Practice this question with an AI interviewer: https://sysround.com/practice/new?problem=credit-risk-scoring


---
SysRound (https://sysround.com) is an AI practice tool for system design interviews. It has a voice or typed AI interviewer and a shared whiteboard. At the end, you get feedback on each skill and a model answer. The AI feedback can be wrong.
