HLD | System design — [Index]

5 min readMar 17, 2023

--

· Golden Rules/Gotchas for System Design Interview
· Why server can’t push data with http?
· Why BOE calculation/Capacity Planning
· Back of the envelope numbers
· DNS — [Notes]
· CAP theorem
· PACELC — [Notes]
· Protocols
· Load Balancer
∘ Global Server Load Balancing (GSLB) — Advance
· CDN Content Routing — [Notes]

· Database
∘ Clustered Vs Non Clustered Index
∘ SQL vs No-SQL
∘ Column-oriented | Columnar databases
∘ Statement vs Prepared Statement vs Callable

· REDIS
· Pessimistic vs Optimistic locking
· Geospatial | GeoHash | R-Tree | QuadTree
· Non-Blocking Vs Blocking I/O

· System design problems
∘ Distributed Web crawler — [Notes]
∘ Instagram
∘ Instagram Image upload + CDN — [Notes]
∘ Design Chat/WhatsApp — [Notes]
∘ Bitly | TinyURL | URL shortener
∘ Distributed ID Generation
∘ Rate limiter
∘ Ads Click aggregation
∘ Design a Highly available system

· Distributed Transactions
· Distributed Systems | Microservice — [Mind Maps]
· Database replication | Consistency Models
· Event driven vs Event sourcing
· tail latency | P99
· Claim check Pattern — [Notes]
· When and where to Message Queues — [Notes]
· Kafka vs RabbitMQ

· TODO -

Golden Rules/Gotchas for System Design Interview

The system design is complex and one design doesn’t fits all. Below are a a bunch of useful rules to get you better off…

tarunjain07.medium.com

Why server can’t push data with http?

Follow this link for all System design articles

tarunjain07.medium.com

Why BOE calculation/Capacity Planning

Medium

Edit description

medium.com

Back of the envelope numbers

BOE Number s— [Notes]

How to Decide of RAM, HDD

tarunjain07.medium.com

DNS — [Notes]

DNS— [Notes]

· Types of DNS servers · DNS Resolution process · DNS Load Balancing ∘ Limitations Of DNS Load Balancing # · AWS Route…

tarunjain07.medium.com

CAP theorem

CAP theorem — [Notes]

Table of content

tarunjain07.medium.com

PACELC — [Notes]

PACELC — [No

tarunjain07.medium.com

Protocols

Protocols — [Notes]

Table of Content

tarunjain07.medium.com

Load Balancer

Load balancer — [Notes]

What is a load balancer[LB]?

tarunjain07.medium.com

Global Server Load Balancing (GSLB) — Advance

*Photogram is an imaginary app like instagram

tarunjain07.medium.com

CDN Content Routing — [Notes]

link for all System design articles

tarunjain07.medium.com

Database

Clustered Vs Non Clustered Index

Clustered Vs NonClustered Index

· Note : · Clustered Index · Non-Clustered Index · When Should We Create A Clustered Index? · When Should We Create A…

tarunjain07.medium.com

SQL vs No-SQL

SQL Vs Non-Sql

· Pointers to choose Sql vs No-Sql ∘ Data structure ∘ Ability to query data ∘ Scaling ∘ The convergence of SQL…

tarunjain07.medium.com

Column-oriented | Columnar databases

Table of Content

tarunjain07.medium.com

Reference — NoSQL wide-column stores demystified

NoSQL wide-column stores demystified - LogRocket Blog

Editor's note: This post was updated on 3 March 2023 to provide more detailed information about column-oriented…

blog.logrocket.com

What difference between columnar and wide column databases?

Thanks for contributing an answer to Database Administrators Stack Exchange! Please be sure to answer the question…

dba.stackexchange.com

What exactly is a wide column store?

Googling for a definition either returns results for a column oriented DB or gives very vague definitions. My…

stackoverflow.com

Statement vs Prepared Statement vs Callable

· SQL — Query execution steps · Statement · Prepared Statement ∘ Basics ∘ Why prepared statement ∘ Rules for…

tarunjain07.medium.com

REDIS

Redis — [Notes]

REDIS = REMOTE DICTIONARY SERVER

tarunjain07.medium.com

Pessimistic vs Optimistic locking

Pessimistic vs Optimistic locking — [Notes]

· Optimistic locking · Pessimistic locking

tarunjain07.medium.com

Geospatial | GeoHash | R-Tree | QuadTree

Geospatial | GeoHash — [Notes]

· Geospatial Data · Spatial search problems ∘ K nearest neighbours ∘ Range and radius queries · How spatial trees…

tarunjain07.medium.com

Non-Blocking Vs Blocking I/O

Non-Blocking Vs Blocking I/O — [Notes]

[Work in progress]

tarunjain07.medium.com

System design problems

Distributed Web crawler — [Notes]

Avoid crawling duplicate URLs at Google scale-Using Bloom Filter

tarunjain07.medium.com

Instagram

Instagram feed- WIP

🔃all HLD design articles

tarunjain07.medium.com

Instagram Image upload + CDN — [Notes]

When a user uploads an image to Instagram, the image is first sent to Instagram’s servers, which are located in various…

tarunjain07.medium.com

TODO — image upload design template — alex xu — link

Design Chat/WhatsApp — [Notes]

Questions / Functional requirement

tarunjain07.medium.com

Bitly | TinyURL | URL shortener

URL shortener — [Notes]

code — https://github.com/tajain07/url-shortner-nodejs

tarunjain07.medium.com

Distributed ID Generation

· Simple ID generation · Why UUID? ∘ Why not 128 bit UUID? ∘ Why we need monotonicity · Best article · TODO

tarunjain07.medium.com

Rate limiter

Rate Limiter

· Rate Limiter? · Token Bucket implementation in Java · Fixed size rate limiter implemented using Redis · Distributed…

tarunjain07.medium.com

Ads Click aggregation

Ads click aggregation — [Notes]

Data / BOE

tarunjain07.medium.com

Design a Highly available system

highly available(available all the time) = lower latency.

tarunjain07.medium.com

Distributed Transactions

Distributed Transactions —

· 3PC and 2PC · Very nice article · Java code for SAGA

tarunjain07.medium.com

Distributed Systems | Microservice — [Mind Maps]

Design Patterns

tarunjain07.medium.com

Database replication | Consistency Models

Database Replication: Benefits and Trade-Offs

Design better systems by understanding the trade-offs and benefits of database replication

betterprogramming.pub

https://docs.google.com/spreadsheets/d/1MdOm-XKr3ODOpLxMAvx_cdvXfJ0HwIcxk9fTyk7p99A/edit#gid=0

Event driven vs Event sourcing

· Domain Events · Event-driven architectures [EDA] · Event sourcing

tarunjain07.medium.com

tail latency | P99

99th percentile (P99) latency is 1 minute: i.e., if you send 100 requests to one, only 1 of those 100 requests will…

tarunjain07.medium.com

Claim check Pattern — [Notes]

Source — https://www.youtube.com/watch?v=xfNzGdrxf5w&ab_channel=CodeOpinion

tarunjain07.medium.com

When and where to Message Queues — [Notes]

Handle Traffic Spikes: Message queues are effective at handling traffic spikes. Without message queues, it’s possible…

tarunjain07.medium.com

Kafka vs RabbitMQ

What is message queuing?

tarunjain07.medium.com

TODO -

Notion(tarunjain07@gmail.com) — websocket notes copy here
Notes of this or add in websocket section for revision — https://stackoverflow.blog/2019/12/18/websockets-for-fun-and-profit/
grpc vs rpc — alex xu video