Remove Cache Remove Design Remove Servers
article thumbnail

The Three Cs: Concatenate, Compress, Cache

CSS Wizardry

Concatenating our files on the server: Are we going to send many smaller files, or are we going to send one monolithic file? Caching them at the other end: How long should we cache files on a user’s device? Caching them at the other end: How long should we cache files on a user’s device? Cache This is the easy one.

Cache 353
article thumbnail

Designing Instagram

High Scalability

Design a photo-sharing platform similar to Instagram where users can upload their photos and share it with their followers. High Level Design. When the server receives a request for an action (post, like etc.) Component Design. API Design. We have provided the API design of posting an image on Instagram below.

Design 334
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Consistent caching mechanism in Titus Gateway

The Netflix TechBlog

We introduce a caching mechanism in the API gateway layer, allowing us to offload processing from singleton leader elected controllers without giving up strict data consistency and guarantees clients observe. We started seeing increased response latencies and leader servers running at dangerously high utilization. of the data.

Cache 228
article thumbnail

Netflix’s Distributed Counter Abstraction

The Netflix TechBlog

By: Rajiv Shringi , Oleksii Tkachuk , Kartik Sathyanarayanan Introduction In our previous blog post, we introduced Netflix’s TimeSeries Abstraction , a distributed service designed to store and query large volumes of temporal event data with low millisecond latencies. Today, we’re excited to present the Distributed Counter Abstraction.

Latency 247
article thumbnail

Introducing Netflix’s Key-Value Data Abstraction Layer

The Netflix TechBlog

In this post, we dive deep into how Netflix’s KV abstraction works, the architectural principles guiding its design, the challenges we faced in scaling diverse use cases, and the technical innovations that have allowed us to achieve the performance and reliability required by Netflix’s global operations.

Latency 256
article thumbnail

Self-Host Your Static Assets

CSS Wizardry

Users might already have the file cached. If website-a.com links to [link] , and a user goes from there to website-b.com who also links to [link] , then the user will already have that file in their cache. Critical assets are far too valuable to leave on someone else’s servers. Penalty: Caching. Risk: Service Shutdowns.

Cache 277
article thumbnail

Optimising for High Latency Environments

CSS Wizardry

RTT is designed to replace Effective Connection Type (ECT) with higher resolution timing information. What follows is overall best-practice advice for designing with latency in mind. Reduce Transfer Size Broadly simplified… Web servers don’t send whole files at once—they chunk them into packets and send those.

Latency 244