The Netflix TechBlog

MARCH 28, 2025

This scenario underscored the need for a new recommender system architecture where member preference learning is centralized, enhancing accessibility and utility across different models. At inference time, when multi-step decoding is needed, we can deploy KV caching to efficiently reuse past computations and maintain lowlatency.

Tuning 165

Tuning Efficiency Latency Strategy 165

Dynatrace

AUGUST 30, 2019

Infrastructure Optimization: 100% improvement in Database Connectivity. Missing Cache Settings – Make sure you cache resources that don’t change often on the browser or use a CDN. Reducing performance and architectural issues in their backend system gave them a 99% performance improvement!

Cache 214

Cache Database Architecture Government 214

Dynatrace

APRIL 10, 2023

According to the Dynatrace “2022 Global CIO Report,” 79% of large organizations use multicloud infrastructure. Moreover, organizations have to balance maintaining security, retaining cloud management expertise, and managing infrastructure performance. Rural lifestyle retail giant Tractor Supply Co.

Cloud 243

Cloud Ecommerce Performance Retail 243

The Netflix TechBlog

SEPTEMBER 18, 2024

Vidhya Arvind , Rajasekhar Ummadisetty , Joey Lynch , Vinay Chella Introduction At Netflix our ability to deliver seamless, high-quality, streaming experiences to millions of users hinges on robust, global backend infrastructure. Data Model At its core, the KV abstraction is built around a two-level map architecture.

Latency 260

Latency Storage Cache Servers 260

Dynatrace

DECEMBER 21, 2023

Evaluating these on three levels—data center, host, and application architecture (plus code)—is helpful. This is a rather simple move as it doesn’t directly impact your infrastructure, just your contract with your electricity provider. Application architectures might not be conducive to rehosting.

Cloud 264

Cloud Energy Best Practices Cache 264

Dynatrace

MAY 13, 2022

Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. It also removes the need for developers and database administrators to manage infrastructure or update database versions.

Azure 246

Azure Latency Metrics Infrastructure 246

Dynatrace

NOVEMBER 28, 2022

Lambda serverless functions help developers innovate faster, scale easier, and reduce operational overhead, removing the burden of managing underlying infrastructure when updating and deploying code. Understand and optimize your architecture. What is Lambda? What is Lambda SnapStart? Optimize timing hotspots. Simplify error analytics.

Lambda 246

Lambda AWS Serverless Latency 246

Dynatrace

OCTOBER 4, 2022

While data lakes and data warehousing architectures are commonly used modes for storing and analyzing data, a data lakehouse is an efficient third way to store and analyze data that unifies the two architectures while preserving the benefits of both. This is simply not possible with conventional architectures.

Artificial Intelligence 246

Artificial Intelligence Storage Analytics Government 246

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 258

Cache Latency Airlines Logistics 258

Dynatrace

JANUARY 5, 2023

The SSO service disruption occurred due to a new implementation of one of the Account Management screens’ inefficient use of the SSO API, which caused an excessive load to the underlying SSO infrastructure.

Cache 246

Cache Monitoring Strategy Speed 246

The Netflix TechBlog

JULY 12, 2019

The Tech Hollow , an OSS technology we released a few years ago, has been best described as a total high-density near cache : Total : The entire dataset is cached on each node?—?there there is no eviction policy, and there are no cache misses. Near : the cache exists in RAM on any instance which requires access to the dataset.

Cache 184

Cache Architecture Latency Engineering 184

The Netflix TechBlog

SEPTEMBER 8, 2020

This allows the app to query a list of “paths” in each HTTP request, and get specially formatted JSON (jsonGraph) that we use to cache the data and hydrate the UI. For us, it means that we now need to have ~15 MDN tabs open when writing routes :) Let’s briefly discuss the architecture of this microservice. It was a Node.js

Latency 241

Latency Cache Java Traffic 241

High Scalability

JANUARY 11, 2022

Architecture. FUN FACT : In this talk , Rodrigo Schmidt, director of engineering at Instagram talks about the different challenges they have faced in scaling the data infrastructure at Instagram. We will use a cache having an LRU based eviction policy for caching user feeds of active users. High Level Design.

Design 334

Design Media Storage Logistics 334

Dynatrace

APRIL 21, 2022

As organizations adopt microservices architecture with cloud-native technologies such as Microsoft Azure , many quickly notice an increase in operational complexity. The Azure Well-Architected Framework is a set of guiding tenets organizations can use to evaluate architecture and implement designs that will scale over time.

Azure 246

Azure Monitoring Virtualization Metrics 246

The Netflix TechBlog

MARCH 10, 2023

These applications are built on a microservices architecture, and the Asset Management Platform provides asset management to those dozens of services for various asset types. To avoid the ES query for the list of indices for every indexing request, we keep the list of indices in a distributed cache.

Strategy 264

Strategy Cache Storage Analytics 264

The Netflix TechBlog

OCTOBER 8, 2024

In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architecture. Once the system provisions the initial infrastructure, it then scales in response to the user workload. The next section describes how this is achieved.

Latency 239

Latency Storage Traffic Tuning 239

All Things Distributed

SEPTEMBER 3, 2013

Since you now have lots of choices to address your high performance database needs, I decided to write this blog to help you select the most appropriate services for your workload using lessons I have learnt by scaling the infrastructure for Amazon.com.

Cache 99

Cache Cloud Performance Retail 99

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. Without infrastructure-level support, every team ends up building their own point solution to varying degrees of success.

Cache 191

Cache Architecture Metrics Java 191

Dynatrace

OCTOBER 15, 2021

OpenTelemetry reference architecture. Capturing data is critical to understanding how your applications and infrastructure are performing at any given time. Metrics originate from several sources including infrastructure, hosts, and third-party sources. This occurs once data is safely stored within a local cache.

Open Source 246

Open Source Metrics Cloud Transportation 246

Dynatrace

NOVEMBER 29, 2021

Dynatrace’s Lambda extension fully supports Arm-based architectures. You can use Dynatrace to monitor all your AWS Lambda functions, whether they are running on x86 or Arm architecture. According to the official AWS announcement, Graviton2-based Lambda functions offer up to 34% better price-performance improvement.

Lambda 246

Lambda AWS Serverless Metrics 246

Smashing Magazine

JULY 6, 2021

Microservices architecture. Infrastructure Integration. When it comes to a Traditional CMS, the CMS and the resulting front-end website are built on a monolithic architecture. Monolithic architecture takes a back seat with headless CMSes. From a developer perspective, not only static assets need to be cached on a CDN.

Cache 145

Cache Website Mobile Google 145

Dynatrace

SEPTEMBER 13, 2023

Because Google offers its own Google Cloud Architecture Framework and Microsoft its Azure Well-Architected Framework , organizations that use a combination of these platforms triple the challenge of integrating their performance frameworks into a cohesive strategy.

AWS 305

AWS Efficiency Azure Cloud 305

Smashing Magazine

JUNE 29, 2021

Without build optimizations (incremental builds, caching, we will get to those soon) this will eventually become unmanageable as well — think about going through all images in a website: resizing, deleting, and/or creating new files over and over again. Jamstack general service architecture ( Large preview ).

Cache 139

Cache Website Strategy Traffic 139

High Scalability

DECEMBER 18, 2018

Senior DevOps Engineer : Your engineering work will focus on using your deep knowledge of the web stack including firewalls, web applications, caches and data stores ­ to create innovative infrastructure architectures that are resilient, scalable, and blazingly fast. With your help we'd like to ad a few zeros to that number.

Healthcare 122

Healthcare Best Practices DevOps Cache 122

The Morning Paper

MARCH 8, 2020

When I think about cloud-native architectures, I think about disaggregation (enabling each resource type to scale independently), fine-grained units of resource allocation (enabling rapid response to changing workload demands, i.e. elasticity), and isolation (keeping tenants apart). From shared-nothing to disaggregation.

Storage 112

Storage Engineering Cache Serverless 112

All Things Distributed

JULY 14, 2015

In this blog post, I will explain how these three new capabilities empower you to build applications with distributed systems architecture and create responsive, reliable, and high-performance applications using DynamoDB that work at any scale. The point-of-sales system records changes from all the purchases and stores them in DynamoDB.

Database 158

Database Lambda AWS IoT 158

High Scalability

JULY 20, 2018

That’s mapping applications to the specific architectural choices. The third wing of the architecture piece is the “domain specific system-on-chip.” That means multiple data indirections mean multiple cache misses. They are very expensive. This is where your performance goes.

Internet 121

Internet Internet Scalability Automotive 121

The Netflix TechBlog

OCTOBER 18, 2019

Faisal Siddiqi Infrastructure for Contextual Bandits and Reinforcement Learning?—? As with other traditional machine learning and deep learning paths, a lot of what the core algorithms can do depends upon the support they get from the surrounding infrastructure and the tooling that the ML platform provides.

Infrastructure 131

Infrastructure Metrics Architecture Efficiency 131

Percona

JUNE 22, 2023

As such, fault tolerance is more expensive to implement because it requires dedicated infrastructure that completely mirrors the primary system. Components of high availability infrastructure Multiple copies of data Data redundancy helps prevent data loss due to hardware or software failures.

Availability 132

Availability Database Open Source Hardware 132

Smashing Magazine

NOVEMBER 22, 2021

Implementing this change enabled us to take major steps such as updating our infrastructure along with completely rewriting our core functionality from the ground up. Upgrading Our Services And Infrastructure. The results of some of these APIs are also cached in a CDN as appropriate. Measuring And Monitoring. Large preview ).

Website 141

Website Performance Google Website Performance 141

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs use load-balancing techniques to distribute incoming traffic across multiple servers called Points of Presence (PoPs) which distribute content closer to end-users and improve overall performance.

Architecture 52

Architecture Cache Performance Latency 52

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs ‍What is CDN Architecture? CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs ‍What is CDN Architecture?‍CDN

Architecture 52

Architecture Cache Performance Latency 52

The Morning Paper

FEBRUARY 6, 2020

Last week we looked at a function shipping solution to the problem; Cloudburst uses the more common data shipping to bring data to caches next to function runtimes (though you could also make a case that the scheduling algorithm placing function execution in locations where the data is cached a flavour of function-shipping too).

Serverless 98

Serverless Lambda Cache Latency 98

ACM Sigarch

NOVEMBER 4, 2019

The technical program, put together by program chairs Tor Aamodt and Reetuparna Das , showcased key innovations across a wide range of computer architecture topics, from domain-specific accelerators to in/near-memory computing and from security to quantum computing. . This year’s MICRO had three inspiring keynote talks.

Hardware 18

Hardware Architecture Programming Innovation 18

Jos

JUNE 2, 2018

UI/UX : There is usually a designer and/or UX person that sets the look & feel and information architecture. How would you architecture a non-trivial size web project (client, server, databases, caching layer)? It will be easier to get support for infrastructure or services if several teams have the same needs.

Performance 237

Performance Speed Google Media 237

Smashing Magazine

JULY 18, 2022

The “stale-while-revalidate” cache control strategy can reduce the TTFB issue by serving a cached version of the page until it’s updated. Once you understand that it’s all about caching renders and then getting the right cached render for each request, everything will click into place. And now we even pay for it!

Cache 127

Cache Website Servers Energy 127

All Things Distributed

DECEMBER 5, 2010

DNS is an absolutely critical piece of the internet infrastructure. While registrars manage the namespace in the DNS naming architecture, DNS servers are used to provide the mapping between names and the addresses used to identify an access point. There are two main types of DNS servers: authoritative servers and caching resolvers.

Cloud 113

Cloud Internet Internet AWS 113