The Netflix TechBlog

AUGUST 29, 2023

Eureka and Ribbon presented a simple but powerful interface, which made adopting them easy. In order for a service to talk to another, it needs to know two things: the name of the destination service, and whether or not the traffic should be secure. Our internal IPC traffic is now a mix of plain REST, GraphQL , and gRPC.

Traffic 231

Traffic Latency Cloud C++ 231

The Netflix TechBlog

NOVEMBER 3, 2022

In the time since it was first presented as an advanced Mesos framework, Titus has transparently evolved from being built on top of Mesos to Kubernetes, handling an ever-increasing volume of containers. The original assumptions and architectural choices were no longer viable. queries/sec.

Cache 235

Cache Latency Traffic Systems 235

Dynatrace

AUGUST 30, 2019

Reducing performance and architectural issues in their backend system gave them a 99% performance improvement! Singapore event last week, one of my colleagues showed a Dynatrace Service Flow for one of our customers, which consisted of 44 different layers of architecture that a single request had to travel through.

Cache 205

Cache Database Architecture Government 205

Dynatrace

JANUARY 11, 2023

These next-generation cloud monitoring tools present reports — including metrics, performance, and incident detection — visually via dashboards. Website monitoring examines a cloud-hosted website’s processes, traffic, availability, and resource use. predict and prevent security breaches and outages. Website monitoring.

Cloud 233

Cloud Monitoring Best Practices Infrastructure 233

The Netflix TechBlog

SEPTEMBER 13, 2021

Supporting developers through those checklists for edge cases, and then validating that each team’s choices resulted in an architecture with all the desired security properties, was similarly not scalable for our security engineers. For development teams, just working through the flowcharts of requirements and options was a monumental task.

Internet 229

Internet Internet Cloud Traffic 229

The Netflix TechBlog

JANUARY 10, 2024

This architecture shift greatly reduced the processing latency and increased system resiliency. Several promising ideas were abandoned owing to the outsized work needed to overcome architectural limitations. The microservice architecture provides strong decoupling between services.

Processing 240

Processing Media Latency Innovation 240

Dynatrace

MAY 8, 2023

Consumers expect personalized, proactive, and convenient service, which traditional application architectures often struggle to provide. Best Buy is designing its journey to cut through the noise of its multicloud and multi-tool environments to immediately pinpoint the root causes of issues during peak traffic loads.

Strategy 186

Strategy Retail DevOps Traffic 186

The Netflix TechBlog

OCTOBER 8, 2024

In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architecture. However, storing and querying such data presents a unique set of challenges: High Throughput : Managing up to 10 million writes per second while maintaining high availability.

Latency 242

Latency Storage Traffic Tuning 242

The Netflix TechBlog

AUGUST 30, 2021

System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform. As such, we can see that the traffic load on the Device Management Platform’s control plane is very dynamic over time.

Latency 224

Latency Traffic Transportation Cloud 224

Dynatrace

JUNE 9, 2021

Before one can design an optimal security approach, it helps to understand what kinds of vulnerabilities are commonly present in web applications. Most common vulnerabilities commonly present in web applications. Web Application Firewall (WAF) helps protect a web application against malicious HTTP traffic.

Open Source 187

Open Source Entertainment Tuning Internet 187

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. DBLog High Level Architecture.

Database 223

Database Traffic Transportation Open Source 223

The Netflix TechBlog

DECEMBER 17, 2019

Nonetheless, we found a number of limitations that could not satisfy our requirements e.g. stalling the processing of log events until a dump is complete, missing ability to trigger dumps on demand, or implementations that block write traffic by using table locks. Blocking write traffic by locking tables. DBLog High Level Architecture.

Database 209

Database Traffic Transportation Open Source 209

CSS Wizardry

JULY 23, 2023

All Core Web Vitals data used to rank you is taken from actual Chrome-based traffic to your site. Core Web Vitals report This means that if we were to drop [link] into pagespeed.web.dev , the Core Web Vitals it presents back would be the data for [link].

Engineering 246

Engineering Google Speed Mobile 246

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. We are working on multiple fronts to extend the solution presented here.

Cache 260

Cache Latency Airlines Logistics 260

DZone

MAY 20, 2019

SD-WAN (software-defined wide area network) is probably the most successful business adoption of SDN architecture and is continuously growing, as last year IDC forecast it to reach $4.5 Introduction. billion by 2022.

Monitoring 100

Monitoring Network Traffic Architecture 100

Jos

JUNE 2, 2018

presented in Google IO 2018 ( source ) These tools make it easier to determine where we need to put emphasis to improve our sites. UI/UX : There is usually a designer and/or UX person that sets the look & feel and information architecture. Arrange a presentation and show them. Present it to the team. Get them excited.

Performance 237

Performance Speed Google Media 237

All Things Distributed

JANUARY 18, 2012

s web-based applications often encounter database scaling challenges when faced with growth in users, traffic, and data. Behind the scenes, Amazon DynamoDB automatically spreads the data and traffic for a table over a sufficient number of servers to meet the request capacity specified by the customer. The growth of Amazonâ??s

Scalability 164

Scalability Database Ecommerce Latency 164

The Netflix TechBlog

OCTOBER 16, 2019

By Ammar Khaku Introduction In a microservice architecture such as Netflix’s, propagating datasets from a single source to multiple downstream destinations can be challenging. This post is a high level overview of the design and architecture of Gutenberg. A publisher publishes to a topic and consumers consume from a topic.

Cache 193

Cache Architecture Metrics Java 193

The Netflix TechBlog

MARCH 5, 2019

In the last section, we will attempt to feed your curiosity by presenting a set of opportunities that will drive our next wave of impact for Netflix. Can we adjust our auto-scaling policies to be more efficiency without risking our availability during traffic spikes?

Infrastructure 186

Infrastructure Cloud Scalability AWS 186

Dynatrace

DECEMBER 8, 2020

More modern tools can provide runtime insights into certain platforms, like Kubernetes or containers, but are still limited in their ability to detect which libraries are actually used vs. those that are present, but unused. They also can’t provide deep insights unless you have source code access.

Cloud 298

Cloud Open Source Internet Internet 298

The Netflix TechBlog

FEBRUARY 9, 2021

We need to be able to easily determine what imagery is present for a given platform, region, and language. However, it would be cost-inefficient to leverage this same hardware for lightweight and more consistent traffic patterns that an asset management service requires. Here’s what the final architecture looked like.

Engineering 174

Engineering Storage Latency Entertainment 174

Percona

JUNE 22, 2023

Load balancing : Traffic is distributed across multiple servers to prevent any one component from becoming overloaded. Load balancers can detect when a component is not responding and put traffic redirection in motion. When planning your database HA architecture, the size of your company is a great place to start to assess your needs.

Availability 114

Availability Database Open Source Hardware 114

Scalegrid

JANUARY 5, 2024

Despite initial investment costs, DBMS presents long-term savings and improved efficiency through automated processes, efficient query optimizations, and scalability, contributing to enhanced decision-making and end-user productivity. By implementing data abstraction techniques, these challenges can be addressed more effectively.

Efficiency 147

Efficiency Storage Database Scalability 147

Dynatrace

MAY 9, 2019

Some time ago, we decided to take a stab at a number of architectural challenges present in the OneAgent installer for Windows. And it added to the network traffic in terms of new version distribution. Dynatrace news. We’re happy to say that this project is moving along at a steady pace. exe , but in such a way that the *.msi

Storage 117

Storage Tuning Traffic Architecture 117

All Things Distributed

MAY 19, 2017

It gave us the opportunity to invent a new database architecture that would address to needs of modern cloud-scale applications, departing from the traditional approaches that had their roots in the databases of nineties. In this paper, we describe the architecture of Aurora and the design considerations leading to that architecture.

Database 91

Database Design Cloud Storage 91

The Netflix TechBlog

OCTOBER 18, 2019

It featured three relevant talks from LinkedIn, Netflix and Facebook, and a platform architecture overview talk from first time participant Dropbox. In particular, he talked about the misattribution potential in a complex microservice architecture where often intermediary results are cached.

Infrastructure 133

Infrastructure Metrics Architecture Efficiency 133

Scalegrid

JANUARY 8, 2024

Challenges of Multi-Cloud Although multi-cloud has its benefits, it also presents some obstacles. Like ScaleGrid’s offerings for multi-cloud architecture compatibility, its solutions are well-suited for use within a single cloud provider or a hybrid cloud setup as well. One downside of the hybrid cloud is related to downtime.

Strategy 147

Strategy Cloud Scalability Artificial Intelligence 147

Scalegrid

FEBRUARY 8, 2024

Distributed Storage Architecture Distributed storage systems are designed with a core framework that includes the main system controller, a data repository for the system, and a database. This strategy reduces the volume needed during retrieval operations.

Storage 130

Storage Systems Big Data Azure 130

IO River

NOVEMBER 2, 2023

CDNs cache content on edge servers distributed globally, reducing the distance between users and the content they want.‍CDNs use load-balancing techniques to distribute incoming traffic across multiple servers called Points of Presence (PoPs) which distribute content closer to end-users and improve overall performance.

Architecture 52

Architecture Cache Performance Latency 52

IO River

NOVEMBER 2, 2023

CDNs use load-balancing techniques to distribute incoming traffic across multiple servers called Points of Presence (PoPs) which distribute content closer to end-users and improve overall performance. ‍What is CDN Architecture?‍CDN ‍CDN architecture serves as a blueprint or plan that guides the distribution of CDN provider PoPs.

Architecture 52

Architecture Cache Performance Latency 52

Adrian Cockcroft

FEBRUARY 9, 2023

The layers of platforms start at the bottom with hardware choices such as which CPU architectures and vendors you want to use. The next layer is operating system platforms, what flavor of Linux, what version of Windows etc.

Engineering 137

Engineering Serverless Lambda AWS 137

The Netflix TechBlog

JULY 30, 2019

In this blog, we would like to present the latest updates to Conductor, address some of the frequently asked questions and thank the community for their contributions. Push based task scheduling interface Current Conductor architecture is based on polling from a worker to get tasks that it will execute.

Lambda 192

Lambda Media Open Source Metrics 192

Percona

MAY 15, 2023

In short, any data that is written must be consistent with the data present. Normally this solution requires a full code redesign and could be quite difficult to achieve when it is injected after the initial code architecture definition. This action is something that can affect very large datasets and be very expensive.

Traffic 128

Traffic Scalability Database Servers 128

InfoQ

DECEMBER 29, 2022

Anderson Parra, Vitor Pellegrino discuss how their ticketing systems work and cover the virtual waiting room – the primary component that allows them to handle high-traffic ticket on-sales. By Anderson Parra, Vitor Pellegrino.

Traffic 52

Traffic Virtualization Systems Design 52

O'Reilly

NOVEMBER 12, 2019

For the inaugural O’Reilly survey on serverless architecture adoption, we were pleasantly surprised at the high level of response: more than 1,500 respondents from a wide range of locations, companies, and industries participated. This scaling takes away the worry from random and unexpected traffic spikes or big seasonal traffic.

Serverless 88

Serverless Architecture FinTech Infrastructure 88

Scalegrid

APRIL 5, 2024

It enhances scalability and manages traffic surges, though it requires specific client support and limits multi-key operations to a single hash slot. It offers automatic data sharding, master-replica configurations for high availability, and a scalable and flexible architecture to maintain consistent performance.

Scalability 130

Scalability Efficiency Java Database 130

Percona

JULY 7, 2023

Unfortunately, using certain open source database software as part of an HA architecture can present significant challenges. Despite all its upside, PostgreSQL software presents such challenges. Downtime due to SPOFs can also be attributed to bottlenecks from architectures designed for applications instead of databases.

Availability 88

Availability Open Source Architecture Database 88