The Netflix TechBlog

FEBRUARY 18, 2022

Motivation With the rapid growth in Netflix member base and the increasing complexity of our systems, our architecture has evolved into an asynchronous one that enables both online and offline computation. This network connection heterogeneity made choosing a single delivery model difficult.

Systems 334

Systems Traffic Architecture Mobile 334

Scalegrid

FEBRUARY 6, 2025

This article outlines the key differences in architecture, performance, and use cases to help determine the best fit for your workload. RabbitMQ follows a message broker model with advanced routing, while Kafkas event streaming architecture uses partitioned logs for distributed processing. What is RabbitMQ? What is Apache Kafka?

Latency 147

Latency Analytics Architecture Storage 147

Dynatrace

DECEMBER 9, 2020

Cloud-native technologies and microservice architectures have shifted technical complexity from the source code of services to the interconnections between services. Heterogeneous cloud-native microservice architectures can lead to visibility gaps in distributed traces. Dynatrace news.

Java 264

Java Traffic Architecture Strategy 264

The Netflix TechBlog

MAY 26, 2020

Without having network visibility, it’s not possible to improve our reliability, security and capacity posture. Network Availability: The expected continued growth of our ecosystem makes it difficult to understand our network bottlenecks and potential limits we may be reaching. 43416 5001 52.213.180.42 43416 5001 52.213.180.42

Network 152

Network Tuning AWS Traffic 152

Dynatrace

MAY 21, 2021

This becomes even more challenging when the application receives heavy traffic, because a single microservice might become overwhelmed if it receives too many requests too quickly. A service mesh is a dedicated infrastructure layer built into an application that controls service-to-service communication in a microservices architecture.

Traffic 279

Traffic DevOps Infrastructure Network 279

Dynatrace

JULY 15, 2024

These include traditional on-premises network devices and servers for infrastructure applications like databases, websites, or email. A local endpoint in a protected network or DMZ is required to capture these messages. The key to success is making data in this complex ecosystem actionable, as many types of syslog producers exist.

Infrastructure 278

Infrastructure Network Azure Monitoring 278

DZone

OCTOBER 27, 2023

In the dynamic world of microservices architecture, efficient service communication is the linchpin that keeps the system running smoothly. Understanding Service Mesh A service mesh is essentially the invisible backbone of a network, connecting and empowering the various components of a microservices ecosystem.

Traffic 240

Traffic Best Practices Architecture Network 240

DZone

DECEMBER 28, 2020

The system could work efficiently with a specific number of concurrent users; however, it may get dysfunctional with extra loads during peak traffic. It is almost a part of the wider performance engineering portrait, concentrating on performance glitches in the architecture and design of any software.

Performance Testing 230

Performance Testing Testing Tools Testing Performance 230

Dynatrace

NOVEMBER 24, 2020

As organizations plan, migrate, transform, and operate their workloads on AWS, it’s vital that they follow a consistent approach to evaluating both the on-premises architecture and the upcoming design for cloud-based architecture. Fully conceptualizing capacity requirements. How to get started.

AWS 221

AWS Artificial Intelligence Best Practices Lambda 221

Dynatrace

JUNE 10, 2024

They can also develop proactive security measures capable of stopping threats before they breach network defenses. For example, an organization might use security analytics tools to monitor user behavior and network traffic. Security analytics must also contend with the multicomponent architecture of modern IT infrastructure.

Analytics 264

Analytics Network Open Source Hardware 264

Dynatrace

JANUARY 11, 2023

Continuous cloud monitoring with automation provides clear visibility into the performance and availability of websites, files, applications, servers, and network resources. Website monitoring examines a cloud-hosted website’s processes, traffic, availability, and resource use. So, how does cloud monitoring work?

Cloud 295

Cloud Monitoring Best Practices Infrastructure 295

The Netflix TechBlog

NOVEMBER 2, 2020

How viewers are able to watch their favorite show on Netflix while the infrastructure self-recovers from a system failure By Manuel Correa , Arthur Gonigberg , and Daniel West Getting stuck in traffic is one of the most frustrating experiences for drivers around the world. Logs and background requests are examples of this type of traffic.

Traffic 257

Traffic Metrics Infrastructure Architecture 257

Dynatrace

MAY 19, 2022

Example 1: Architecture boundaries. First, they took a big step back and looked at their end-to-end architecture (Figure 2). SLO dashboard defined by architectural boundary. This represents the total number of requests across the network. This refers to the load on your network and servers. So, what did they do?

Automotive 290

Automotive Latency Architecture Mobile 290

Dynatrace

SEPTEMBER 3, 2024

In many ways, the shift to cloud computing and the adoption of cloud-native architectures have enabled organizations to realize greater resiliency alongside scalability. Software performance can be compromised in many ways, including software bugs, cyberattacks, overwhelming demand, backup failures, network issues, and human error.

Infrastructure 290

Infrastructure Innovation Monitoring Software Performance 290

Dynatrace

NOVEMBER 22, 2022

For retail organizations, peak traffic can be a mixed blessing. While high-volume traffic often boosts sales, it can also compromise uptimes. Instead, to speed up response times, applications are now processing most data at the network’s perimeter, closest to the data’s origin.

Infrastructure 246

Infrastructure Availability Systems Retail 246

Dynatrace

JANUARY 28, 2021

With Dynatrace OneAgent you also benefit from support for traffic routing and traffic control. OneAgent implements network zones to create traffic routing rules and limit cross-data-center traffic. Enrich OpenTelemetry instrumentation with high-fidelity data provided by OneAgent.

Traffic 242

Traffic Open Source Servers Cloud 242

Dynatrace

MAY 31, 2023

Microservices-based architectures and software containers enable organizations to deploy and modify applications with unprecedented speed. The growing amount of data processed at the network edge, where failures are more difficult to prevent, magnifies complexity. However, cloud complexity has made software delivery challenging.

Best Practices 246

Best Practices DevOps Latency Metrics 246

The Netflix TechBlog

NOVEMBER 3, 2022

The original assumptions and architectural choices were no longer viable. Overview The figure below depicts a simplified high-level architecture of a single Titus cluster (a.k.a With traffic growth, a single leader node handling all request volume started becoming overloaded.

Cache 228

Cache Latency Traffic Systems 228

Dynatrace

SEPTEMBER 30, 2021

In case of a spike in traffic, you can automatically spin up more resources, often in a matter of seconds. Likewise, you can scale down when your application experiences decreased traffic. For example, as traffic increases, costs will too. This can dramatically decrease network latency and its effect on the end-user experience.

Cloud 241

Cloud Traffic Best Practices Strategy 241

Dynatrace

AUGUST 30, 2019

Reducing performance and architectural issues in their backend system gave them a 99% performance improvement! Singapore event last week, one of my colleagues showed a Dynatrace Service Flow for one of our customers, which consisted of 44 different layers of architecture that a single request had to travel through.

Cache 214

Cache Database Architecture Government 214

The Netflix TechBlog

SEPTEMBER 8, 2020

We tried a few iterations of what this new service should look like, and eventually settled on a modern architecture that aimed to give more control of the API experience to the client teams. For us, it means that we now need to have ~15 MDN tabs open when writing routes :) Let’s briefly discuss the architecture of this microservice.

Latency 237

Latency Cache Java Traffic 237

Dynatrace

JULY 6, 2020

Azure Virtual Network Gateways. Azure Traffic Manager. Our customers have frequently requested support for this first new batch of services, which cover databases, big data, networks, and computing. Azure DB for PostgreSQL. Azure SQL Managed Instance. Azure HDInsight. Azure Front Door.

Azure 227

Azure Cloud Big Data Virtualization 227

Dynatrace

MAY 8, 2023

The process involves monitoring various components of the software delivery pipeline, including applications, infrastructure, networks, and databases. Infrastructure monitoring Infrastructure monitoring reviews servers, storage, network connections, virtual machines, and other data center elements that support applications.

DevOps 246

DevOps Efficiency Monitoring Infrastructure 246

Dynatrace

NOVEMBER 20, 2019

At Dynatrace, where we provide a software intelligence platform for hybrid environments (from infrastructure to cloud) we see a growing need to measure how mainframe architecture and the services running on it contribute to the overall performance and availability of applications. Network metrics are also collected for detected processes.

Availability 43

Availability Hardware Java Tuning 43

The Netflix TechBlog

AUGUST 30, 2021

System Setup Architecture The following diagram summarizes the architecture description: Figure 1: Event-sourcing architecture of the Device Management Platform. When a new hardware device is connected, the Local Registry detects and collects a set of information about it, such as networking information and ESN.

Latency 218

Latency Traffic Transportation Cloud 218

Dynatrace

MAY 1, 2020

We anticipate massive growth in the popularity of this architecture in the coming quarters, driven additionally by companies’ push for cost reductions. We’re therefore happy to announce the Early Adopter release of OneAgent full-stack monitoring for Linux on the ARM 64-bit AArch64 architecture with OneAgent version 1.191.

Java 182

Java Hardware Metrics Tuning 182

The Netflix TechBlog

SEPTEMBER 13, 2021

Supporting developers through those checklists for edge cases, and then validating that each team’s choices resulted in an architecture with all the desired security properties, was similarly not scalable for our security engineers. For development teams, just working through the flowcharts of requirements and options was a monumental task.

Internet 224

Internet Internet Cloud Traffic 224

Dynatrace

JUNE 16, 2020

One key requirement of a microservices architecture is the ability to make information of all kinds available wherever and whenever it’s needed, without putting undue traffic on corporate and public networks.

Storage 182

Storage Metrics Java Architecture 182

Dynatrace

OCTOBER 16, 2023

The Dynatrace team gathered cloud billing data, infrastructure data, networking data, and analyzed that data in Dynatrace Notebooks. As a result, the team found that cloud architecture had resulted in overprovisioning of resources. “There are way over 30 availability zones.

Innovation 246

Innovation DevOps Cloud Efficiency 246

Dynatrace

JULY 8, 2019

I’ve been speaking to customers over the last few months about our new cloud architecture for Synthetic testing locations and their confusion is clear. When we wanted to add a location, we had to ship hardware and get someone to install that hardware in a rack with power and network. Sound easy? Try doing that in India.

Cloud 203

Cloud Hardware Testing Logistics 203

Dynatrace

OCTOBER 13, 2019

But in today’s fast-changing technology world driven by IoT, microservice based architectures, mobile app integration, automation, and containerization, modern businesses are faced with API security issues more than ever. They are, of course, not a complete solution, as they can be intercepted like any other network traffic.

Monitoring 34

Monitoring IoT Tuning Traffic 34

Adrian Cockcroft

JANUARY 27, 2025

They were focused on getting Netflix onto TV sets, and thought the screen was too small, the time people would spend watching was too short, and there wasnt enough mobile network bandwidth. We simply didnt have enough capacity in our datacenter to run the traffic, so it had to work.

C++ 88

C++ Mobile Hardware Java 88

Dynatrace

APRIL 13, 2023

Log auditing is a cybersecurity practice that involves examining logs generated by various applications, computer systems, and network devices to identify and analyze security-related events. It requires an understanding of cloud architecture and distributed systems, with the goal of automating processes.

Java 246

Java Analytics Infrastructure Cloud 246

Dynatrace

OCTOBER 9, 2020

In such circumstances, it’s challenging to investigate the reasons for unexpected behavior or traffic between pods. Now you can: Understand the actual architecture of your applications in Kubernetes in real-time. Understand the architecture of your applications in Kubernetes in real-time.

Design 133

Design Google Architecture Traffic 133

The Netflix TechBlog

OCTOBER 8, 2024

In previous blog posts, we introduced the Key-Value Data Abstraction Layer and the Data Gateway Platform , both of which are integral to Netflix’s data architecture. Handling Bursty Traffic : Managing significant traffic spikes during high-demand events, such as new content launches or regional failovers.

Latency 235

Latency Storage Traffic Tuning 235

Dynatrace

AUGUST 8, 2019

At Dynatrace, where we provide a software intelligence platform for hybrid environments (from infrastructure to cloud) we see a growing need to measure how mainframe architecture and the services running on it contribute to the overall performance and availability of applications. Network metrics are also collected for detected processes.

Availability 34

Availability Hardware Java Tuning 34

The Netflix TechBlog

SEPTEMBER 18, 2024

In this post, we dive deep into how Netflix’s KV abstraction works, the architectural principles guiding its design, the challenges we faced in scaling diverse use cases, and the technical innovations that have allowed us to achieve the performance and reliability required by Netflix’s global operations.

Latency 256

Latency Storage Cache Efficiency 256