The Netflix TechBlog

SEPTEMBER 10, 2024

By Jose Fernandez , Sebastien Dabdoub , Jason Koch , Artem Tkachuk The Compute and Performance Engineering teams at Netflix regularly investigate performance issues in our multi-tenant environment. Traditional performance analysis tools such as perf can introduce significant overhead, risking further performance degradation.

Latency 262

Latency Metrics Programming Monitoring 262

The Netflix TechBlog

JUNE 14, 2023

This blog post will share broadly-applicable techniques (beyond GraphQL) we used to perform this migration. So, we relied on higher-level metrics-based testing: AB Testing and Sticky Canaries. To determine customer impact, we could compare various metrics such as error rates, latencies, and time to render.

Traffic 358

Traffic Latency Metrics Cache 358

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix. to the broader community.

Performance 216

Performance Latency Open Source Metrics 216

The Netflix TechBlog

MAY 4, 2023

The first phase involves validating functional correctness, scalability, and performance concerns and ensuring the new systems’ resilience before the migration. These include Quality-of-Experience(QoE) measurements at the customer device level, Service-Level-Agreements (SLAs), and business-level Key-Performance-Indicators(KPIs).

Traffic 347

Traffic Latency Tuning Systems 347

DZone

NOVEMBER 25, 2023

We often dwell on the technical aspects of database selection, focusing on performance metrics , storage capacity, and querying capabilities. The New Decision Matrix: Beyond Performance Metrics Performance metrics are pivotal, no doubt.

Database 278

Database Latency Speed Metrics 278

DZone

JANUARY 31, 2024

The aim was to enhance the user experience and improve critical business metrics by leveraging the capabilities of the modern HTTP/3 protocol. The Journey to HTTP/3 Network performance, such as low latency and high throughput, is critical to Pinners’ experience.

Performance 189

Performance Latency Network Infrastructure 189

Dynatrace

AUGUST 25, 2023

This article explores SLOs for service performance. According to the Google Site Reliability Engineering (SRE) handbook, monitoring the four golden signals is crucial in delivering high-performing software solutions. While this connection might sound simple, finding the right metrics to measure the needed SLIs takes time and effort.

Performance 180

Performance Latency Traffic Metrics 180

Dynatrace

JANUARY 15, 2020

This extends Dynatrace visibility into Citrix user experience and Citrix platform performance. Platform performance —get visibility into the performance of the Citrix platform to optimize application delivery. Dynatrace Extension: SAP ABAP platform performance. Dynatrace Extension: NetScaler performance.

Latency 37

Latency Performance Virtualization Infrastructure 37

Dynatrace

DECEMBER 27, 2022

By implementing service-level objectives, teams can avoid collecting and checking a huge amount of metrics for each service. When organizations implement SLOs, they can improve software development processes and application performance. Latency is the time that it takes a request to be served. SLOs improve software quality.

Software 270

Software Software Benchmarking Latency 270

Scalegrid

JANUARY 25, 2024

Redis® is an in-memory database that provides blazingly fast performance. This makes it a compelling alternative to disk-based databases when performance is a concern. You might already use ScaleGrid hosting for Redis hosting to power your performance-sensitive applications.

Metrics 130

Metrics Monitoring Latency Cache 130

Dynatrace

JULY 22, 2024

Observability Observability is the ability to determine a system’s health by analyzing the data it generates, such as logs, metrics, and traces. Telemetry Telemetry involves collecting and analyzing data from distributed sources to provide insights into how a system is performing. There are three main types of telemetry data: Metrics.

Latency 240

Latency Best Practices Metrics Open Source 240

Dynatrace

FEBRUARY 21, 2024

Automating quality gates is ideal, as it minimizes manually checking and validating key metrics throughout the SDLC. By actively monitoring metrics such as error rate, success rate, and CPU load, quality gates instill confidence in teams during software releases. Several tools can be used to collect metrics in load/performance testing.

Speed 213

Speed Software Software Latency 213

The Netflix TechBlog

JANUARY 24, 2022

To that end, it’s important that we prevent significant performance regressions from reaching the production app. Any performance regression that makes it into a product release will degrade user experience, so the challenge is to detect and fix such regressions before they ship. What do we mean by Performance?

Performance 209

Performance Performance Testing Metrics Testing 209

CSS Wizardry

OCTOBER 16, 2023

When serving and storing files on the web, there are a number of different things we need to take into consideration in order to balance ergonomics, performance, and effectiveness. Plotted on the same horizontal axis of 1.6s, the waterfalls speak for themselves: 201ms of cumulative latency; 109ms of cumulative download. It gets worse.

Cache 338

Cache Latency Strategy Speed 338

DZone

AUGUST 29, 2023

You can use Istio to observe the performance and behavior of all your microservices in your infrastructure (see the image below).

Monitoring 260

Monitoring Latency Network Infrastructure 260

Dynatrace

MAY 13, 2022

This extension provides fully app-centric Cassandra performance monitoring for Azure Managed Instance for Apache Cassandra. Because of its scalability and distributed architecture, thousands of companies trust it to run their cloud and hybrid-based workloads at high availability without compromising performance. Seeing the value.

Azure 240

Azure Latency Metrics Infrastructure 240

CSS Wizardry

AUGUST 7, 2019

However, one metric I feel that front-end developers overlook all too quickly is Time to First Byte (TTFB). The first—and often most surprising for people to learn—thing that I want to draw your attention to is that TTFB counts one whole round trip of latency. can all provide valuable insights. But what else is TTFB?

Latency 271

Latency Ecommerce Servers Mobile 271

Dynatrace

NOVEMBER 10, 2022

With the growing complexity of application architectures which can rely on tens of thousands of microservices, end-2-end observability is a requirement to optimize application performance and to deliver intelligent root-cause analysis. to better understand AWS Lambda behaviour such as cold starts. to setup AWS access policies).

Lambda 238

Lambda Serverless AWS Latency 238

DZone

JUNE 15, 2023

In the realm of production applications, it is customary to address performance bottlenecks such as CPU and memory issues in order to identify and resolve their underlying causes. It is worth noting that this data collection process does not impact the performance of the application.

Latency 253

Latency Storage Strategy Metrics 253

Dynatrace

NOVEMBER 28, 2022

The new Amazon capability enables customers to improve the startup latency of their functions from several seconds to as low as sub-second (up to 10 times faster) at P99 (the 99th latency percentile). This can cause latency outliers and may lead to a poor end-user experience for latency-sensitive applications.

Lambda 230

Lambda AWS Serverless Latency 230

CSS Wizardry

OCTOBER 27, 2018

A lot of companies—even if they are aware that performance is key to their business—are often unsure of how, when, or where performance testing sits within their development lifecycle. To make things worse, they’re also usually unsure whose responsibility performance measuring and monitoring is.

Performance Testing 198

Performance Testing Testing Performance Strategy 198

The Netflix TechBlog

JUNE 13, 2023

A small percentage of production traffic is redirected to the two new clusters, allowing us to monitor the new version’s performance and compare it against the current version. By tracking metrics only at the level of service being updated, we might miss capturing deviations in broader end-to-end system functionality.

Traffic 285

Traffic Metrics Systems Strategy 285

Dynatrace

MAY 31, 2023

As a result, site reliability has emerged as a critical success metric for many organizations. With so many of their transactions occurring online, customers are becoming more demanding, expecting websites and applications to always perform perfectly. The volume of travel spending booked online is expected to reach nearly $1.5

Best Practices 229

Best Practices DevOps Latency Metrics 229

Dynatrace

SEPTEMBER 18, 2020

Sure, cloud infrastructure requires comprehensive performance visibility, as Dynatrace provides , but the services that leverage cloud infrastructures also require close attention. Well-defined APIs are required for managing such microservices and tracking changes in their performance. High latency or lack of responses.

Infrastructure 193

Infrastructure Latency Metrics Analytics 193

Dynatrace

MARCH 16, 2023

In the 2023 Perform session “SLOs done right: A practitioners guide,” Michael Cabrera, SRE lead at Vivint, and Andreas Grabner, DevSecOps activist at Dynatrace, break down the state of SLOs and discuss how teams can adopt successful SLOs, avoid less-than-ideal objectives, and ultimately build better SLOs. The result?

DevOps 222

DevOps Latency Metrics Traffic 222

Dynatrace

DECEMBER 4, 2023

AI model observability plays a crucial role in achieving this by addressing these key aspects: Model performance and reliability: Evaluating the model’s ability to provide accurate and timely responses, ensuring stability, and assessing domain-specific semantic accuracy. Maintained under the Apache 2.0

Open Source 263

Open Source Metrics Java Latency 263

Dynatrace

APRIL 7, 2023

Dynatrace is a launch partner in support of AWS Lambda Response Streaming , a new capability enabling customers to improve the efficiency and performance of their Lambda functions. Customers can use AWS Lambda Response Streaming to improve performance for latency-sensitive applications and return larger payload sizes.

Lambda 222

Lambda AWS Serverless Latency 222

Dynatrace

NOVEMBER 3, 2021

Monitoring focuses on watching specific metrics. Observability is the ability to understand a system’s internal state by analyzing the data it generates, such as logs, metrics, and traces. For example, we can actively watch a single metric for changes that indicate a problem — this is monitoring.

Monitoring 227

Monitoring Metrics DevOps Scalability 227

Dynatrace

MAY 19, 2022

This multinational information technology service and consulting company was asked to help a global automotive manufacturer with the management goal of measuring service flow performance. In their new dashboard, they added dimensions for load, latency, and open problems for each component. Initial SLO management dashboard.

Automotive 275

Automotive Latency Architecture Azure 275

The Netflix TechBlog

APRIL 27, 2023

A few years ago, we were paged by our SRE team due to our Metrics Alerting System falling behind — critical application health alerts reached engineers 45 minutes late! Hence, we started down the path of alert evaluation via real-time streaming metrics. This has proven to be valuable towards reducing Mean Time to Recover (MTTR).

Storage 298

Storage Cache Metrics Database 298

Dynatrace

MAY 23, 2024

Performance is usually a primary concern when using stream processing frameworks. See more about the performance of stream processing frameworks in our published paper. ShuffleBench i s a benchmarking tool for evaluating the performance of modern stream processing frameworks. This significantly increases event latency.

Engineering 187

Engineering Tuning Latency Open Source 187

Dynatrace

FEBRUARY 15, 2023

SREs use Service-Level Indicators (SLI) to see the complete picture of service availability, latency, performance, and capacity across various systems, especially revenue-critical systems. Additionally, you can easily use any previously defined metrics and SLOs from your environments.

DevOps 225

DevOps Latency Traffic Best Practices 225

The Netflix TechBlog

SEPTEMBER 10, 2024

Finally, the device receives the message, and the action, such as “Show me Stranger Things on Netflix”, is performed. Dynomite had great performance, but it required manual scaling as the system grew. In our case, we value low latency — the faster we can read from KeyValue, the faster these messages can get delivered.

Latency 235

Latency Cache Tuning Efficiency 235

The Netflix TechBlog

SEPTEMBER 8, 2020

To prepare ourselves for a big change in the tech stack of our endpoint, we decided to track metrics around the time taken to respond to queries. After some consultation with our backend teams, we determined the most effective way to group these metrics were by UI screen.

Latency 242

Latency Cache Java Traffic 242

Dynatrace

AUGUST 21, 2024

This approach enhances key DORA metrics and enables early detection of failures in the release process, allowing SREs more time for innovation. This blog post explores the Reliability metric , which measures modern operational practices. Why reliability? It forms the cornerstone of chaos engineering experiments.

Engineering 198

Engineering Systems Latency Metrics 198

Dynatrace

JUNE 25, 2020

Dynatrace Managed is intrinsically highly available as it stores three copies of all events, user sessions, and metrics across its cluster nodes. The network latency between cluster nodes should be around 10 ms or less. – A Dynatrace customer, Head of Performance Engineering. Dynatrace is a Tier 0 application for us.

Availability 252

Availability Hardware Latency Traffic 252

Dynatrace

SEPTEMBER 13, 2023

The framework comprises six pillars: Operational Excellence, Security, Reliability, Performance Efficiency, Cost Optimization, and Sustainability. And how can you verify this performance consistently across a multicloud environment that also uses Microsoft Azure and Google Cloud Platform frameworks?

AWS 253

AWS Efficiency Azure Cloud 253