The Netflix TechBlog

MARCH 5, 2024

More than half of our critical streaming video services are now running on JDK 21 with Generational ZGC, so it’s a good time to talk about our experience and the benefits we’ve seen. Reduced tail latencies In both our GRPC and DGS Framework services, GC pauses are a significant source of tail latencies.

Latency 240

Latency Java Tuning Efficiency 240

The Netflix TechBlog

OCTOBER 8, 2024

Rajiv Shringi Vinay Chella Kaidan Fullerton Oleksii Tkachuk Joey Lynch Introduction As Netflix continues to expand and diversify into various sectors like Video on Demand and Gaming , the ability to ingest and store vast amounts of temporal data — often reaching petabytes — with millisecond access latency has become increasingly vital.

Latency 242

Latency Storage Traffic Tuning 242

Dynatrace

JUNE 1, 2023

Note : you might hear the term latency used instead of response time. Both latency and response time are critical to ensure reliability. Latency typically refers to the time it takes for a single request to travel from its source to its destination. Latency primarily focuses on the time spent in transit.

Latency 189

Latency Website Traffic Virtualization 189

Dynatrace

DECEMBER 27, 2022

First, it helps to understand that applications and all the services and infrastructure that support them generate telemetry data based on traffic from real users. Latency is the time that it takes a request to be served. To see these principles in action, check out our videos about implementing service-level objectives.

Software 276

Software Software Benchmarking Latency 276

Dynatrace

JUNE 1, 2023

Note : you might hear the term latency used instead of response time. Both latency and response time are critical to ensure reliability. Latency typically refers to the time it takes for a single request to travel from its source to its destination. Latency primarily focuses on the time spent in transit.

Traffic 173

Traffic Website Latency Virtualization 173

The Netflix TechBlog

JUNE 4, 2019

Because microprocessors are so fast, computer architecture design has evolved towards adding various levels of caching between compute units and the main memory, in order to hide the latency of bringing the bits to the brains. This avoids thrashing caches too much for B and evens out the pressure on the L3 caches of the machine.

Cache 260

Cache Latency Airlines Logistics 260

The Netflix TechBlog

MARCH 10, 2023

Existing data got updated to be backward compatible without impacting the existing running production traffic. Data Sharding strategy in elasticsearch is updated to provide low search latency (as described in blog post) Design of new Cassandra reverse indices to support different sets of queries.

Media 245

Media Traffic Processing Design 245

The Netflix TechBlog

MAY 14, 2021

Prodicle Distribution Our service is required to be elastic and handle bursty traffic. We are expected to process 1,000 watermarks for a single distribution in a minute, with non-linear latency growth as the number of watermarks increases. Things got hairy. We wanted a scalable service that was near real-time, 2.

Traffic 168

Traffic Java Latency Google 168

The Netflix TechBlog

OCTOBER 19, 2020

Investigating a video streaming failure consists of inspecting all aspects of a member account. If we had an ID for each streaming session then distributed tracing could easily reconstruct session failure by providing service topology, retry and error tags, and latency measurements for all service calls.

Infrastructure 239

Infrastructure Transportation Storage Open Source 239

The Morning Paper

OCTOBER 4, 2020

We are standing on the eve of the 5G era… 5G, as a monumental shift in cellular communication technology, holds tremendous potential for spurring innovations across many vertical industries, with its promised multi-Gbps speed, sub-10 ms low latency, and massive connectivity. Throughput and latency. What about UHD video?

Energy 130

Energy Latency Performance Network 130

VoltDB

FEBRUARY 29, 2024

In this fast-paced ecosystem, two vital elements determine the efficiency of this traffic: latency and throughput. LATENCY: THE WAITING GAME Latency is like the time you spend waiting in line at your local coffee shop. All these moments combined represent latency – the time it takes for your order to reach your hands.

Latency 52

Latency Games Traffic Network 52

All Things Distributed

OCTOBER 2, 2017

VPC Endpoints give you the ability to control whether network traffic between your application and DynamoDB traverses the public Internet or stays within your virtual private cloud. Performant – DynamoDB consistently delivers single-digit millisecond latencies even as your traffic volume increases.

Internet 113

Internet Internet AWS Performance 113

The Morning Paper

JULY 4, 2019

Two failure modes we focus on are a service becoming slower (increase in response latency) or a service failing outright (returning errors). An example hypotheses to be tested is that users should still be able to stream video even if the bookmarking service (which remembers their last watched location in a video) is down.

Latency 77

Latency Engineering Metrics Traffic 77

Adrian Cockcroft

JANUARY 29, 2023

There is no way to model how much more traffic you can send to that system before it exceeds it’s SLA. I presented this analysis of response time distributions talk in 2016 — at Microxchg in Berlin ( video ). Mu is the mean of each component, the latency. I’ve been thinking about this for a long time.

Lambda 98

Lambda Latency Cache C++ 98

All Things Distributed

MARCH 11, 2016

AWS has come to support many different workloads; from high-volume transaction processing to video transcoding at scale, from high-performance parallel computing to massive web site traffic. This lowered latency more than 2x and delivered more than 10x improvement in latency variability on the network. No gatekeepers.

AWS 127

AWS Hardware Retail Virtualization 127

Dotcom-Montior

MAY 12, 2020

Modern web applications and pages, such as single-page applications, that put the user experience at its utmost priority are expected to be available 24/7, anywhere in the world, usable on any screen size, secure, flexible, scalable and be ready to meet traffic spikes on demand. Network latency. Network Latency. Connection time.

Monitoring 63

Monitoring Entertainment Hardware Traffic 63

Smashing Magazine

AUGUST 9, 2021

You’ve probably heard things like: “HTTP/3 is much faster than HTTP/2 when there is packet loss”, or “HTTP/3 connections have less latency and take less time to set up”, and probably “HTTP/3 can send data more quickly and can send more resources in parallel”. TLS, TCP, and QUIC handshake durations ( Large preview ).

Transportation 145

Transportation Internet Internet Network 145

The Netflix TechBlog

NOVEMBER 12, 2019

We also apply additional business logic to handle constraints like maturity filtering and deduplication of videos. The real pages we presented to our members are the result of ranking videos and rows from our current production page generation models.

Metrics 125

Metrics Testing Systems Government 125

Smashing Magazine

AUGUST 3, 2023

It increases our visibility and enables us to draw a steady stream of organic (or “free”) traffic to our site. While paid marketing strategies like Google Ads play a part in our approach as well, enhancing our organic traffic remains a major priority. The higher our organic traffic, the more profitable we become as a company.

Performance 75

Performance Cache Traffic Metrics 75

MachMetrics

OCTOBER 16, 2019

However, there is excitement around Starlink for other reasons – namely, the implications it might have for internet speed and latency – even by just a small amount (20 milliseconds on average). Starlink’s Goal: Reduce Internet Latency. What does Starlink and Reduced Latency have to do with me?

Internet 44

Internet Internet Latency Speed 44

Scalegrid

JUNE 7, 2024

While ensuring that messages are durable brings several advantages, it’s important to note that it doesn’t significantly degrade performance regarding throughput or latency. Using a message queue approach, RabbitMQ adeptly handles surges in traffic through data queuing. Can RabbitMQ handle streaming data?

IoT 130

IoT Software Architecture Architecture Scalability 130

IO River

NOVEMBER 2, 2023

If price is your top priority, you'll need to decide how much you're willing to sacrifice in terms of reliability and performance.What are your traffic patterns like? If your traffic is mostly static, you may be able to meet all your needs with a less expensive CDN that provides content distribution services.

Infrastructure 52

Infrastructure Traffic Cache Strategy 52

VoltDB

JUNE 1, 2017

An opening scene involving a traffic jam of Viking boats and a musical number (“Love Can’t Afjord to wait”). Latency Optimizers” – need support for very large federated deployments. When it comes to minimizing latency we’re in the sweet spot as well – our whole architecture is designed to be as fast as possible. Watch the Video.

Hardware 56

Hardware Latency Virtualization Cloud 56

IO River

NOVEMBER 2, 2023

‍Just as a well-coordinated airport directs flights to multiple runways based on traffic and weather conditions, a CDN with Multiple Origins Load Balancing ensures that web traffic is distributed across various data centers, optimizing performance and reliability. ‍But how does it decide where to send this traffic?

Traffic 52

Traffic Cache Servers Network 52

The Netflix TechBlog

NOVEMBER 12, 2019

We also apply additional business logic to handle constraints like maturity filtering and deduplication of videos. The real pages we presented to our members are the result of ranking videos and rows from our current production page generation models.

Metrics 100

Metrics Testing Systems Government 100

The Netflix TechBlog

NOVEMBER 12, 2019

We also apply additional business logic to handle constraints like maturity filtering and deduplication of videos. The real pages we presented to our members are the result of ranking videos and rows from our current production page generation models.

Metrics 100

Metrics Testing Systems Government 100

O'Reilly

DECEMBER 2, 2019

I don’t need more bandwidth for video conferences or movies, but I would like to be able to download operating system updates and other large items in seconds rather than minutes. There are impressive estimates for latency for 5G, but reality has a tendency to be harsh on such predictions. At a gigabit, you don’t have to think twice.

Wireless 53

Wireless Serverless IoT Artificial Intelligence 53

VoltDB

APRIL 25, 2024

While Wi-Fi theoretically can achieve 5G-like speeds, it falls short in providing the consistent performance and reliability that 5G offers, including low latency, higher speeds, and increased bandwidth. Organizations that use private cellular networks don’t have to worry about running into performance issues during peak traffic periods.

Network 52

Network IoT Wireless Infrastructure 52

IO River

NOVEMBER 2, 2023

Just as a well-coordinated airport directs flights to multiple runways based on traffic and weather conditions, a CDN with Multiple Origins Load Balancing ensures that web traffic is distributed across various data centers, optimizing performance and reliability. But how does it decide where to send this traffic?

Traffic 40

Traffic Cache Servers Network 40

IO River

NOVEMBER 2, 2023

If price is your top priority, you'll need to decide how much you're willing to sacrifice in terms of reliability and performance.What are your traffic patterns like? If your traffic is mostly static, you may be able to meet all your needs with a less expensive CDN that provides content distribution services.

Infrastructure 40

Infrastructure Traffic Cache Strategy 40

Nick Desaulniers

FEBRUARY 22, 2015

First, please check out this excellent video on public key crypto: Hopefully that explains the gist of the technique, but what might it actually look like in code? As you might imagine, all of these back and forth trips made during the TLS handshake add latency overhead when compared to unencrypted HTTP requests. crypto module.

Servers 71

Servers C++ Education Government 71

Brendan Gregg

SEPTEMBER 5, 2017

. ## Observability Here's the big picture of performance observability tools on Linux, from my [Linux performance] page, where I also have diagrams for other tool types, as well as videos and slides of prior Linux performance talks: I also have a USE Method: Linux Performance Checklist , as a different way to navigate and apply the tools.

Virtualization 75

Virtualization AWS Engineering Hardware 75

VoltDB

JUNE 9, 2017

Watch the Video of our Telco Expert. downgrading the streaming rate on video). Telco companies used this information and insights to plan capital investment projects for network expansion and marketing. There is a class of real-time data that has not been used to benefit telco insights.

Analytics 40

Analytics Strategy Network Games 40

Percona

APRIL 17, 2023

The CFQ works well for many general use cases but lacks latency guarantees. The deadline excels at latency-sensitive use cases ( like databases ), and noop is closer to no schedule at all. This allows MongoDB to scale horizontally, handling large datasets and high traffic loads. Two other schedulers are deadline and noop.

Best Practices 52

Best Practices Design Tuning Database 52

VoltDB

JUNE 9, 2017

downgrading the streaming rate on video). For passive services like email, this wouldn’t be as necessary. Will a subscriber really know that an email that arrives five seconds late is “late”?

Analytics 40

Analytics Strategy Network Games 40

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. What Comprises Video Streaming - Traffic CharacteristicsWith the emphasis on a high-quality streaming experience, the optimization starts from the very core. Those days are long gone.

Architecture 52

Architecture Performance Internet Internet 52

IO River

NOVEMBER 2, 2023

Now, with viewers all over the world expecting flawless and high-definition streaming, video providers have their work cut out for them. ‍What Comprises Video Streaming - Traffic CharacteristicsWith the emphasis on a high-quality streaming experience, the optimization starts from the very core. Those days are long gone.

Architecture 52

Architecture Performance Internet Internet 52