The Netflix TechBlog

MARCH 1, 2021

It supports both high throughput services that consume hundreds of thousands of CPUs at a time, and latency-sensitive workloads where humans are waiting for the results of a computation. The subsystems all communicate with each other asynchronously via Timestone, a high-scale, low-latency priority queuing system. Warm capacity.

Serverless 236

Serverless Media Latency Social Media 236

The Netflix TechBlog

JUNE 13, 2023

Our previous blog post presented replay traffic testing — a crucial instrument in our toolkit that allows us to implement these transformations with precision and reliability. They enable us to further fine-tune and configure the system, ensuring the new changes are integrated smoothly and seamlessly.

Traffic 287

Traffic Metrics Systems Strategy 287

The Netflix TechBlog

MARCH 4, 2024

Operational automation–including but not limited to, auto diagnosis, auto remediation, auto configuration, auto tuning, auto scaling, auto debugging, and auto testing–is key to the success of modern data platforms. We have also noted a great potential for further improvement by model tuning (see the section of Rollout in Production).

Tuning 219

Tuning Efficiency Big Data Engineering 219

Dynatrace

APRIL 25, 2023

Higher latency and cold start issues due to the initialization time of the functions. Data visualization : how to present, explore and interpret observability data from serverless functions intuitively, clearly, and holistically? Enable faster development and deployment cycles by abstracting away the infrastructure complexity.

Serverless 220

Serverless Lambda Azure AWS 220

The Netflix TechBlog

AUGUST 29, 2023

Eureka and Ribbon presented a simple but powerful interface, which made adopting them easy. The abstraction we present continues to be VIP name plus secure, and we can migrate to mesh by configuring individual IPC clients to connect to the local proxy instead of the upstream app directly.

Traffic 231

Traffic Latency Cloud C++ 231

The Netflix TechBlog

DECEMBER 21, 2020

This article will list some of the use cases of AutoOptimize, discuss the design principles that help enhance efficiency, and present the high-level architecture. These principles reduce resource usage by being more efficient and effective while lowering the end-to-end latency in data processing. More processing resources.

Storage 214

Storage Latency Efficiency Data Engineering 214

Scalegrid

JANUARY 25, 2024

Key Takeaways Critical performance indicators such as latency, CPU usage, memory utilization, hit rate, and number of connected clients/slaves/evictions must be monitored to maintain Redis’s high throughput and low latency capabilities. Similarly, an increased throughput signifies an intensive workload on a server and a larger latency.

Metrics 130

Metrics Monitoring Latency Cache 130

The Netflix TechBlog

AUGUST 30, 2021

A timeline of the transition from Spring KafkaListener to Alpakka-Kafka is presented here for a better understanding of the motivations for the transition. By the following morning, alerts were received regarding high memory consumption and GC latencies, to the point where the service was unresponsive to HTTP requests.

Latency 224

Latency Traffic Transportation Cloud 224

Dynatrace

DECEMBER 22, 2019

Metrics for each service instance are presented in detailed charts—see the example for ECS below. The example below visualizes average latency by API name and stage for a specific AWS API Gateway. Stay tuned for updates in Q1 2020. You can also create custom charts. You can then pin custom charts to your dashboards.

AWS 138

AWS Metrics IoT Storage 138

Dynatrace

DECEMBER 22, 2019

Metrics for each service instance are presented in detailed charts—see the example for ECS below. The example below visualizes average latency by API name and stage for a specific AWS API Gateway. Stay tuned for updates in Q1 2020. You can also create custom charts. You can then pin custom charts to your dashboards.

AWS 134

AWS Metrics IoT Storage 134

Percona

NOVEMBER 3, 2023

And now, execute the benchmark: -- execute the following on the coordinator node pgbench -c 20 -j 3 -T 60 -P 3 pgbench The results are not pretty. psql pgbench <<_eof1_ qecho adding node citus3. select citus_add_node('citus3', 5432); qecho rebalancing shards across TWO nodes.

Database 110

Database Benchmarking Latency C++ 110

Smashing Magazine

NOVEMBER 8, 2021

As developers, we rightfully obsess about the customer experience, relentlessly working to squeeze every millisecond out of the critical rendering path, optimize input latency, and eliminate jank. Stay tuned for more in 2022! Ilya Grigorik. 2021-11-08T14:30:00+00:00. 2021-11-08T19:34:34+00:00. Large preview ). Curious to give it a try?

Cache 137

Cache Best Practices Strategy Servers 137

Percona

NOVEMBER 2, 2023

Improved performance : MongoDB continually fine-tunes its database engine, resulting in faster query execution and reduced latency. Navigating common MongoDB upgrade challenges Even with a well-thought-out plan, MongoDB upgrades can present challenges.

Best Practices 94

Best Practices Hardware Tuning Scalability 94

The Netflix TechBlog

FEBRUARY 9, 2021

When we merge these two concepts together and present them to the customer, we have the plan selection page (shown above). This implies that the presentation layer should be void of any business logic and should simply be responsible for rendering data that is passed to it. Conclusion This work was a large cross-functional effort.

Engineering 146

Engineering Scalability Architecture Innovation 146

The Morning Paper

JULY 7, 2019

In addition to availability, our respondents focus most heavily on supporting the following data attributes: “accessibility, accuracy, authoritativeness, freshness, latency, structuredness, ontological typing, connectedness, and semantic joinability.” To address this, rigorous rollout processes are required.

Software Engineering 92

Software Engineering Engineering Software Software 92

The Netflix TechBlog

DECEMBER 17, 2019

Go to step 1 if more chunks present. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. A SELECT is assumed to return state which represents committed changes up to a certain point in history.

Database 223

Database Traffic Transportation Open Source 223

The Netflix TechBlog

DECEMBER 17, 2019

Go to step 1 if more chunks present. Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. Or equivalently: the SELECT executed on a specific position of the change log, considering changes up to that point.

Database 209

Database Traffic Transportation Open Source 209

All Things Distributed

NOVEMBER 29, 2017

As there are few individuals with this expertise, an easier process presents a significant opportunity for companies who want to accelerate their ML usage. After this, there is often a long process of training that includes tuning the knobs and levers, called hyperparameters, that control the different aspects of the training algorithm.

Tuning 77

Tuning AWS Scalability Infrastructure 77

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS. in total.

Speed 103

Speed Java AWS Virtualization 103

InfoQ

APRIL 15, 2024

The presenter shared the lessons learned from evolving and operating the platform, including cluster management and library versioning. At the QCon London 2024 conference, Félix GV from LinkedIn discussed the AI/ML platform powering the company’s products. By Rafal Gancarz

Artificial Intelligence 109

Artificial Intelligence Big Data Data Engineering Latency 109

All Things Distributed

DECEMBER 12, 2013

Moreover, a GSI''s performance is designed to meet DynamoDB''s single digit millisecond latency - you can add items to a Users table for a gaming app with tens of millions of users with UserId as the primary key, but retrieve them based on their home city, with no reduction in query performance.

Games 110

Games Scalability Database Retail 110

The Morning Paper

MARCH 17, 2020

Based on these findings, the authors present four guidelines to get the best performance out of this memory today. higher latency and lower bandwidth)… We have found the actual behavior of Optane DIMMs to be more complicated and nuanced than the "slower, persistent DRAM" label would suggest. Optane DIMMs are here!

Scalability 59

Scalability Latency Cache Media 59

The Morning Paper

JUNE 13, 2019

HotOS’19 is presenting me with something of a problem as there are so many interesting looking papers in the proceedings this year it’s going to be hard to cover them all! The following figure highlights how just one of these variables, batch size, impacts throughput and latency on ResNet50. HotOS’19.

Hardware 58

Hardware Latency Serverless Energy 58

O'Reilly Software

APRIL 4, 2018

Fast forward to the present day and we find ourselves in a world where the number of connected devices is constantly increasing. The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. What message process warranty level do we require? At least once? At most once?

Architecture 80

Architecture Scalability Google Operating System 80

HammerDB

OCTOBER 18, 2019

cpupower frequency-info analyzing CPU 0: driver: intel_pstate CPUs which run at the same hardware frequency: 0 CPUs which need to have their frequency coordinated by software: 0 maximum transition latency: Cannot determine or is not supported. hardware limits: 1000 MHz - 4.00 bin/pgbench -c 1 -S -T 60 pgbench starting vacuum.end.

Benchmarking 63

Benchmarking Performance Hardware C++ 63

Percona

APRIL 17, 2023

The main objective of this post is to share my experience over the past years tuning MongoDB and centralize the diverse sources that I crossed in this journey in a unique place. The CFQ works well for many general use cases but lacks latency guarantees. Spoiler alert: This post focuses on MongoDB 3.6.X tcp_fin_timeout = 30 net.ipv4.tcp_keepalive_intvl

Best Practices 52

Best Practices Design Tuning Database 52

John McCalpin

JANUARY 22, 2018

Dr. Damon McDougall gave a short presentation on this study at the IXPUG 2018 Fall Conference ( pdf ) — I originally wrote these notes to help organize my thoughts as we were preparing the IXPUG presentation, and later decided that the extra details contained here are interesting enough for me to post it. cmpl $1000000000, %eax.

Latency 40

Latency Hardware Code Testing 40

Brendan Gregg

SEPTEMBER 5, 2017

Here's some output from my zfsdist tool, in bcc/BPF, which measures ZFS latency as a histogram on Linux: # zfsdist. Tracing ZFS operation latency. Both Xen and KVM have had many performance and security improvements, and workloads can now be tuned to run at almost bare metal speeds (say, a 3% loss or less). Hit Ctrl-C to end. ^C

Virtualization 75

Virtualization AWS Engineering Hardware 75

Smashing Magazine

AUGUST 9, 2021

You’ve probably heard things like: “HTTP/3 is much faster than HTTP/2 when there is packet loss”, or “HTTP/3 connections have less latency and take less time to set up”, and probably “HTTP/3 can send data more quickly and can send more resources in parallel”. Stay tuned! (vf, This is shown in the image below. Large preview ).

Transportation 145

Transportation Internet Internet Network 145

The Agile Manager

AUGUST 23, 2007

The basic management tools and structures must be present or this simply doesn’t work. I chair our meetings and ask the individuals present to talk in turn. 5 Grand Prix Tune-Ups” F1 Racing Magazine. After about a year and a half, he decided teams should elect leaders. 4 But that, too, isn’t enough. 4 White, Erin. “ August 2007.

Innovation 40

Innovation Technology Technology Latency 40

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. The change was obvious in the production graphs, showing a drop in write latencies: Once tested more broadly, it showed the write latencies dropped by 43%, delivering slightly better performance than on CentOS. in total.

Speed 40

Speed Java AWS Virtualization 40

HammerDB

OCTOBER 12, 2018

For this reason sysbench presents a vastly more simplified workload than HammerDB. . Therefore if you are testing MySQL or MariaDB’s ability to support web-based applications that use SQL statements with minimal contention then sysbench is likely to present the best assessment of the system for this type of workload.

Best Practices 40

Best Practices Scalability Performance C++ 40

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only.

Servers 40

Servers Cache Media Hardware 40

Scalegrid

DECEMBER 14, 2023

For example, if there’s some trouble connecting due to networking problems or excessive load requests from customers present on the server’s side, that might result in a resolution-related delay causing a subsequent timeout problem. Fine-tuning these settings would lead to improved performance and provide an enhanced user experience. <p>The

Java 130

Java Network Servers Database 130

Smashing Magazine

AUGUST 22, 2021

Because we are dealing with network protocols here, we will mainly look at network aspects, of which two are most important: latency and bandwidth. Latency can be roughly defined as the time it takes to send a packet from point A (say, the client) to point B (the server). Two-way latency is often called round-trip time (RTT).

Performance 107

Performance Network Latency Servers 107

Smashing Magazine

SEPTEMBER 29, 2021

Tip: When evaluating quality, compression and fine-tuning of modern formats, Squoosh.app ’s ability to perform a visual side-by-side comparison is helpful. CDN servers are often located closer to users than origin servers and can have a shorter round-trip times (RTT), improving network latency. Large preview ). AVIF Gotchas.

Open Source 145

Open Source Speed Website Google 145

SQL Server According to Bob

JANUARY 11, 2020

​​ Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of publication. This White Paper is for informational purposes only.

Servers 40

Servers Cache Database Media 40