The Netflix TechBlog

MAY 1, 2019

In late 2017, we received some critical feedback from the brothers on the Stranger Things 2 audio mix: in some scenes, there was a reduced sense of where sounds are located in the 5.1-channel We want your experience to be brilliant even if you aren’t listening with a state-of-the-art home theater system. We began streaming 5.1

Engineering 274

Engineering Network Media Entertainment 274

SQL Performance

JANUARY 23, 2020

The queues component of our methodology comes from Performance Monitor counters, which provide a view of system performance from a resource standpoint.". Tom Davidson, Opening Microsoft's Performance-Tuning Toolbox SQL Server Pro Magazine, December 2003. Waiting queries mean waiting applications and users, and no one likes to wait!

Tuning 115

Tuning Servers Monitoring Hardware 115

Brendan Gregg

SEPTEMBER 5, 2017

What follows are topics that may be of interest to anyone looking to migrate their systems and skillset: scan these to find topics that interest you. ## ZFS ZFS is available for Linux via the [zfsonlinux] and [OpenZFS] projects, and more recently was included in Canonical's Ubuntu Linux distribution: Ubuntu Xenial 16.04 LTS (April 2016).

Virtualization 75

Virtualization AWS Engineering Hardware 75

Brendan Gregg

SEPTEMBER 5, 2021

They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at [Kernel Recipes] in 2017 and have shared the full story here. ## 1. These included a breakdown of CPU time into percentages for "usr" (user: applications) and "sys" (system: the kernel). contending for the same locks).

Cache 141

Cache Cloud Code Java 141

SQL Server According to Bob

SEPTEMBER 25, 2017

Scott Guthrie and Rohan Kumar officially made the announcement today at Ignite that SQL Server 2017 will be generally available on October 2nd, 2017. Andrew Brust also wrote a very nice article detailing out all the great new features that come with SQL Server 2017. Principal Architect, Microsoft Database Systems Group.

Servers 40

Servers Availability Tuning Database 40

The Netflix TechBlog

JULY 1, 2019

Surface Cache Surface cache is a reserved pool in main memory (or separate graphics memory on a minority of systems) that the Netflix app uses for storing textures (decoded images and cached resources). those running the 2017 SDK?—?also The SNG files have a relatively large download size at ~1.5MB each.

Cache 167

Cache Design Testing Development 167

All Things Distributed

OCTOBER 2, 2017

With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database.

Internet 111

Internet Internet AWS Performance 111

Scalegrid

AUGUST 27, 2024

Key features of RabbitMQ, such as message acknowledgments, complex routing, and asynchronous processing, contribute to system reliability and performance. By decoupling applications, message queues enable them to operate independently and asynchronously, which is crucial for maintaining efficiency and flexibility in complex systems.

Ecommerce 130

Ecommerce IoT Games Scalability 130

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. Checking those available: $ cat /sys/devices/system/clocksource/clocksource0/available_clocksource. Try changing the kernel clocksource.

Speed 103

Speed Java AWS Virtualization 103

Percona

AUGUST 17, 2023

StackOverflow statistics show that 26% of developers preferred it in 2017, 34% in 2019, and 40% in 2021. In another survey, using multiple metrics for overall popularity, PostgreSQL ranks as the fourth most popular database management system ( DB-Engines, March 2023 ).

Open Source 98

Open Source Healthcare Social Media Database 98

SQL Performance

MARCH 17, 2020

Back in 2014, I wrote an article called Performance Tuning the Whole Query Plan. The optimizer chooses this plan without any hints on my system configuration because the estimated cost of the plan is below the cost threshold for parallelism. Cost" column shows the optimizer's cost estimate for each query as reported on the test system.

Servers 86

Servers Tuning Database Efficiency 86

O'Reilly Software

APRIL 4, 2018

Are there inherent time relationships in the messages that need to be preserved as they travel across the system? The data shape will dictate capacity planning, tuning of the backbone, and scalability analysis for individual components. What message process warranty level do we require? At least once? At most once? Exactly once?

Architecture 80

Architecture Scalability Google Operating System 80

Percona

APRIL 12, 2023

Instead of relational (SQL) databases defined primarily through a hierarchy of related sets via tables and columns, their non-relational structure used a system of collections and documents. 2017: MongoDB goes public, trading as MDB. They came up with a horizontally scalable NoSQL database.

Open Source 98

Open Source Programming Database Servers 98

Particular Software

DECEMBER 14, 2020

ServiceControl is the nerve center of your distributed system, storing the data and providing the APIs that allow ServicePulse and ServiceInsight to function. When enabling saga audits in an existing system make sure to provision enough resources as the Saga Audit plugin sends one additional message for each message processed by a saga.

Azure 52

Azure Transportation Tuning Processing 52

Smashing Magazine

JUNE 3, 2022

These compiled systems for letters and symbols, which are representations of sounds and information, get a lot of use and are a large part of graphic communication. Fast forward to the early 1960s, phototypesetting systems appeared. Instead, we need to address multiple factors within the design system. Stay tuned!

Performance 123

Performance Design Best Practices Testing 123

Brendan Gregg

SEPTEMBER 5, 2021

They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at Kernel Recipes in 2017; it is an old story that's worth resharing here. These included a breakdown of CPU time into percentages for "usr" (user: applications) and "sys" (system: the kernel).

Cache 52

Cache Cloud Java Tuning 52

Alex Russell

MARCH 31, 2022

Like every other successful platform, the web operates on a finely tuned understanding of risk and trust , and deprecations are particularly explosive. [2] Shared caches must make sense within this value system. Systems that externalise governance and administrative costs to browser vendors are also unattractive. Trust Falls #.

Cache 89

Cache Government Traffic Network 89

SQL Performance

MAY 7, 2019

Understanding what these mean and how to investigate them is critical so you don’t succumb to what I call ‘knee-jerk performance tuning’ and waste time and effort trying to fix a problem that isn’t actually a problem. Someone complained about a sluggish system yesterday afternoon or a report that timed out last Tuesday? No problem.

Servers 40

Servers Metrics Azure Tuning 40

Brendan Gregg

SEPTEMBER 5, 2021

They claimed that the ZFS file system was consuming 30% of CPU capacity. I summarized this case study at [Kernel Recipes] in 2017; it is an old story that's worth resharing here. ## 1. These included a breakdown of CPU time into percentages for "usr" (user: applications) and "sys" (system: the kernel). Ahh, it makes sense now.

Cache 40

Cache Cloud Code Java 40

Brendan Gregg

SEPTEMBER 25, 2021

CLI tools The Cassandra systems were EC2 virtual machine (Xen) instances. Microbenchmark os::javaTimeMillis() on both systems. Running this on the two systems saw similar results. A quick check of basic performance statistics showed over 30% higher CPU consumption. Try changing the kernel clocksource. include <sys/time.h>

Speed 40

Speed Java AWS Virtualization 40

Randon ASCII

APRIL 17, 2018

When you own all of the code then this may involve some back of the envelope estimates, competitive benchmarking, or intuition tuned by experience. When dealing with a closed box like Microsoft’s NTFS file system it’s trickier to know if things could be running faster than they are. I then worked with the tool’s author to get a fix.

Monitoring 43

Monitoring C++ Code Processing 43

SQL Performance

SEPTEMBER 2, 2021

I’ve written several articles about this function (and STRING_AGG, which arrived in SQL Server 2017) since this post was written: Performance Surprises and Assumptions : STRING_SPLIT(). He spent a lot of time fine-tuning this CLR function to efficiently parse a string. STRING_SPLIT() in SQL Server 2016 : Follow-Up #1. Sanity checking.

C++ 46

C++ Servers Testing Performance 46

The Netflix TechBlog

FEBRUARY 13, 2024

Safe software deployment, canary testing, and play-delay Software engineering readers of this blog are likely familiar with unit, integration and load testing, as well as other testing practices that aim to prevent bugs from reaching production systems. Rationale : This system is part of a semi-automated process for all client deployments.

Testing 248

Testing Software Software Metrics 248

Rigor

SEPTEMBER 11, 2019

Rachel is also one of the people behind Perch , a PHP content management system (CMS). His keynote address from O’Reilly Fluent 2017, Reflecting on 20 years on the web , is a must-see. He served as the Editor-in-Chief of Smashing Magazine until October 2017 when he passed the baton to the remarkable Rachel Andrew.

Performance 89

Performance Education Google Website 89

John McCalpin

JANUARY 22, 2018

A peculiar throughput limitation on Intel’s Xeon Phi x200 (Knights Landing) Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. not FMAs). FMAs/cycle.

Latency 40

Latency Hardware Code Testing 40

John McCalpin

JANUARY 22, 2018

Introduction: In December 2017, my colleague Damon McDougall (now at AMD) asked for help in porting the fused multiply-add example code from a Colfax report ( [link] ) to the Xeon Phi x200 (Knights Landing) processors here at TACC. of the “adjusted peak performance”, there is no longer a significant upside to performance tuning.

Latency 40

Latency Hardware Code Testing 40

O'Reilly

JULY 25, 2023

To provide some coherence to the music, I decided to use Taylor Swift songs since her discography covers the time span of most papers that I typically read: Her main albums were released in 2006, 2008, 2010, 2012, 2014, 2017, 2019, 2020, and 2022. This choice also inspired me to call my project Swift Papers.

Programming 98

Programming Code Design Benchmarking 98

Percona

JANUARY 14, 2019

To simulate text messages I have used ~3 billion of reddit comments (10 years from 2007 to 2017), downloaded from pushshift.io. In a partitioned massively parallel database system, the storage format and sorting algorithm may not be optimized for that operation as we are reading multiple partitions in parallel. Conclusion.

Database 48

Database Analytics Blockchain Healthcare 48