Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 121

Performance Latency Hardware Storage 121

Dynatrace

DECEMBER 22, 2021

Metrics are measures of critical system values, such as CPU utilization or average write latency to persistent storage. Observability platforms are becoming essential as the complexity of cloud-native architectures increases. But by 2015, it was more common to split up monolithic applications into distributed systems.

Artificial Intelligence 190

Artificial Intelligence Metrics Architecture DevOps 190

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. That chance encounter, coupled with the Netflix's fault-tolerant cloud, gave me enough confidence to suggest trying tsc in production as a workaround for the issue. We ended up setting it in the BaseAMI for all cloud services.

Speed 103

Speed Java AWS Virtualization 103

Brendan Gregg

FEBRUARY 28, 2023

My personal opinion is that I don't see a widespread need for more capacity given horizontal scaling and servers that can already exceed 1 Tbyte of DRAM; bandwidth is also helpful, but I'd be concerned about the increased latency for adding a hop to more memory. Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map. runqlat CPU scheduler latency heat map. This is currently part of our FlameCommander UI, which also runs flame graphs across the cloud. For a more recent example, I wrote cachestat(8) while on vacation in 2014 for use on the Netflix cloud, which was a mix of Linux 3.2

Latency 144

Latency Cache Energy Systems 144

Brendan Gregg

MAY 16, 2017

I previously wrote about Netflix in [2015] and [2016], and if you are interested in what it's like to work here, I already covered much in those posts. We're on the EC2 cloud, which has great scalability, and our own cloud architecture of microservices is also designed for scalability. Time flies! Little to no bureaucracy.

Java 75

Java Entertainment Engineering Scalability 75

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. That chance encounter, coupled with the Netflix's fault-tolerant cloud, gave me enough confidence to suggest trying tsc in production as a workaround for the issue. We ended up setting it in the BaseAMI for all cloud services.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

SEPTEMBER 25, 2021

A Cassandra database cluster had switched to Ubuntu and noticed write latency increased by over 30%. That chance encounter, coupled with the Netflix's fault-tolerant cloud, gave me enough confidence to suggest trying tsc in production as a workaround for the issue. We ended up setting it in the BaseAMI for all cloud services.

Speed 52

Speed Java AWS Virtualization 52

The Netflix TechBlog

NOVEMBER 22, 2019

4:45pm-5:45pm NFX 202 A day in the life of a Netflix Engineer Dave Hahn , SRE Engineering Manager Abstract : Netflix is a large, ever-changing ecosystem serving millions of customers across the globe through cloud-based systems and a globally distributed CDN. We explore all the systems necessary to make and stream content from Netflix.

AWS 38

AWS Entertainment Open Source Benchmarking 38

All Things Distributed

AUGUST 16, 2011

Expanding the Cloud - The AWS GovCloud (US) Region. This new region, which is located on the West Coast of the US, helps US government agencies and contractors move more of their workloads to the cloud by implementing a number of US government-specific regulatory requirements. Cloud First. Cloud Firstâ?? Comments ().

AWS 102

AWS Government Big Data Cloud 102

Brendan Gregg

AUGUST 8, 2017

Load averages are an industry-critical metric – my company spends millions auto-scaling cloud instances based on them and other metrics – but on Linux there's some mystery around them. They can be also useful when a single value of demand is desired, such as for a cloud auto scaling rule. I've never seen an explanation.

Latency 111

Latency Metrics C++ Systems 111

The Netflix TechBlog

DECEMBER 17, 2019

Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. Proceedings of the Third ACM Symposium on Cloud Computing. Beresford, and Boerge Svingen. Online event processing. Communications of the ACM 62.5

Database 203

Database Traffic Transportation Open Source 203

The Netflix TechBlog

DECEMBER 17, 2019

Passive instances across regions are also possible, though it is recommended to operate in the same region as the database host in order to keep the change capture latencies low. Proceedings of the Third ACM Symposium on Cloud Computing. Beresford, and Boerge Svingen. Online event processing. Communications of the ACM 62.5

Database 217

Database Traffic Transportation Open Source 217

Brendan Gregg

JULY 2, 2021

biolatency Disk I/O latency histogram heat map 5. runqlat CPU scheduler latency heat map 10. This is currently part of our FlameCommander UI, which also runs flame graphs across the cloud. As an extreme example, I wrote cachestat(8) while on vacation in 2014 for use on the Netflix cloud, which was a mix of Linux 3.2

Open Source 40

Open Source Latency Cache Energy 40

Alex Russell

MARCH 6, 2021

Devices and networks have evolved too: Alex Russell @slightlylate An update on mobile CPUs and the Performance Inequality Gap: Mid-tier Android devices (~$300) now get the single-core performance of a 2014 iPhone and the multi-core perf of a 2015 iPhone. The cheapest (high volume) Androids perform like 2012/2013 iPhones, respectively.

Performance 127

Performance Network Cache Metrics 127

All Things Distributed

APRIL 4, 2017

This enables customers to serve content to their end users with low latency, giving them the best application experience. In 2011, AWS opened a Point of Presence (PoP) in Stockholm to enable customers to serve content to their end users with low latency. In 2014 and 2015 respectively, AWS opened offices in Stockholm and Espoo, Finland.

AWS 112

AWS Airlines Latency Games 112

Adrian Cockcroft

AUGUST 1, 2022

photo by Adrian I gave a talk at Monitorama in Portland Oregon in June, which set out the idea that carbon is just another metric to monitor, and that in a few years most of the monitoring and performance tuning tools are going to be reporting and optimizing for carbon alongside latency, throughput, availability and cost.

AWS 52

AWS Virtualization DevOps Latency 52

Smashing Magazine

JANUARY 6, 2020

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Network Servers 145

Smashing Magazine

JANUARY 7, 2019

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. In real-life world, most products aren’t even close: an average bundle size today is around 400KB , which is up 35% compared to late 2015. On a middle-class mobile device, that accounts for 30-35 seconds for Time-To-Interactive.

Performance 105

Performance Cache Network Metrics 105

Smashing Magazine

JANUARY 11, 2021

Estimated Input Latency tells us if we are hitting that threshold, and ideally, it should be below 50ms. Designed for the modern web, it responds to actual congestion, rather than packet loss like TCP does, it is significantly faster , with higher throughput and lower latency — and the algorithm works differently.

Performance 145

Performance Cache Media Metrics 145