Brendan Gregg

NOVEMBER 29, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. AWS called this [enhanced networking]. Impressive!

Virtualization 110

Virtualization AWS Hardware Storage 110

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014). flame graphs (2014). eBPF tools (2014-2019). I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive [work culture]. I could help not only Netflix but all customers of the cloud. PMC analysis (2017). my pandemic-abandoned desk (2020); office wall.

Java 142

Java Cloud Cache AWS 142

The Netflix TechBlog

FEBRUARY 20, 2019

by Jason Koch , with Martin Spier , Brendan Gregg , Ed Hunter Improving the tools available to our engineers to help them diagnose, triage, and work through software performance challenges in the cloud is a key goal for the cloud performance engineering team at Netflix.

Performance 217

Performance Latency Open Source Metrics 217

High Scalability

NOVEMBER 16, 2018

Know anyone looking for a simple book explaining the cloud? book: Explain the Cloud Like I'm 10. AWS Redshift FTW! yishengdd : However from my own experience, AWS Amplify is 10x better than Google Firebase. Doubleslash : Back in 2014 OpenStack may have been a thing but nowadays, 4 years later, people learned a lesson.

Internet 28

Internet Internet Scalability Energy 28

All Things Distributed

SEPTEMBER 26, 2014

The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. Take a look at the AWS Loft homepage. What’s Happening at the AWS Loft.

AWS 93

AWS Games Education Innovation 93

All Things Distributed

MAY 19, 2017

Soon after the launch of Amazon Relation Dabase Service (RDS) AWS customers were giving us feedback that they would love to migrate to RDS but what they would love even more was if we could also unshackle them from the high-cost, punitive licensing schemes that came with the proprietary databases.

Database 91

Database Design Cloud Storage 91

Dynatrace

JULY 13, 2020

Cloud Native DevOps with Kubernetes : . Cloud: A utomation of infrastructure and services on-demand, pay as you use model . Cloud-native? refers to cloud-based, containerized, distributed systems, made up of cooperating microservices, dynamically managed by automated infrastructure as code. . ?

Google 133

Google DevOps Ecommerce Cloud 133

Dynatrace

JULY 13, 2020

Cloud Native DevOps with Kubernetes : . Cloud: A utomation of infrastructure and services on-demand, pay as you use model . Cloud-native? refers to cloud-based, containerized, distributed systems, made up of cooperating microservices, dynamically managed by automated infrastructure as code. . ?

Google 130

Google DevOps Ecommerce Cloud 130

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 121

Performance Latency Hardware Storage 121

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 103

Speed Java AWS Virtualization 103

Adrian Cockcroft

MARCH 24, 2020

While datacenter based IT costs are largely fixed, in a three year depreciation schedule, cloud costs are inherently variable, and can be sized to fit the need. When times get tough, a focus on cost optimization can also greatly reduce cloud costs, and the results take effect in next month’s bill.

Cloud 52

Cloud Social Media Entertainment Healthcare 52

High Scalability

JUNE 22, 2018

And if you know anyone looking for a simple book that uses lots of pictures and lots of examples to explain the cloud, then please recommend my new book: Explain the Cloud Like I'm 10. 40 million : Netflix monthly spend on cloud services; 5% : retention increase can increase profits 25%; 50+% : Facebook's IPv6 traffic from the U.S,

Internet 113

Internet Internet Scalability Artificial Intelligence 113

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Not a lot has changed with these tunables since my [2014] talk. Donovan Fritz and Joel Kodama (networking) A Day in the Life of a Cloud Network Engineer at Netflix. Networking.

Tuning 53

Tuning AWS Best Practices Network 53

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Not a lot has changed with these tunables since my [2014] talk. Donovan Fritz and Joel Kodama (networking) A Day in the Life of a Cloud Network Engineer at Netflix. Networking.

Tuning 52

Tuning AWS Best Practices Network 52

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] Mar 2020 - [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 - [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 103

Performance Latency Cache Virtualization 103

Adrian Cockcroft

MARCH 24, 2020

While datacenter based IT costs are largely fixed, in a three year depreciation schedule, cloud costs are inherently variable, and can be sized to fit the need. When times get tough, a focus on cost optimization can also greatly reduce cloud costs, and the results take effect in next month’s bill.

Cloud 40

Cloud Social Media Entertainment Healthcare 40

Brendan Gregg

NOVEMBER 28, 2017

Hardware virtualization for cloud computing has come a long way, improving performance using technologies such as VT-x, SR-IOV, VT-d, NVMe, and APICv. At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. AWS called this [enhanced networking]. Impressive!

Virtualization 40

Virtualization AWS Hardware Storage 40

Brendan Gregg

APRIL 14, 2022

offer letter logo (2014) flame graphs (2014) eBPF tools (2014-2019) PMC analysis (2017) my pandemic-abandoned desk (2020); office wall I joined Netflix in 2014, a company at the forefront of cloud computing with an attractive work culture. I could help not only Netflix but all customers of the cloud.

Java 52

Java Cache Cloud AWS 52

Brendan Gregg

JULY 4, 2021

It's an exciting time for developments in computer performance, not just for the BPF technology (which I often [write about]) but also for processors with 3D stacking and cloud vendor CPUs (e.g., Ford, et al., “TCP on Upcoming Sapphire Rapids CPUs,” [link] Oct 2020 - [Liu 20] Linda Liu, “Samsung QVO vs EVO vs PRO: What’s the Difference?

Performance 52

Performance Latency Hardware Storage 52

Brendan Gregg

AUGUST 29, 2021

A cloud-wide monitoring tool, Atlas, showed a high rate of paging for the larger file uploads: The blue is pageins (page ins). 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25

Cache 78

Cache C++ AWS Java 78

Brendan Gregg

SEPTEMBER 5, 2017

Xen's biggest user is the Amazon EC2 cloud, which has over one million customers, and appears to be a custom version (it self identifies as version "3.4.3.amazon"). The way the cloud is used helps with security: most instances at my employer have only been up for one or two days. Oracle VM Server is based on Xen.

Virtualization 75

Virtualization AWS Engineering Hardware 75

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 52

Speed Java AWS Virtualization 52

Brendan Gregg

FEBRUARY 28, 2023

TCP Extensions for Multipath Operation with Multiple Addresses,” [link] , Mar 2020 [Gregg 20] Brendan Gregg, “Systems Performance: Enterprise and the Cloud, Second Edition,” Addison-Wesley, 2020 [Hruska 20] Joel Hruska, “Intel Demos PCIe 5.0 Ford, et al., “TCP

Performance 52

Performance Latency Cache Virtualization 52

Brendan Gregg

SEPTEMBER 25, 2021

These strange questions came to the fore back in 2014 when Netflix was switching services from CentOS Linux to Ubuntu, and I helped debug several weird performance issues including one I'll describe here. Aftermath I provided details to AWS and Canonical, and then moved onto the other performance issues as part of the migration.

Speed 40

Speed Java AWS Virtualization 40

Brendan Gregg

AUGUST 29, 2021

A cloud-wide monitoring tool, Atlas, showed a high rate of paging for the larger file uploads: The blue is pageins (page ins). 1072-aws (xxx) 12/18/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 5.03 1072-aws (xxx) 12/19/2018 _x86_64_ (16 CPU) avg-cpu: %user %nice %system %iowait %steal %idle 12.25

Cache 40

Cache C++ AWS Systems 40

All Things Distributed

APRIL 4, 2017

Today, I am very excited to announce our plans to open a new AWS Region in the Nordics! The new region will give Nordic-based businesses, government organisations, non-profits, and global companies with customers in the Nordics, the ability to leverage the AWS technology infrastructure from data centers in Sweden.

AWS 110

AWS Airlines Latency Games 110