The Netflix TechBlog

OCTOBER 19, 2020

Reconstructing a streaming session was a tedious and time consuming process that involved tracing all interactions (requests) between the Netflix app, our Content Delivery Network (CDN), and backend microservices. The process started with manual pull of member account information that was part of the session.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. WARNING: These tunables were developed in late 2017, for Ubuntu Xenial instances on EC2.** Networking. We help where we can. schedtool –B PID. Virtual Memory. vm.swappiness = 0 # from 60.

Tuning 53

Tuning AWS Best Practices Network 53

Dynatrace

JUNE 15, 2023

If your app runs in a public cloud, such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP), the provider secures the infrastructure, while you’re responsible for security measures within applications and configurations. What are some key characteristics of securing cloud applications?

Cloud 245

Cloud Open Source Architecture Monitoring 245

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. WARNING: These tunables were developed in late 2017, for Ubuntu Xenial instances on EC2.** Networking. We help where we can. schedtool –B PID. Virtual Memory. vm.swappiness = 0 # from 60.

Tuning 52

Tuning AWS Best Practices Network 52

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 121

Performance Latency Hardware Storage 121

Dynatrace

OCTOBER 17, 2019

Everything as Code can be described as a methodology or practice which consists of extending the idea of how applications are treated as code and applying these concepts to all other IT components like operating systems, network configurations, and pipelines. We went from managing five EC2 instances in 2011 to around 1,000 in 2017.

Code 167

Code Infrastructure DevOps Cloud 167

All Things Distributed

SEPTEMBER 25, 2017

Today, I am excited to announce plans for Amazon Web Services (AWS) to bring an infrastructure Region to the Middle East! Based in Bahrain, this will be the first Region for AWS in the Middle East. This news marks the 22nd AWS Region we have announced globally. 2017 continues a busy year for AWS in the Middle East.

Cloud 117

Cloud Education Energy Government 117

O'Reilly

FEBRUARY 18, 2020

Up until 2017, the ML+AI topic had been amongst the fastest growing topics on the platform. After several years of steady climbing—and after outstripping Java in 2017—Python-related interactions now comprise almost 10% of all usage. Not necessarily: Java-related searches increased by 5% between 2017 and 2018. Coincidence?

Software Architecture 145

Software Architecture DevOps Data Engineering Architecture 145

Brendan Gregg

NOVEMBER 28, 2017

At Netflix, we've been using these technologies as they've been made available for instance types in the AWS EC2 cloud. The latest AWS hypervisor, Nitro, uses everything to provide a new hardware-assisted hypervisor that is easy to use and has near bare-metal performance. AWS called this [enhanced networking]. Impressive!

Virtualization 40

Virtualization AWS Hardware Storage 40

Brendan Gregg

SEPTEMBER 5, 2017

At my employer we sometimes use SR-IOV for direct network interface access, and NVMe for direct disk access. Most of the changes since rc7 are actually networking fixes, the bulk of them to various drivers. But there's another factor at play: jobs are also migrating from both Solaris and Linux to cloud jobs instead, specifically AWS.

Virtualization 75

Virtualization AWS Engineering Hardware 75

All Things Distributed

MAY 19, 2017

Soon after the launch of Amazon Relation Dabase Service (RDS) AWS customers were giving us feedback that they would love to migrate to RDS but what they would love even more was if we could also unshackle them from the high-cost, punitive licensing schemes that came with the proprietary databases.

Database 88

Database Design Cloud Storage 88

All Things Distributed

OCTOBER 2, 2017

As we began growing the AWS business, we realized that external customers might find our Dynamo database just as useful as we found it within Amazon.com. So, we set out to build a fully hosted AWS database service based upon the original Dynamo design. As we say at AWS, It is still Day One for DynamoDB.

Internet 110

Internet Internet AWS Performance 110

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. [link] 2021 - [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] Apr 2021 - [Ghigoff 21] Yoann Ghigoff, et al., "BMC:

Performance 103

Performance Latency Cache Google 103

The Symphonia

DECEMBER 6, 2017

The light show at the re:Play party Another re:Invent has come and gone, and us mere AWS-using mortals are now rapidly trying to sort the wheat from the chaff of a heady harvest of announcements. It’s funny to think that AWS Lambda was announced at re:Invent only 3 years ago?—?the to a massively distributed CDN network a possibility.

Serverless 40

Serverless Lambda AWS Traffic 40

Brendan Gregg

JULY 15, 2019

At over 700 pages, it covers CPUs, memory, disks, file systems, networking, multiple languages, applications, containers, hypervisors, security analysis, and the Linux kernel. - I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit.

Systems 111

Systems Performance Education Technology 111

Percona

APRIL 12, 2023

2017: MongoDB goes public, trading as MDB. This part of the actual SSPL language speaks volumes: If you make the functionality of the Program or a modified version available to third parties as a service, you must make the Service Source Code available via network download to everyone at no charge, under the terms of this License.

Open Source 98

Open Source Programming Database Servers 98

Brendan Gregg

JULY 4, 2021

AWS Graviton2); for memory with the arrival of DDR5 and High Bandwidth Memory (HBM) on-processor; for storage including new uses for 3D Xpoint as a 3D NAND accelerator; for networking with the rise of QUIC and eXpress Data Path (XDP); and so on.

Performance 52

Performance Latency Hardware Storage 52

Abhishek Tiwari

DECEMBER 1, 2017

At re:Invent 2017, Amazon Web Services (AWS) announced Amazon Time Sync Service which provides a highly accurate and reliable global time reference. This service is immediately available in all AWS regions. With the launch of Amazon Time Sync Service, AWS regions are equipped with similar GPS and atomic clocks.

AWS 55

AWS Google Database Virtualization 55

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. [link] , 2021 [Trader 21] Tiffany Trader, “Cerebras Second-Gen 7nm Wafer Scale Engine Doubles AI Performance Over First-Gen Chip ,” [link] , Apr 2021 [Ghigoff 21] Yoann Ghigoff, et al.,

Performance 52

Performance Latency Cache Google 52

Enprowess

JANUARY 12, 2022

Twitter Lite PWA : It was integrated as the standard User Interface in 2017. IBM OpenWhisk, Microsoft Azure, AWS Lambda, and Google Cloud Functions are famous names that provide server-less services. Serverless Computing – AWS Lambda – Amazon Web Services. Pinterest PWA: Pins increased by 401%. AI-powered Chatbots.

Blockchain 59

Blockchain IoT Development Serverless 59

Brendan Gregg

JULY 14, 2019

At over 700 pages, it covers CPUs, memory, disks, file systems, networking, multiple languages, applications, containers, hypervisors, security analysis, and the Linux kernel. - I'm also grateful that my fiancée, Deirdré Straughan, could find the time outside of her AWS job to do technical copy-edit.

Systems 40

Systems Performance Education Technology 40

Smashing Magazine

JANUARY 7, 2019

If you don’t have a device at hand, emulate mobile experience on desktop by testing on a throttled network (e.g. To make the performance impact more visible, you could even introduce 2G Tuesdays or set up a throttled 3G network in your office for faster testing. 150ms RTT, 1.5 Mbps down, 0.7 Mbps up) with a throttled CPU (5× slowdown).

Performance 111

Performance Cache Network Metrics 111