The Netflix TechBlog

NOVEMBER 22, 2019

by Shefali Vyas Dalal AWS re:Invent is a couple weeks away and our engineers & leaders are thrilled to be in attendance yet again this year! Netflix delivers shows like Sacred Games, Stranger Things, Money Heist, and many more to more than 150 million subscribers across 190+ countries around the world.

AWS 100

AWS Entertainment Open Source Benchmarking 100

All Things Distributed

JUNE 21, 2018

In fact, this is been proven by our customers as Amazon Aurora remains the fastest growing service in AWS history. Typical use cases for a relational database include web and mobile applications, enterprise applications, and online gaming. The opposite is true. Building applications with purpose-built databases.

Database 167

Database AWS Games Latency 167

All Things Distributed

AUGUST 20, 2015

Today, we are releasing a plugin that allows customers to use the Titan graph engine with Amazon DynamoDB as the backend storage layer. It opens up the possibility to enjoy the value that graph databases bring to relationship-centric use cases, without worrying about managing the underlying storage. The importance of relationships.

Database 121

Database Logistics Availability Social Media 121

All Things Distributed

APRIL 9, 2015

Details on the AWS Blog. AWS has been offering a range of storage solutions: objects, block storage, databases, archiving, etc. When we designed Amazon EFS we decided to build along the AWS principles: Elastic, scalable, highly available, consistent performance, secure, and cost-effective. Details on the AWS Blog.

Lambda 104

Lambda Cloud IoT AWS 104

All Things Distributed

JANUARY 18, 2012

Amazon DynamoDB stores data on Solid State Drives (SSDs) and replicates it synchronously across multiple AWS Availability Zones in an AWS Region to provide built-in high availability and data durability. Customers can typically achieve average service-side in the single-digit milliseconds. History of NoSQL at Amazon â??

Scalability 162

Scalability Database Ecommerce Latency 162

The Netflix TechBlog

SEPTEMBER 10, 2024

Where aws ends and the internet begins is an exercise left to the reader. KeyValue is an abstraction over the storage engine itself, which allows us to choose the best storage engine that meets our SLO needs. Finally, the device receives the message, and the action, such as “Show me Stranger Things on Netflix”, is performed.

Latency 234

Latency Cache Tuning Efficiency 234

All Things Distributed

OCTOBER 8, 2014

The best part is that we are also significantly expanding the free tier many of you already enjoy by increasing the storage to 25 GB and throughput to 200 million requests per month. More than a decade ago, Amazon embarked on a mission to build a distributed system that challenged conventional methods of data storage and querying.

Availability 124

Availability Performance Scalability AWS 124

High Scalability

OCTOBER 24, 2022

The disincentive to game service pricing levels in order to create short-term profits at the expense of long-term investment will be overwhelming. For example, AWS created Nitro. Would Nitro have been invented if AWS was restricted to being a platform provider?

Cloud 187

Cloud Hardware Infrastructure Innovation 187

All Things Distributed

JULY 13, 2010

Cluster Compute Instances for Amazon EC2 change the HPC game for two important reasons: Access to scalable on-demand capacity. Jeff Barr in his blog post on the AWS developer blog has additional details and there are some great testimonials of early Cluster Compute Instances customers in the press release. More information.

Cloud 98

Cloud AWS Automotive Latency 98

Scalegrid

JANUARY 8, 2024

Exploring artificial intelligence in cloud computing reveals a game-changing synergy. In this way, intelligent automation is a game-changer in the cloud computing landscape. Discover how AI is reshaping the cloud and what this means for the future of technology. Frequently Asked Questions What role does AI play in cloud computing?

Artificial Intelligence 147

Artificial Intelligence Cloud Scalability Analytics 147

Brendan Gregg

DECEMBER 31, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Alex Maestretti (security) co-presented SecOps 2021 Today: Using AWS Services to Deliver SecOps. File System. Networking. tcp_wmem = 4096 12582912 16777216 net.ipv4.tcp_rmem

Tuning 53

Tuning AWS Best Practices Network 53

High Scalability

JUNE 22, 2018

Each drone is rated with a game mechanic and gets special privileges based on performance (just kidding). using them to respond to storage events on s3 or database events or auth events is super easy and powerful. Eitally : there are a few critical differences between GCP and AWS or Azure. Do you like this sort of Stuff?

Internet 113

Internet Internet Scalability Artificial Intelligence 113

Brendan Gregg

DECEMBER 30, 2017

My last talk for 2017 was at AWS re:Invent, on "How Netflix Tunes EC2 Instances for Performance," an updated version of my [2014] talk. Storage I/O. Alex Maestretti (security) co-presented SecOps 2021 Today: Using AWS Services to Deliver SecOps. File System. Networking. tcp_wmem = 4096 12582912 16777216 net.ipv4.tcp_rmem

Tuning 52

Tuning AWS Best Practices Network 52

All Things Distributed

SEPTEMBER 30, 2010

With existing customers I get a change to dive deep on their AWS usage and understand what works well and where we can do better. AWS Solutions Architect Matt Tavis will present on " Architecting for the Cloud ". AWS Startup Event in Tel Aviv on October 12 with customers Porticor , SemantiNet , Live Definition. . | Comments ().

AWS 66

AWS Cloud Storage Best Practices 66

All Things Distributed

MARCH 11, 2015

AWS is enabling innovations in areas such as healthcare, automotive, life sciences, retail, media, energy, robotics that it is mind boggling and humbling. For example many of the Internet of Things innovations that we have seen come to life in the past years on AWS all have a significant analytics components to it.

Analytics 109

Analytics Cloud Healthcare Retail 109

The Morning Paper

MARCH 3, 2020

It takes you through the thinking processes and engineering practices behind the design of a key part of the control plane for AWS Elastic Block Storage (EBS): the Physalia database that stores configuration information. For Physalia, and for AWS more generally, the guiding principle is minimise the blast radius. NSDI’20.

Database 106

Database AWS Network Design 106

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] Apr 2018 - [Cutress 19] Dr. DDR6: Here's What to Expect in RAM Modules,” [link] Nov 2020 - [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] Jul 2020 - [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 103

Performance Latency Cache Virtualization 103

Brendan Gregg

FEBRUARY 28, 2023

Titus, the Netflix container management platform, is now open source,” [link] , Apr 2018 [Cutress 19] Dr. DDR6: Here's What to Expect in RAM Modules,” [link] , Nov 2020 [Salter 20] Jim Salter, “Western Digital releases new 18TB, 20TB EAMR drives,” [link] , Jul 2020 [Spier 20] Martin Spier, Brendan Gregg, et al.,

Performance 52

Performance Latency Cache Virtualization 52

Percona

FEBRUARY 24, 2023

Figure 1: PMM Home Dashboard From the Amazon Web Services (AWS) documentation , an instance is considered over-provisioned when at least one specification of your instance, such as CPU, memory, or network, can be sized down while still meeting the performance requirements of your workload and no specification is under-provisioned.

Cloud 133

Cloud Serverless AWS Storage 133

Adrian Cockcroft

NOVEMBER 11, 2019

A learning organization, disaster recovery testing, game days, and chaos engineering tools are all important components of a continuously resilient system. This is why most AWS regions have three availability zones. This discussion focuses on hardware, software and operational failure modes.

Latency 53

Latency Systems Engineering Hardware 53

Adrian Cockcroft

NOVEMBER 11, 2019

A learning organization, disaster recovery testing, game days, and chaos engineering tools are all important components of a continuously resilient system. This is why most AWS regions have three availability zones. This discussion focuses on hardware, software and operational failure modes.

Latency 52

Latency Systems Engineering Hardware 52

Smashing Magazine

JANUARY 7, 2019

Brotli is widely supported, and many CDNs support it ( Akamai , AWS , KeyCDN , Fastly , Cloudlare , CDN77 ) and you can enable Brotli even on CDNs that don’t support it yet (with a service worker). To optimize storage interally, you could use Dropbox’s new Lepton format for losslessly compressing JPEGs by an average of 22%.

Performance 111

Performance Cache Network Metrics 111

Smashing Magazine

JANUARY 6, 2020

Brotli is widely supported, and many CDNs support it ( Akamai , AWS , KeyCDN , Fastly , Cloudlare , CDN77 ) and you can enable Brotli even on CDNs that don’t support it yet (with a service worker). To optimize storage interally, you could use Dropbox’s new Lepton format for losslessly compressing JPEGs by an average of 22%.

Performance 112

Performance Cache Servers Network 112

Smashing Magazine

JANUARY 11, 2021

Brotli is widely supported, and many CDNs support it ( Akamai , Netlify Edge , AWS , KeyCDN , Fastly (currently only as a pass-through), Cloudflare , CDN77 ) and you can enable Brotli even on CDNs that don’t support it yet (with a service worker). You can also estimate Brotli compression savings for your site.

Performance 145

Performance Cache Media Metrics 145